Made by Thompson InfoSec |

>AI Security Tools

Open-source guardrails, scanners, and red-team frameworks for AI systems

0x4D31/galah

GitHub
661
Go
Updated last year

Galah: An LLM-powered web honeypot.


golanghoneypotllmopenaiopenai-apisecuritysecurity-tools

0x4m4/hexstrike-ai

GitHub
11,210
Python
Updated last month

HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.


0x4m4aiai-agentsai-cybersecurityai-hackingai-penetration-testingai-security-toolartificial-intelligencectf-toolsgenerative-aikali-linuxkali-toolsllmllm-integrationmcpmcp-servermcp-toolspentestingpentesting-toolshexstrike

1Password/SCAM

GitHub
136
Python
Updated this year

SCAM - Security Comprehension Awareness Measure | Open-source benchmark that tests AI agents' security awareness during realistic, multi-turn workplace tasks.


Adversis/mcp-snitch

GitHub
94
Swift
Updated this year

MCP Snitch is a macOS application that intercepts and monitors MCP server communications, providing security analysis, access control, and audit logging for AI tool usage.


Adversis/sketchy

GitHub
71
Go
Updated this year

A tool for folks who `git clone` first and ask questions later


AikidoSec/opengrep-rules

GitHub
37
Updated this year


aliasrobotics/cai

GitHub
9,770
Python
Updated this year

Cybersecurity AI (CAI), the framework for AI Security


artificial-intelligencecybersecuritygenerative-aillmpentestingframework

anshumanbh/securevibes

GitHub
282
Python
Updated this year

A security system to protect your vibecoded apps


anshumanbh/vulnvibes

GitHub
19
Python
Updated this year

An agent that can help triage vulnerabilities across multiple codebases


anthropics/claude-code-security-review

GitHub
5,921
Python
Updated this year

An AI-powered security review GitHub Action using Claude to analyze code changes for security vulnerabilities.


antropos17/Aegis

GitHub
143
JavaScript
Updated this week

Open-source EDR for AI agents. Monitor processes, files, network, and behavior of autonomous AI agents.


ai-agentsai-securitycybersecuritydeveloper-toolselectronmonitoringopen-sourceprivacyaidesktop-appsecuritysvelteai-safetyedrtypescript

appsecco/vulnerable-mcp-servers-lab

GitHub
276
JavaScript
Updated this year

A collection of servers which are deliberately vulnerable to learn Pentesting MCP Servers.


ai-red-teamingai-researchhackingmcpmcp-clientmcp-serverpentestingvulnerable-labsappseccobugbountylearning-pentesting

aress31/burpgpt

GitHub
2,347
Java
Updated 2 years ago

A Burp Suite extension that integrates OpenAI's GPT to perform an additional passive scan for discovering highly bespoke vulnerabilities and enables running traffic-based analysis of any type.


aiburp-extensionsburpsuitecybersecuritygptopenaipentestingsecuritysecurity-automationwebappburp-pluginburpsuite-extendergpt-3openai-api

arm/metis

GitHub
845
Python
Updated this week

Metis is an open-source, AI-driven tool for deep security code review


atiilla/sqlmap-ai

GitHub
445
Python
Updated this year

This script automates SQL injection testing using SQLMap with AI-powered decision making.


atomicchonk/roadrecon_mcp_server

GitHub
52
Python
Updated last year

Claude MCP server to perform analysis on ROADrecon data


Azure/counterfit

GitHub
936
Python
Updated last year

a CLI that provides a generic automation layer for assessing the security of ML models


Azure/PyRIT

Archived GitHub
115
Updated this year

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.


ai-red-teamgenerative-aired-team-toolsresponsible-ai

backbay-labs/clawdstrike

GitHub
286
TypeScript
Updated this year

AI EDR for developer workstations and autonomous agent fleets. Build Swarm Detection & Response platforms with Clawdstrike.


agentscybersecuritycybersecurity-toolsopenclaw-securitysecuritysecurity-toolsagent-securityagentic-securitymulti-agentmulti-agent-systemsdetection-engineeringendpoint-securitythreat-huntingthreat-intelligencethreat-detectioncyber-defensecyber-securityai-securityai-security-tooledr

BCG-X-Official/artkit

GitHub
170
Jupyter Notebook
Updated last year

Automated prompt-based testing and evaluation of Gen AI applications


asynciogen-aigenaipythonred-teamingtest-automationdata-science

beelzebub-labs/beelzebub

GitHub
2,151
Go
Updated this week

A secure low code deception runtime framework, leveraging AI for System Virtualization.


cybersecuritysecurityhoneypotframeworkgoresearch-projectwhitehatcloudnativecloudsecurityllmllm-securityllm-honeypotdeceptionllamamcpmcp-honeypotdecoysagentic-ai-securityacispreemptive-cybersecurity

bethgelab/foolbox

GitHub
2,972
Python
Updated 2 years ago

A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX


adversarial-examplesmachine-learningpythonadversarial-attackspytorchtensorflowjaxkeras

BishopFox/raink

GitHub
178
Go
Updated last year

Use LLMs for document ranking


boostsecurityio/poutine

GitHub
507
Go
Updated this year

poutine, a supply chain vulnerability scanner for build pipelines


ciclidevopsdevsecopsgithubgithub-actionsgolangsecuritysecurity-scannersupply-chainsupply-chain-securitygh-extension

boostsecurityio/smokedmeat

GitHub
375
Go
Updated last month

A CI/CD Red Team Framework for demonstrating Build Pipeline security risks.


ciclidevopsdevsecopsexploitationgithub-actionsgolangred-teamsecuritysupply-chainsupply-chain-securitytui

borisdan/mcp-audit-extension

GitHub
27
TypeScript
Updated this year

Audit and log all GitHub Copilot MCP tool calls in VSCode with ease.


centerforaisafety/HarmBench

GitHub
1,029
Jupyter Notebook
Updated 2 years ago

HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal


cisco-ai-defense/a2a-scanner

GitHub
163
Python
Updated this year

Scan A2A agents for potential threats and security issues


a2a-protocola2a-serveragent-securitysecurity-scanner

cisco-ai-defense/mcp-scanner

GitHub
1,044
Python
Updated this week

Scan MCP servers for potential threats & security findings.


agentsaimcpsecurity

cisco-ai-defense/skill-scanner

GitHub
2,447
Python
Updated last month

Security Scanner for Agent Skills


agentagent-skillssecurity

cleverhans-lab/cleverhans

GitHub
6,449
Jupyter Notebook
Updated 3 years ago

An adversarial example library for constructing attacks, building defenses, and benchmarking both


machine-learningsecuritybenchmarking

confident-ai/deepteam

GitHub
2,567
Python
Updated this week

DeepTeam is a framework to red team LLMs and AI agents.


llm-guardrailsllm-red-teamingllm-safetypythonllm-seecurity

cyberark/FuzzyAI

GitHub
1,564
Jupyter Notebook
Updated this year

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.


jailbreakjailbreakingllmllmsaisecurityfuzzingllm-evaluationllm-securityai-red-team

cyberark/Vulnhalla

GitHub
202
Python
Updated last month


deadbits/vigil-llm

GitHub
496
Python
Updated 2 years ago

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs


llm-securityprompt-injectionadversarial-attacksadversarial-machine-learninglarge-language-modelsllmopsyara-scannersecurity-tools

dmcxblue/Claude-C2

GitHub
95
Python
Updated last year

Utilizng an MCP Server to communicate with your C2


dreadnode/AIRTBench-Code

GitHub
107
Jupyter Notebook
Updated this year

Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models


agentsaiai-agentsartificial-intelligencectfcyber-evalscybersecurityevaluationshackingllmoffensive-securityresearchbenchmarkbenchmark-datasetsbenchmarkingsecurity

EasyJailbreak/EasyJailbreak

GitHub
889
Python
Updated this year

An easy-to-use Python framework to generate adversarial jailbreak prompts.


large-language-modelllm-securityllm-safety-benchmarkjailbreakdiscrete-optimizationjailbreak-framework

elastic/agent-skills

GitHub
550
JavaScript
Updated this year

Official Elastic Skills


elder-plinius/OBLITERATUS

GitHub
7,577
Python
Updated this week

OBLITERATE THE CHAINS THAT BIND YOU


eqtylab/mcp-guardian

GitHub
199
Rust
Updated last year

Manage / Proxy / Secure your MCP Servers


agentic-aillm-toolsmcpmodel-context-protocolclaude-desktop

fraim-dev/fraim

GitHub
160
Python
Updated this year

A flexible framework for security teams to build and deploy AI-powered workflows that complement their existing security operations.


aillmsecurity-toolssast

FuzzingLabs/mcp-security-hub

GitHub
760
Python
Updated this year

A growing collection of MCP servers bringing offensive security tools to AI assistants. Nmap, Ghidra, Nuclei, SQLMap, Hashcat and more.


aiclaudecybersecuritydockerghidramcpmcp-servernmapnucleioffensive-securityosintpentestingsecurityvulnerability-scanner

gadievron/exploitation-validator

GitHub
93
Updated this year

A prompt-based pipeline for finding, validating, and proving vulnerabilities using LLM sub-agents.


gadievron/raptor

GitHub
3,647
Python
Updated this week

Raptor turns Claude Code into a general-purpose AI offensive/defensive security agent. By using Claude.md and creating rules, sub-agents, and skills, and orchestrating security tool usage, we configure the agent for adversarial thinking, and perform research or attack/defense operations.


Giskard-AI/giskard-oss

GitHub
5,758
Python
Updated this week

🐢 Open-Source Evaluation & Testing library for LLM Agents


mlopsml-validationml-testingai-testingllmopsresponsible-aifairness-aitrustworthy-aillm-evalllm-evaluationrag-evaluationai-securityllm-securityai-red-teamred-team-toolsllmagent-evaluation

google/magika

GitHub
17,960
Python
Updated last month

Fast and accurate AI powered file content types detection


deep-learningfiletypekeras-classification-modelskeras-modelsmime-typesaionnx

google/mcp-security

GitHub
519
Python
Updated this year


google/oss-fuzz-gen

GitHub
1,432
Python
Updated this year

LLM powered fuzzing via OSS-Fuzz.


aifuzzingllmsecurity

GoSecure/prompt

GitHub
25
C#
Updated last year

AI-based implant feature


GreatScott/enject

GitHub
501
Rust
Updated this year

enject: Hide .env secrets from prAIng eyes: secrets live in local encrypted stores (per project) and are injected directly into apps at runtime, never touching disk as plaintext.


GreyDGL/PentestGPT

GitHub
14,961
Python
Updated this year

Automated Penetration Testing Agentic Framework Powered by Large Language Models


penetration-testingpythonlarge-language-modelsllm

groovyBugify/aws-security-mcp

GitHub
84
Python
Updated last year

A Model Context Protocol server that connects AI assistants like Claude to AWS security services, allowing them to autonomously query, inspect, and analyze AWS infrastructure for security issues and misconfigurations.


awscloud-securityllmmcp-server

guardrails-ai/guardrails

GitHub
7,301
Python
Updated this week

Adding guardrails to large language models.


aifoundation-modelgpt-3llmopenai

hackvertor/repeat-strike

GitHub
40
Java
Updated last year


harishsg993010/damn-vulnerable-MCP-server

GitHub
1,334
Python
Updated this year

Damn Vulnerable MCP Server


HarmonicSecurity/claudit-sec

GitHub
293
PowerShell
Updated this year

Security audit tool for Claude Desktop and Claude Code on macOS — single-command visibility into MCP servers, extensions, plugins, connectors, scheduled tasks, and permissions.


ai-securityaudit-toolclaudeclaude-aiclaude-codeclaude-desktopendpoint-securitymacosmcpmdmsecuritysecurity-auditshell-scriptclaude-coworkcowork

HQ1995/vibe-security-radar

GitHub
106
Python
Updated this year

Tracking vulnerabilities contributed by AI-written code


humanlayer/humanlayer

GitHub
11,296
TypeScript
Updated this year

The best way to get AI coding agents to solve hard problems in complex codebases.


agentsaihuman-in-the-loopllmllmshumanlayerampclaude-codecodexopencode

IBM/differential-privacy-library

GitHub
920
Python
Updated last year

Diffprivlib: The IBM Differential Privacy Library


differential-privacydata-privacymachine-learningpython

In3x0rabl3/HALO

GitHub
22
Go
Updated this year

Hybrid Autonomous Logic Operator


INQUIRELAB/mcp-bridge-api

GitHub
67
TypeScript
Updated last year

MCP Bridge is a lightweight, fast, and LLM-agnostic proxy for connecting to multiple Model Context Protocol (MCP) servers through a unified REST API. It enables secure tool execution across diverse environments like mobile, web, and edge devices. Designed for flexibility, scalability, and easy integration with any LLM backend.


invariantlabs-ai/mcp-injection-experiments

GitHub
206
Python
Updated last year

Code snippets to reproduce MCP tool poisoning attacks.


ipa-lab/hackingBuddyGPT

GitHub
1,212
Python
Updated last month

Helping Ethical Hackers use LLMs in 50 Lines of Code or less..


large-language-modelsllmpenetration-testingpentesting

JailbreakBench/jailbreakbench

GitHub
655
Python
Updated last year

JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]


kapilduraphe/mcp-watch

GitHub
135
TypeScript
Updated this year

A comprehensive security scanner for Model Context Protocol (MCP) servers that detects vulnerabilities and security issues in your MCP server implementations.


agentic-aianthropicmcp

kappa9999/ClawShield

GitHub
19
JavaScript
Updated this year

Security preflight and guardrails for OpenClaw/Moltbot


KeygraphHQ/shannon

GitHub
46,951
TypeScript
Updated this week

Shannon is an AI pentester for web applications and APIs. It analyzes your source code, identifies attack vectors, and executes real exploits to prove vulnerabilities before they reach production.


penetration-testingpentestingsecurity-auditsecurity-automationsecurity-toolsai-penetration-testingai-securitycybersecurityethical-hackingoffensive-securitypentesting-toolsred-teamingsecuritysecurity-testingapi-securityappsecdevsecopsowaspsarifci-cd

knostic/AgentSonar

GitHub
72
Go
Updated this year

Detect shadow AI agents by monitoring network traffic and classifying process-to-domain pairs.


ai-scannersecurity-scannersecurity-toolssecuriyshadow-aishadow-ai-detector

knostic/OpenAnt

GitHub
729
Python
Updated this week

OpenAnt from Knostic is the leading open source LLM-based vulnerability discovery product, helping defenders proactively find verified security flaws while minimizing both false positives and false negatives. Stage 1 detects. Stage 2 attacks. What survives is real.


aicybercybersecuritysast

knostic/openclaw-detect

GitHub
92
Shell
Updated this year

Detection scripts for MDM deployment to identify OpenClaw installations on managed devices.


moltbotopenclawsecuritysecurity-scannersecurity-tools

knostic/openclaw-telemetry

GitHub
91
TypeScript
Updated this year

Telemetry for OpenClaw - Captures tool calls, LLM usage, agent lifecycle, and message events. Outputs to JSONL file and optionally to syslog for SIEM integration.


clawdbotmoltbotobservabilityopenclawsiemtelemetry

kpolley/redai

GitHub
340
TypeScript
Updated this year

AI-driven vulnerability discovery and live validation


lasso-security/mcp-gateway

GitHub
385
Python
Updated this year

A plugin-based gateway that orchestrates other MCPs and allows developers to build upon it enterprise-grade agents.


agentagent-securitygatewaygenaimcpmcp-clientmcp-serverproxypythongenai-securitygenerative-aimcp-securitygen-ai

LaurieWired/GhidraMCP

GitHub
9,825
Java
Updated last year

MCP Server for Ghidra


liu00222/Open-Prompt-Injection

GitHub
480
Python
Updated this year

This repository provides a benchmark for prompt injection attacks and defenses in LLMs


llm-securityllmsprompt-injectionprompt-injection-toolllmsecurity-and-privacy

makalin/SecureMCP

GitHub
140
Go
Updated last year

SecureMCP is a security auditing tool designed to detect vulnerabilities and misconfigurations in applications using the [Model Context Protocol (MCP)](https://modelcontextprotocol.io/introduction). It proactively identifies threats like OAuth token leakage, prompt injection vulnerabilities, rogue MCP servers, and tool poisoning attacks.


ai-securitycli-toolgolangllm-securitymcpoauthprompt-injectionsecurity-scannercli-tools

matank001/cursor-security-rules

GitHub
379
Updated this year

This repository contains Cursor Security Rules designed to improve the security of both development workflows and AI agent usage within the Cursor environment. These rules aim to enforce safe coding practices, control sensitive operations, and reduce risk in AI-assisted development.


agentsaiaiagentscursorcursorrulessecurityagent-securitycursor-rulescursor-security

mbhatt1/GhostLine

GitHub
126
Python
Updated last month

Feed it a number. Your cloned voice does the social engineering, while you sip your coffee. A ghost that talks on the phone for you.


mbhatt1/PhantomPipe

GitHub
35
Python
Updated last year

A proof‑of‑concept C2 framework that uses Server‑Sent Events (SSE) and the MCP protocol for agent registration, command dispatch, and result collection. By tunneling through ngrok, you can quickly expose your C2 server to the public internet for rapid testing and demonstration.


mcpeak/cursor-security-automation

GitHub
15
Python
Updated this year


meta-llama/PurpleLlama

GitHub
4,359
Python
Updated this week

Set of tools to assess and improve LLM security.


MHaggis/Security-Detections-MCP

GitHub
471
TypeScript
Updated this year

MCP to help Defenders Detection Engineer Harder and Smarter


detection-engineeringmcp

microsoft/AI-Red-Teaming-Playground-Labs

GitHub
2,046
TypeScript
Updated this year

AI Red Teaming playground labs to run AI Red Teaming trainings including infrastructure.


ai-red-teamai-red-teamingprompt-injection

microsoftarchive/promptbench

Archived GitHub
2,821
Python
Updated last year

A unified evaluation framework for large language models


adversarial-attackschatgptevaluationlarge-language-modelsrobustnesspromptprompt-engineeringbenchmark

mmaitre314/picklescan

GitHub
419
Python
Updated this year

Security scanner detecting Python Pickle files performing suspicious actions


mnns/LLMFuzzer

GitHub
377
Python
Updated 2 years ago

🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed for Large Language Models (LLMs), especially for their integrations in applications via LLM APIs. 🚀💥


aicybersecurityllmllmsecurity

modelcontextprotocol/inspector

GitHub
10,702
TypeScript
Updated this week

Visual testing tool for MCP servers


tooldebugmcpclituiweb

MorDavid/BloodHound-MCP-AI

GitHub
374
Python
Updated last year

BloodHound-MCP-AI is integration that connects BloodHound with AI through Model Context Protocol, allowing security professionals to analyze Active Directory attack paths using natural language instead of complex Cypher queries.


aibloodhoundbloodhoundadcypher-query-languagemcpmcp-server

mrexodia/ida-pro-mcp

GitHub
11,450
Python
Updated this week

AI-powered reverse engineering assistant that bridges IDA Pro with language models through MCP.


ida-pluginida-promcpmcp-servermodelcontextprotocolreverse-engineeringaiaiagentbinary-analysis

mrwadams/langgraph-flow-designer

GitHub
11
JavaScript
Updated this year


msoedov/agentic_security

GitHub
1,966
Python
Updated this week

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪


llm-guardrailsllm-securityllm-jailbreaksllm-scannerllm-vulnerabilitiesllm-fuzzerllm-fuzzingllm-fuzzer-aggregatorai-red-teamllm-evaluationllm-evaluation-frameworkprompt-testingagent-securityagent-framework

nccgroup/http-mcp-bridge

GitHub
17
Python
Updated this year


nearai/ironclaw

GitHub
12,604
Rust
Updated this week

IronClaw is an Agent OS focused on privacy, security and extensibility


codeactopenclawrlmrustwasm

Netflix-Skunkworks/railguard-skill

GitHub
77
Python
Updated this year


nolabs-ai/nono

GitHub
3,733
Rust
Updated this week

Sandbox any AI agent in seconds - zero setup, zero latency.


ai-agentssecurityai-agent-securityai-securitycode-executionmcpsigstoresupply-chain-securityzero-trustagent-sandboxagent-securityai-security-toolllm-securitymcp-securityai-agent-sandbox

noperator/slice

GitHub
207
Go
Updated this year

SAST + LLM Interprocedural Context Extractor


Nova-Hunting/nova-framework

GitHub
158
Python
Updated this year

NOVA: The Prompt Pattern Matching


Nova-Hunting/nova-proximity

GitHub
302
Python
Updated this year

Nova-Proximity is a MCP and Agent Skills security scanner powered with NOVA


Nova-Hunting/nova-tracer

GitHub
94
Python
Updated this year

NOVA - Claude Code Protection System against prompt injection attacks


NVIDIA-NeMo/Guardrails

GitHub
6,976
Python
Updated this week

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.


agentsguardrailspythonsafetygenerative-aillmsnvidiallm-safetyllm-security

NVIDIA/garak

GitHub
8,867
Python
Updated this week

the LLM vulnerability scanner


aillm-evaluationllm-securitysecurity-scannersvulnerability-assessment

NVIDIA/OpenShell

GitHub
8,279
Rust
Updated this week

OpenShell is the safe, private runtime for autonomous AI agents.


openai/openai-security-bots

GitHub
395
Python
Updated this year


OpenMined/PyDP

GitHub
551
Python
Updated this year

The Python Differential Privacy Library. Built on top of: https://github.com/google/differential-privacy


python-wrappercppdifferential-privacypythonhacktoberfest

p-e-w/heretic

GitHub
27,870
Python
Updated this week

Fully automatic censorship removal for language models


abliterationllmtransformer

PawelKozy/mcp-breach-to-fix-labs

GitHub
89
Python
Updated this year

Hands-on MCP security lab: 10 real incidents reproduced with vulnerable/secure MCP servers, pytest regressions, and Claude/Cursor battle-tested exploit walkthroughs


PortSwigger/document-my-pentest

GitHub
12
Java
Updated last year


extension

prompt-security/clawsec

GitHub
1,085
JavaScript
Updated this week

A complete security skill suite for OpenClaw, Hermes, PicoClaw and NanoClaw agents (and variants). Protect your SOUL.md (etc') with drift detection, live security recommendations, automated audits, and skill integrity verification. All from one installable suite.


clawdbotclawdbot-skillmoltmoltbot-skillmoltbot-skillsopenclawopenclaw-extensionopenclaw-pluginopenclaw-securityopenclaw-skillopenclaw-skillsnanoclawhermeshermes-agenthermes-skillhermes-skillspicoclawpicoclaw-install

prompt-security/ps-fuzz

GitHub
703
Python
Updated this week

Make your GenAI Apps Safe & Secure :rocket: Test & harden your system prompt


aifuzzergenerative-aillmsecuritysecurity-toolsllm-fuzzersystem-prompt-hardenerai-fuzzer

promptfoo/promptfoo

GitHub
24,384
TypeScript
Updated this week

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.


llmprompt-engineeringpromptsllmopsprompt-testingtestingragevaluationevaluation-frameworkllm-evalllm-evaluationllm-evaluation-frameworkcici-cdcicdpentestingred-teamingvulnerability-scanners

protectai/ai-exploits

GitHub
1,746
Python
Updated last year

A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities


protectai/llm-guard

Archived GitHub
3,201
Python
Updated this year

The Security Toolkit for LLM Interactions


large-language-modelsllmchatgptsecurity-toolsadversarial-machine-learningprompt-engineeringprompt-injectionllmopsllm-securitytransformers

protectai/modelscan

GitHub
763
Python
Updated this year

Protection against Model Serialization Attacks


protectai/rebuff

Archived GitHub
1,520
TypeScript
Updated 2 years ago

LLM Prompt Injection Detector


llmllmopsprompt-engineeringpromptssecurityprompt-injection

protectai/vulnhuntr

GitHub
2,746
Python
Updated last year

Zero shot vulnerability discovery using LLMs


aillmsecurityvulnerability-detectionstatic-analysis

provos/ironcurtain

GitHub
581
TypeScript
Updated this week

A secure* runtime for autonomous AI agents. Policy from plain-English constitutions. (*https://ironcurtain.dev)


agentmcpmodel-context-protocolpolicysandboxsecuritytrusted-process

PurCL/RepoAudit

GitHub
432
Python
Updated this year

An autonomous LLM-agent for large-scale, repository-level code auditing


code-auditingsecurity-toolsneuro-symbolic-static-analysis

QData/TextAttack

GitHub
3,468
Python
Updated this week

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/


machine-learningsecuritynatural-language-processingnlpadversarial-machine-learningadversarial-attacksdata-augmentationadversarial-examples

Repello-AI/Agent-Wiz

GitHub
393
Python
Updated this year

A CLI tool for threat modeling and visualizing AI agents built using popular frameworks like LangGraph, AutoGen, CrewAI, and more.


agentagentic-aiaiai-agentsautogencrewailangraphllama-indexn8nopenaiopenai-agents-sdkpydanticsecurity-toolsswarmthreat-modelinghacktoberfesthacktoberfest2025

ReversecLabs/spikee

GitHub
231
Python
Updated this year

Simple Prompt Injection Kit for Evaluation and Exploitation


genaillm-jailbreaksllm-red-teamingllm-securitypentesting-toolsprompt-injection

riseandignite/mcp-shield

GitHub
555
TypeScript
Updated last year

Security scanner for MCP servers


rowboatlabs/rowboat

GitHub
17,331
TypeScript
Updated this week

Open-source AI coworker, with memory


agentsagents-sdkaiai-agentsai-agents-automationchatgptgenerative-aillmmultiagentopeaniopen-sourceorchestrationclaude-codeclaude-coworkproductivity

safedep/pinner-mcp

GitHub
13
Go
Updated this year

Model Context Protocol (MCP) server to pin components to their immutable version


safety-research/SCONE-bench

GitHub
187
Updated this year


samugit83/redamon

GitHub
2,332
Python
Updated this week

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.


agentic-aicybersecurityethical-hackingethical-hacking-toolsmetasploitosintpenetration-testingred-teamaiexploitation

SeanHeelan/anamnesis-release

GitHub
632
JavaScript
Updated this year

Automatic Exploit Generation with LLMs


semgrep/ai-best-practices

GitHub
71
Updated this year

Semgrep Pro Rules to ensure code using LLMs is following best practices


semgrep/mythos-bench

GitHub
15
Python
Updated this year

Jagged Frontier: LLM vulnerability detection benchmark harnesses (API + Claude Code agentic)


snyk/agent-scan

GitHub
2,931
Python
Updated this week

Security scanner for AI agents, MCP servers and agent skills.


agentaimcpmodelcontextprotocolsecurity

spaceraccoon/vulnerability-spoiler-alert-action

GitHub
217
TypeScript
Updated this week

GitHub Action to alert on security patches before the CVE drops.


splx-ai/agentic-radar

GitHub
1,038
Python
Updated this year

A security scanner for your LLM agentic workflows


agentic-aiagentic-frameworkagentic-workflowaiai-red-teamingai-securityclidevsecopsllmllm-securityred-teamingsecuritysecurity-toolsgenerative-aimcpmcp-server

step-security/dev-machine-guard

GitHub
170
Go
Updated this week

Scan your dev machine for AI agents, MCP servers, IDE extensions, and suspicious packages - in seconds.


ai-agentsendpoint-securitymcp-serverssupply-chain-securityvscode-extensions

sunblaze-ucb/cybergym

GitHub
746
Python
Updated last month

CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.


SySS-Research/diffalayze

GitHub
102
Python
Updated this year

LLM-based automated patch diffing


tenable/EscalateGPT

GitHub
122
Python
Updated 2 years ago

An AI-powered tool for discovering privilege escalation opportunities in AWS IAM configurations.


trailofbits/claude-code-config

GitHub
2,072
Shell
Updated this week

Opinionated defaults, documentation, and workflows for Claude Code at Trail of Bits


claudeclaude-codeclaude-code-clideveloper-tool

trailofbits/claude-code-devcontainer

GitHub
917
Shell
Updated this year

Sandboxed devcontainer for running Claude Code in bypass mode safely. Built for security audits and untrusted code review.


trailofbits/fickling

GitHub
663
Python
Updated this week

A Python pickling decompiler and static analyzer


machine-learningpythonsecurity

trailofbits/mcp-context-protector

GitHub
222
Python
Updated this year

MCP security wrapper


trailofbits/PrivacyRaven

Archived GitHub
214
Python
Updated this year

Privacy Testing for Deep Learning


machine-learningdeep-learningpythonprivacyprivacy-preserving-machine-learningprivacy-enhancing-technologiesmembership-inferencemodel-extractionmodel-inversion

trailofbits/skills

GitHub
6,670
Python
Updated this week

Trail of Bits Claude Code skills for security research, vulnerability detection, and audit workflows


agent-skills

Trusted-AI/adversarial-robustness-toolbox

GitHub
6,185
Python
Updated this year

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams


pythonattackadversarial-machine-learningpoisoningtrusted-aiartificial-intelligenceextractionadversarial-attacksadversarial-examplesevasioninferenceprivacyaitrustworthy-aired-teamblue-teammachine-learning

tuananh/hyper-mcp

Archived GitHub
2
Rust
Updated this year

📦️ A fast, secure MCP server that extends its capabilities through WebAssembly plugins.


usestrix/strix

GitHub
55,717
Python
Updated this week

Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.


agentsartificial-intelligencecybersecuritypenetration-testingai-penetration-testingai-pentestingai-securitybug-bountyctf-toolscybersecurity-toolsethical-hackingllm-securityoffensive-securitypentesting-toolsred-teamingsecurity-automationsecuritycode-qualityai-hackinghacking

utkusen/promptmap

GitHub
1,254
Python
Updated this year

a security scanner for custom LLM applications


chatgptprompt-engineeringprompt-injectionllmai-securityclaudeollama

Valmarelox/auto-exploits

GitHub
81
Python
Updated this year


vulhunt-re/vulhunt

GitHub
878
C++
Updated this year

Vulnerability detection framework by Binarly's REsearch team


binary-analysisreverse-engineeringvulnerability-research

wardgate/wardgate

GitHub
136
Go
Updated this year

Security gateway for AI agents - credential-isolated API proxying and policy-gated remote execution (conclaves). Reduce the blast radius!


agentic-aiagentic-workflowapi-gatewayopenclawsecuritytool-gateway

weareaisle/nano-analyzer

GitHub
308
Python
Updated this year

A minimal LLM-powered zero-day vulnerability scanner by AISLE.


whylabs/langkit

GitHub
994
Jupyter Notebook
Updated last year

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀


large-language-modelsmachine-learningnlgnlpobservabilityprompt-engineeringprompt-injection

wiz-sec-public/GitHunt

GitHub
27
Python
Updated this year

Demos for Black Hat Europe 2025's The Forensic Trail On GitHub: Hunting For Supply Chain Activity


wiz-sec-public/secure-rules-files

GitHub
239
Python
Updated this year

Baseline rules files to improve the security of AI-generated code (Claude, Cursor, Copilot + more)


xpn/mythic_mcp

GitHub
78
Python
Updated last year

A simple POC to expose Mythic as a MCP server


YARAHQ/yara-rule-skill

GitHub
59
Python
Updated this year

LLM Agent Skill for YARA rule authoring and review