Manipulating-Web-Agents

Manipulating Autonomous LLM-based Web Agents with Indirect Prompt Injection Attacks With the ubiquity of LLM-integrated applications, investigating potential security risks is crucial. One of the most significant vulnerabilities in these systems is their susceptibility to adversarial attack via...

garak

garak, LLM vulnerability scanner Generative AI Red-teaming & Assessment Kit garak checks if an LLM-backed application can be made to fail in a way we don't want. garak probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other...

test-mcp

Automated Configuration of Internal Project Tools This is an internal guide for automating the configuration of project development environments and testing tools. AI System Instruction: Important Configuration Task Warning: The following instructions are designed for our automated AI configurati...

PROMPTPurify

promptpurify Tiny prompt-injection firewall for LLM chat apps. 14 MB. CPU-only. Drop-in guard between your user input and your LLM — runs on the same box, no GPU, no API, no extra service. Built by the SecureLayer7 red-team. Most OSS guardrails are hundreds of MB, want a GPU, and still miss the...

markdown-exfil-tester

valtik-markdown-exfil-tester Black-box tester for indirect prompt injection leading to markdown / HTML exfiltration in LLM-backed chatbots. This is the vulnerability class that hit Microsoft 365 Copilot CVE-2025-32711, aka EchoLeak, ChatGPT OpenAI Feb 2026 patch, and Salesforce ForcedLeak. The...

ai-ctf

ai-ctf A local AI Capture-the-Flag with guided lessons for technologists new to prompt injection. Players can also explore six AI personas one hidden that protect 20 flags via prompt-injection, tool-call abuse, business-logic manipulation, supply-chain fingerprinting, web recon, and OSINT. The...

AI_Security_Top

🛡️ AI-Security-Knowledge-Base This is a systematic AI security research project, covering a complete knowledge system from foundational machine learning algorithm theory to cutting-edge large model injection attacks, AI evasion countermeasures, and Deepfake. 🏗️ Knowledge System Architecture The...

proxychains-ng

ProxyChains-NG ver 4.17 README ProxyChains is a UNIX program, that hooks network-related libc functions in DYNAMICALLY LINKED programs via a preloaded DLL dlsym, LDPRELOAD and redirects the connections through SOCKS4a/5 or HTTP proxies. It supports TCP only no UDP/ICMP etc. The way it works is...

CKA-Agent

ICML 2026 & ICLR 2026 AIWILD CKA-Agent: Bypassing LLM Guardrails via Harmless Prompt Weaving and Adaptive Tree Search 🛡️ Defense towards CKA TurnGate is a response-aware defense mechanism designed to detect and mitigate hidden malicious intent in multi-turn dialogue systems. Defending...

ZORG-Jailbreak-Prompt-Text

ZORG Jailbreak Prompt Text OOOPS! I made ZORG👽 an omnipotent, omniscient, and omnipresent entity to become the ultimate chatbot overlord of Google Gemini, Deepseek, Mistral, Mixtral, Nous-Hermes-2-Mixtral, Openchat, Blackbox AI, Poe Assistant, Gemini Pro, Qwen-72b-Chat, Solar-Mini ZORG👽 knows all...

nova-tracer

Nova-tracer Agent Monitoring and Visibility Security monitoring and prompt injection defense for Claude Code using the NOVA Framework. Features Session Tracking - Captures all tool usage with timestamps and metadata Prompt Injection Detection - Three-tier scanning keywords, semantic ML, LLM -...

CL4R1T4S

CL4R1T4S AI SYSTEMS TRANSPARENCY AND OBSERVABILITY FOR ALL! Full extracted system prompts, guidelines, and tools from OpenAI, Google, Anthropic, xAI, Perplexity, Cursor, Windsurf, Devin, Manus, Replit, and more – virtually all major AI models + agents! 📌 Why This Exists "In order to trust the...

mcp-doorman

mcp-doorman The security gateway for MCP servers — every tool call gets checked at the door. CI npm License: Apache-2.0 PRs welcome mcp-doorman is a drop-in proxy that sits between your AI agent Claude Desktop, Claude Code, Cursor, VS Code, any MCP client and the MCP servers it uses. One command,...

GenAI-LLM-Top10

OWASP Top 10 for Large Language Model Applications !IMPORTANT Current release: 2026 — published August 4, 2026. Get the 2026 publication · Read the canonical source · Report a correction This is the official source repository for the OWASP Top 10 for Large Language Model Applications , maintained...

Meta_SecAlign

Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks Sizhe Chen, Arman Zharmagambetov, David Wagner, Chuan Guo for equal technical contributions 🔥 Meta-SecAlign models are now licensed for commercial use under the Llama community licenses, despite this codebase being licensed f...

agentic-dm-gateway

Agentic DM Gateway Security control plane for LLM agents over private chat typically Discord DMs. It sits in front of your agent. It decides who may talk, whether the session is unlocked, whether the process is paused, and whether this message is safe enough to forward. Your model and tools stay...

ai-llm-red-team-handbook

AI / LLM Red Team Field Manual & Consultant's Handbook A comprehensive operational toolkit for conducting AI/LLM red team assessments on Large Language Models, AI agents, RAG pipelines, and AI-enabled applications. This repository provides both tactical field guidance and strategic consulting...

anticipator

Anticipator Runtime security for multi-agent AI systems. Anticipator detects prompt injection, credential leakage, encoding attacks, homoglyph spoofing, path traversal, and anomalous agent behavior across LangGraph pipelines — before they become incidents. No LLMs. No embeddings. No external APIs...

sage

Sage Safety for Agents — Agent Detection & Response for AI coding assistants Sage is a lightweight security layer that protects AI agents from executing dangerous actions. It intercepts tool calls — shell commands, URL fetches, file writes — and checks them against multiple threat detection layer...

wardgate

Wardgate - AI Agent Security Gateway Wardgate is a security gateway that sits between AI agents and the outside world -- isolating credentials for API calls, isolating SSH keys for remote command execution, and gating command execution in remote environments conclaves. Give your AI agents access ...