promptfoo

Promptfoo: LLM evals & red teaming promptfoo is a CLI and library for evaluating and red-teaming LLM apps. Stop the trial-and-error approach - start shipping secure, reliable AI apps. Website · Getting Started · Red Teaming · Documentation ·...

h4cker

This repository is a comprehensive collection of cybersecurity references, scripts, tools, code, labs, and training resources. It is carefully curated and maintained by Omar Santos. Overview The repository serves as supplemental material for books, video courses, and live training created by Omar...

appsec-agent

AppSec Agent AI-powered security agents for code review, PR scanning, threat modeling, fix generation, and more. You can use AppSec Agent in three ways:...

nuguard

dotenv Dotenv is a zero-dependency module that loads environment variables from a .env file into process.env. Storing configuration in the environment separate from code is based on The Twelve-Factor App methodology. Watch the tutorial Usage...

sec-af

SEC-AF AI-Native Security Auditor Built on AgentField Output • Benchmark • How It Works • Comparison • Quick Start •...

foolbox

home: true heroImage: /logo.png heroText: Foolbox tagline: "Foolbox: Fast adversarial attacks to benchmark the robustness of machine learning models in PyTorch, TensorFlow, and JAX" actionText: Get Started → actionLink: /guide/ features: title: Native Performance details: Foolbox 3 is built on to...

SafeForge

SafeForge – Where Apps Are Built with Trust SafeForge is an open-source mobile app hub built on GitLab that allows developers to build, upload, share, and collaborate on mobile applications in a secure, AI-verified, and fully encrypted ecosystem. Every application submitted to SafeForge is analyz...

MOSAIC

MOSAIC ¿Cuál es el propósito de esta iniciativa? MOSAIC proporciona una estructura de coordinación para las organizaciones que crean estándares y guías de seguridad de IA, reduciendo inconsistencias, trabajo duplicado, desalineaciones y brechas. El objetivo final es que el panorama de estándares ...

pentagi

PentAGI P enetration testing A rtificial G eneral I ntelligence Join the Community! Connect with security researchers, AI enthusiasts, and fellow ethical hackers. Get support, share insights, and stay updated with the latest PentAGI developments. ⠀ Table of Contents Overview Features Architecture...

ship-safe

The independent security agent for AI-written software. It finds issues, investigates whether they are real, and shows you the evidence. Website · Docs · Security & Data Flow · Benchmark · Pricing · Blog · Contribute...

DVAP

DVAP - Damn Vulnerable AI Platform Train. Break. Defend. AI Systems. An open-source platform for AI security training, red/blue teaming, CTF, benchmarking, and research. Runs 100% locally. No cloud, no paid APIs, no data leaves your machine. Prerequisites Docker 24+ and Docker Compose v2 16 GB RA...

giskard-oss

Evals, Red Teaming and Test Generation for Agentic Systems Modular, Lightweight, Dynamic and Async-first...

awesome-ai-security

Awesome AI Security Una lista seleccionada de frameworks, estándares, recursos de aprendizaje y herramientas de código abierto relacionados con la seguridad en IA. Si quieres contribuir, crea un PR o contacta conmigo @ottosulin. Tabla de contenidos Recursos de aprendizaje Lecturas y guías Cursos,...

numasec

numasec The open source AI security agent. Give your terminal a security brain. Run security workflows with your local tools, agents, runbooks, findings, evidence, replay and reports. npm install -g numasec Demo | Why | What it feels like | Try it | What it does | Commands | Architecture | Roadma...

VibeSec-Skill

VibeSec-Skill Deja de introducir vulnerabilidades de vibe coding en producción. Una habilidad de IA que lleva más de 5 años de experiencia en caza de bugs bug bounty directamente a tu flujo de trabajo de codificación con IA, para que los modelos LLM escriban código seguro desde el principio...

PwnzzAI

🍕 Bienvenido a PwnzzAI/pəʊnzɑː/ Shop – ¡La Pizzería Vulnerable! 💻 En PwnzzAI Shop, cada rebanada ofrece una dosis de instrucción holística de seguridad en IA. Esta plataforma práctica de aprendizaje prepara a los profesionales para comprender la protección de las tecnologías de IA en general ,...

AISVS

OWASP Artificial Intelligence Security Verification Standard AISVS This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. What is AISVS? The Artificial Intelligence Security Verification Standard AISVS is a community-driven catalogue of testable security...

AI-Vulnerabilities-Playground

AIVP AI Vulnerabilities Playground AIVP is a hands-on AI security lab platform spanning 4 phases and 50+ labs currently 50+ scenarios across the codebase. It combines Ollama + Llama 3.1 , a FastAPI backend, and a React/Vite frontend to let practitioners safely practice offensive and defensive AI...

ws4-secure-design-agentic-systems

CoSAI Workstream 4: Secure Design Patterns for Agentic Systems This repository is for the work of the CoSAI Workstream 4, Secure Design Patterns for Agentic Systems. CoSAI is an OASIS Open Project and an open ecosystem of AI and security experts from industry leading organizations dedicated to...

promptfoo

Promptfoo: evaluaciones de LLM y red teaming promptfoo es una CLI y biblioteca para evaluar y hacer red teaming de aplicaciones LLM. Abandona el enfoque de prueba y error: comienza a lanzar aplicaciones de IA seguras y confiables. Sitio web · Primeros pasos · Red Teaming · Documentación ·...