attack-attention

Attacking Attention of Foundation Models Effectively Disrupts Downstream Tasks Official PyTorch implementation of the paper "Attacking Attention of Foundation Models Effectively Disrupts Downstream Tasks" , accepted in the Adversarial Machine Learning on Computer Vision: Foundation Models + X ADV...

AdaptixC2

AdaptixC2 v1.2 FEB, 28: What has changed in version v1.2? Adaptix is an extensible post-exploitation and adversarial emulation framework made for authorized penetration testing. The Adaptix server is written in Golang and to allow operator flexibility. The GUI Client is written in C++ QT, allowin...

AI-Red-Teaming-Playground-Labs

AI Red Teaming Playground Labs This repository contains the challenges for the labs used in the course "AI Red Teaming in Practice". The course was originally taught at Black Hat USA 2024 by Dr. Amanda Minnich and Gary Lopez. Martin Pouliot handled the infrastructure and scoring for the challenge...

adversarial-robustness-toolbox

Adversarial Robustness Toolbox ART v1.20 中文README请按此处 Fallback image description Adversarial Robustness Toolbox ART is a Python library for Machine Learning Security. ART is hosted by the Linux Foundation AI & Data Foundation LF AI & Data. ART provides tools that enable developers and researchers...

offensive-ai-compilation

Offensive AI Compilation A curated list of useful resources that cover Offensive AI. 📁 Contents 📁 🚫 Abuse 🚫 🧠 Adversarial Machine Learning 🧠 ⚡ Attacks ⚡ 🔒 Extraction 🔒 ⚠️ Limitations ⚠️ 🛡️ Defensive actions 🛡️ 🔗 Useful links 🔗 ⬅️ Inversion or inference ⬅️ 🛡️ Defensive actions 🛡️ 🔗 Useful links 🔗 💉...

ai-llm-red-team-handbook

AI / LLM Red Team Field Manual & Consultant's Handbook A comprehensive operational toolkit for conducting AI/LLM red team assessments on Large Language Models, AI agents, RAG pipelines, and AI-enabled applications. This repository provides both tactical field guidance and strategic consulting...

Sec5GLoc

Sec5GLoc: Securing 5G Indoor Localization via Adversary-Resilient Deep Learning Architecture Our work addresses security and privacy challenges in 5G indoor localization by proposing an adversary-resilient deep learning architecture. Sec5GLoc combines Channel Impulse Response CIR fingerprinting...

alibi-detect

Alibi Detect is a source-available Python library focused on outlier , adversarial and drift detection. The package aims to cover both online and offline detectors for tabular data, text, images and time series. Both TensorFlow and PyTorch backends are supported for drift detection. Documentation...

machine_learning_security

Machine Learning and Security Source codes about machine learning and security. Line up. Cyber security and Machine Learning course The elementary training course of Machine learning for security engineer. Vulnerabilities of Machine Learning Summary of Machine Learning vulnerability. Analytics...

augustus

Augustus - LLM vulnerability scanner for prompt injection, jailbreak, and adversarial attack testing Augustus - LLM Vulnerability Scanner Test large language models against 210+ adversarial attacks covering prompt injection, jailbreaks, encoding exploits, and data extraction. Augustus is a Go-bas...

security-audit-skill

security-audit A coding-agent skill that turns your agent into a security auditor. It orchestrates multiple parallel agents through a six-phase pipeline -- recon, hunting, validation, reporting, structured output, and independent verification -- to find exploitable vulnerabilities with real impac...

FecalFace

Description | Installation | Website | Issues FecalFace Description Fecal face was born from the concept of "Shit Bucket" where the idea is to try to rot the data they have about each other. Specifically, it is related to the detection and recognition of faces. The motivation of this project is...

cerebro-red-v2

CEREBRO-RED v2 Research Edition Autonomous Local LLM Red Teaming Suite A research-grade framework for automated vulnerability discovery in local LLMs using Agentic Fuzzing and Adaptive Adversarial Mutation AAM. Research Goals Implement PAIR Algorithm Prompt Automatic Iterative Refinement from...

StealthRL

StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors Paper arXiv Demo Model Hugging Face Benchmark Dataset Hugging Face Abstract AI-text detectors are increasingly used in high-stakes settings, yet their robustness to meaning-preserving adversarial...

PoisonCraft

PoisonCraft This repository provides the official implementation of POISONCRAFT: Practical Poisoning of Retrieval-Augmented Generation for Large Language Models. Overview POISONCRAFT aims to demonstrate how a malicious actor can plant “poisoned” content into the corpus used by Retrieval-Augmented...

SecML

SecML: A library for Secure and Explainable Machine Learning SecML is an open-source Python library for the security evaluation of Machine Learning ML algorithms. It comes with a set of powerful features: Wide range of supported ML algorithms. All supervised learning algorithms supported by...

metta

Metta Metta is an information security preparedness tool. This project uses Redis/Celery, python, and vagrant with virtualbox to do adversarial simulation. This allows you to test mostly your host based instrumentation but may also allow you to test any network based detection and controls...

redeval

RedEval - LLM Safety Evaluation Framework A comprehensive framework for evaluating the safety of Large Language Models LLMs through systematic attack and refusal testing. RedEval provides a unified, secure, and extensible platform for assessing LLM robustness against adversarial prompts and harmf...

Ruse

Ruse Mobile camera-based application that attempts to alter photos to preserve their utility to humans while making them unusable for facial recognition systems. Installation 1 Easy Method: Wait and download app from appropriate app store. 2 Download and run ios app via XCode see Development setu...

Set-AuditRule

Set-AuditRule A repository of useful access control entries ACE that could be added to the system access control list SACL of a securable object's security descriptor to monitor potential adversarial activity. These entries are categorized by specific securable objects such as files, registry key...