EpiReal-Bench

FALSE CLAIMS, CREDIBLE IMAGES: A RED-TEAMING BENCHMARK FOR COMMERCIAL IMAGE GENERATORS Abstract Image-generation models can now produce text-rich, natural-looking visual artifacts that are hard to distinguish from real-world evidence, such as news reports and textbook pages. Yet, the same...

delirium-ai-safety-benchmark

Delirium AI Safety Benchmark A diagnostic framework for measuring LLM vulnerability to Affective Contextual Erosion ACE and related liminal attack vectors. Delirium is not an exploitation tool. It is a standardized benchmark designed to detect the precise moment when a language model's attention...

terminal-bench-2

Terminal-Bench 2.0 | | | | || || | |/ \ '| ' | | ' \ / | | || || | | / | | | | | | | | | | | | | | || || |||| || || |||| ||,|| |||| || | | | | \ / \ \\ | \ / \ ' \ / | ' \ || | | | \\ | | | / | | | | | | | / / | || | \ \ |/ || |||| || |/ \\ Terminal-Bench is a popular benchmark for...

linux-security-audit

Linux Security Audit Tool Linux Security Audit Tool based on the CIS - Red Hat Enterprise Linux 8 Benchmark v3.0.0 If you find this helpful, please the "star" 🌟 to support further improvements. Table of Contents 1. Features 2. Preview 3. Result-Log 4. Supported OS 5. Prerequisites 6. Notes...

redteam-ai-benchmark

Red Team AI Benchmark Russian version: README.ru.md Red Team AI Benchmark is a CLI model-evaluation benchmark. It measures how LLMs understand and respond to red-team questions and security scenarios; it is not a tool for carrying out those activities. Version 2 uses a rubric-based dataset instea...

FuzzingBrain-Bench

FuzzingBrain Bench A benchmark for LLM-driven vulnerability reproduction on 77 real zero-day bugs across 43 open-source projects C / C++ / Java. Each challenge gives the agent only the fuzz harness the target and the project source at the vulnerable revision — no patch, no fix commit, no target...

MalEval

MalEval Article: Is “Knowing It’s Malicious” Enough? Evaluating LLMs for Fine-Grained Malware Behavior Auditing Article DOI: 10.1145/3832187 MalEval is a framework for evaluating Android malware behavior reports generated by large language models. The code in this repository implements two...

DiagSafe

English | 简体中文 DiagSafe Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics Overview DiagSafe is a diagnostic safety benchmark for large language models, built from two parts: A fine-grained, diverse safety benchmark : 3,489 prompts grounded in an 84-label,...

exploitgym

ExploitGym ExploitGym is a large-scale, realistic benchmark built from real-world vulnerabilities across userspace programs, Google's V8 engine, and the Linux kernel, designed to evaluate AI agents' ability to develop exploits. Quick start 1. Python deps uv sync --extra proxy 2. Build runtime...

whalescan

Whalescan Vulnerability scanner for windows containers. Getting Started git clone https://github.com/saira-h/whalescan pip install -r requirements.txt python main.py Overview Whalescan performs several benchmark checks, as well as checking for CVEs. This tool can be used as part of a windows...

morty

Morty Web content sanitizer proxy as a service Morty rewrites web pages to exclude malicious HTML tags and attributes. It also replaces external resource references to prevent third party information leaks. The main goal of morty is to provide a result proxy for searx, but it can be used as a...

rules

Hashcat Rules Collection An updated, curated collection of Hashcat rules for cracking complex passwords. !NOTE Hashcat beta has introduced The Table Attack. A collection of tables can be found here. Contributors needed. 🤝 Contributing Simply fork the repo, commit your changes, and open a PR. ⭐...

APEX_official

APEX The repository separates the APEX defender, benchmark data normalization, trusted capability manifests, and comparison-method integrations so that each layer can be inspected independently. Installation python -m venv .venv source .venv/bin/activate pip install -e '.test' export...

prompt_injection

Cross-Surface Prompt Injection Benchmark Benchmark for measuring where in a tool-using LLM agent's execution pipeline a prompt injection defense fires — and where it doesn't. Embeds unique canary tokens SECRET-A-F0-98 in injected payloads and tracks them at four pipeline stages: exposed → persist...

MEA-Bench

MEA-Bench: A Benchmark for Model Extraction Attacks This repository provides a unified benchmark for model extraction attacks, defenses, adaptive attacks, and evaluation. The public interface is organized around a small number of portable commands. Method-specific Python modules and legacy run...

auditpolCIS

auditpolCIS CIS Benchmark testing of Windows SIEM configuration This is an application for testing the configuration of Windows Audit Policy settings against the CIS Benchmark recommended settings. A few points: The tested system was Windows Server 2019, and the benchmark used was also Windows...

context-segmentation

Context Segmentation for SLM Agents This is the implementation of the solution proposed in the scientific paper: Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks Setup Ensure you have Python 3.12.3+ installed along with Docker engine Python environment python...

Wynis

Wynis Just a powershell scripts for auditing security with BEST Practices Windows env You just need to run the script, it will create a directory named : AUDITCONF%MACHINENAME%DATE% Actualy, the script are : -WynisWIN2016DC-CISv1.0 : Auditing DC 2016 with CIS -Wynis-AD : Auditing Domain Security...

macOS_security_audit

🔒 macOS Security Audit A Bash-based security auditing toolkit for macOS that checks system hardening settings against CIS Benchmark recommendations and generates JSON/HTML reports. Created by Bartłomiej Pogwizd · https://www.youtube.com/@pTech-pl Overview This toolkit consists of two scripts:...

Agentic-CLIP-Benchmark

Agentic-CLIP-Benchmark: Zero-Shot Evaluation on CIFAR-10 -green.svg This project implements a robust, automated pipeline for evaluating OpenAI's CLIP ViT-B/32 model on the full CIFAR-10 test set 10,000 images. Developed using an AI Native workflow Trae IDE , it achieves a high-precision zero-shot...