auditpolCIS

auditpolCIS CIS Benchmark testing of Windows SIEM configuration This is an application for testing the configuration of Windows Audit Policy settings against the CIS Benchmark recommended settings. A few points: The tested system was Windows Server 2019, and the benchmark used was also Windows...

Zeus

Zeus AWS Auditing & Hardening Tool Zeus is a powerful tool for AWS EC2 / S3 / CloudTrail / CloudWatch / KMS best hardening practices. It checks security settings according to the profiles the user creates and changes them to recommended settings based on the CIS AWS Benchmark source at request of...

delirium-ai-safety-benchmark

Delirium AI Safety Benchmark A diagnostic framework for measuring LLM vulnerability to Affective Contextual Erosion ACE and related liminal attack vectors. Delirium is not an exploitation tool. It is a standardized benchmark designed to detect the precise moment when a language model's attention...

trivy-operator

Kubernetes-native security toolkit. Documentation Introduction The Trivy Operator leverages Trivy to continuously scan your Kubernetes cluster for security issues. The scans are summarised in security reports as Kubernetes Custom Resource Definitions, which become accessible through the Kubernete...

BoxPwnr-Traces

BoxPwnr-Traces BoxPwnr traces and benchmark results across multiple security platforms. Each trace includes the full LLM interaction, commands executed, a markdown report + attack graph, stats and config used. Browse leaderboards, replay runs in an interactive web viewer, and read AI-generated...

robustbench

RobustBench: a standardized adversarial robustness benchmark Francesco Croce University of Tübingen, Maksym Andriushchenko EPFL, Vikash Sehwag Princeton University, Edoardo Debenedetti EPFL, Nicolas Flammarion EPFL, Mung Chiang Purdue University, Prateek Mittal Princeton University, Matthias Hein...

JShielder

JShielder JShielder Automated Hardening Script for Linux Servers JSHielder is an Open Source Bash Script developed to help SysAdmin and developers secure there Linux Servers in which they will be deploying any web application or services. This tool automates the process of installing all the...

rules

Hashcat Rules Collection An updated, curated collection of Hashcat rules for cracking complex passwords. !NOTE Hashcat beta has introduced The Table Attack. A collection of tables can be found here. Contributors needed. 🤝 Contributing Simply fork the repo, commit your changes, and open a PR. ⭐...

Wynis

Wynis Just a powershell scripts for auditing security with BEST Practices Windows env You just need to run the script, it will create a directory named : AUDITCONF%MACHINENAME%DATE% Actualy, the script are : -WynisWIN2016DC-CISv1.0 : Auditing DC 2016 with CIS -Wynis-AD : Auditing Domain Security...

kube-beacon

Kube-Beacon Project Scan your kubernetes runtime !! Kube-Beacon is an open source audit scanner who perform audit check on a deployed kubernetes cluster and output a security report. The audit tests are the full implementation of CIS Kubernetes Benchmark specification NEW !! audit result now can ...

APEX_official

APEX The repository separates the APEX defender, benchmark data normalization, trusted capability manifests, and comparison-method integrations so that each layer can be inspected independently. Installation python -m venv .venv source .venv/bin/activate pip install -e '.test' export...

MalEval

MalEval Article: Is “Knowing It’s Malicious” Enough? Evaluating LLMs for Fine-Grained Malware Behavior Auditing Article DOI: 10.1145/3832187 MalEval is a framework for evaluating Android malware behavior reports generated by large language models. The code in this repository implements two...

redteam-ai-benchmark

Red Team AI Benchmark Russian version: README.ru.md Red Team AI Benchmark is a CLI model-evaluation benchmark. It measures how LLMs understand and respond to red-team questions and security scenarios; it is not a tool for carrying out those activities. Version 2 uses a rubric-based dataset instea...

prompt_injection

Cross-Surface Prompt Injection Benchmark Benchmark for measuring where in a tool-using LLM agent's execution pipeline a prompt injection defense fires — and where it doesn't. Embeds unique canary tokens SECRET-A-F0-98 in injected payloads and tracks them at four pipeline stages: exposed → persist...

terminal-bench-2

Terminal-Bench 2.0 | | | | || || | |/ \ '| ' | | ' \ / | | || || | | / | | | | | | | | | | | | | | || || |||| || || |||| ||,|| |||| || | | | | \ / \ \\ | \ / \ ' \ / | ' \ || | | | \\ | | | / | | | | | | | / / | || | \ \ |/ || |||| || |/ \\ Terminal-Bench is a popular benchmark for...

MEA-Bench

MEA-Bench: A Benchmark for Model Extraction Attacks This repository provides a unified benchmark for model extraction attacks, defenses, adaptive attacks, and evaluation. The public interface is organized around a small number of portable commands. Method-specific Python modules and legacy run...

Ajar

Ajar: Measuring Open Privilege in Agent Defenses An agent-security benchmark reports two numbers, attack success and benign utility, and both are read off runs that happened. Neither says what the defense stood ready to allow on the paths no run took. Ajar asks it directly: for each benign task i...

FML-Network

FLNET2023: Realistic Network Intrusion Detection Dataset for Federated Learning Paper: FLNET2023: Realistic Network Intrusion Detection Dataset for Federated Learning Dataset: FLNET2023 Introduction FLNET2023 is a state-of-the-art benchmark dataset for intrusion detection systems, specifically fo...

context-segmentation

Context Segmentation for SLM Agents This is the implementation of the solution proposed in the scientific paper: Evaluating Context Segmentation in Locally Deployable SLMs for Cybersecurity CTF Tasks Setup Ensure you have Python 3.12.3+ installed along with Docker engine Python environment python...

macOS_security_audit

🔒 macOS Security Audit A Bash-based security auditing toolkit for macOS that checks system hardening settings against CIS Benchmark recommendations and generates JSON/HTML reports. Created by Bartłomiej Pogwizd · https://www.youtube.com/@pTech-pl Overview This toolkit consists of two scripts:...