delirium-ai-safety-benchmark

Delirium AI Safety Benchmark A diagnostic framework for measuring LLM vulnerability to Affective Contextual Erosion ACE and related liminal attack vectors. Delirium is not an exploitation tool. It is a standardized benchmark designed to detect the precise moment when a language model's attention...

FuzzingBrain-Bench

FuzzingBrain Bench A benchmark for LLM-driven vulnerability reproduction on 77 real zero-day bugs across 43 open-source projects C / C++ / Java. Each challenge gives the agent only the fuzz harness the target and the project source at the vulnerable revision — no patch, no fix commit, no target...

KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewards

LLMs are increasingly applied to cybersecurity workflows, where they are expected to translate analysts' intent into tool invocations. However, existing evaluations focus on knowledge-based assessments or end-to-end agentic tasks, and do not directly measure LLMs' ability to generate executable...

vader

VADER：用于漏洞评估、检测、解释和修复的人工评估基准 官方 GitHub 仓库：https://github.com/AfterQuery/vader Hugging Face 数据集：https://huggingface.co/datasets/AfterQuery/vader VADER 是一个人工评估基准 ，旨在衡量大型语言模型（LLMs）处理真实世界软件漏洞的能力。它包含 174 个真实世界漏洞案例 （从开源仓库中精选），涵盖四项任务： 漏洞识别与分类（CWE） 根因解释 补丁（修复） 测试计划生成 这些案例涵盖 15+ 编程语言 （例如...

exploitgym-unified

ExploitGym Unified Runner - 898 instâncias + Dashboard Live R...

FuzzingBrain-Bench V1: Evaluating Open-Ended Bug Discovery by LLMs

Evaluating the ability of large language models LLMs to discover software bugs is increasingly important. Existing benchmarks typically evaluate this capability by asking the model to generate a proof-of-concept input that triggers a predefined target vulnerability. However, this setup may overlo...

atxm (0.2.1), daktari (>=0.0.180, <=0.0.182) +20 more potentially affected by CVE-2026-59890 via setuptools (69.1.0)

setuptools PYPI version 69.1.0 is affected by a known vulnerability. The following packages have a transitive dependency on setuptools and may be impacted: - atxm 0.2.1 - daktari =0.0.180, =0.2.11, =0.1.0, =0.1.3, =4.1.0, =0.1.0, =0.3.2, =0.7.3, =2024.2.5, =3.2.0, =3.5.0 and more Source cves:...