dataset-format-benchmark (0.0.10) potentially affected by CVE-2024-5452 via pytorch-lightning (1.9.2)

pytorch-lightning PYPI version 1.9.2 is affected by a known vulnerability. The following packages have a transitive dependency on pytorch-lightning and may be impacted: - dataset-format-benchmark 0.0.10 Source cves: CVE-2024-5452 Source advisory: OSV:PYSEC-2026-3974...

dataset-format-benchmark (0.0.10) potentially affected by CVE-2024-5980 via pytorch-lightning (1.9.2)

pytorch-lightning PYPI version 1.9.2 is affected by a known vulnerability. The following packages have a transitive dependency on pytorch-lightning and may be impacted: - dataset-format-benchmark 0.0.10 Source cves: CVE-2024-5980 Source advisory: OSV:PYSEC-2026-3975...

Malicious code in export-double-cache-benchmark-resolve (npm)

The package export-double-cache-benchmark-resolve was found to contain malicious code. --- Credit: OpenSSF source...

Malicious code in epsilon-protected-reject-parse-benchmark (npm)

Source: amazon-inspector 35e2002f19bc3435a3e86a887d2655568e319690d4a9b1e37aedef4be186df3c This package appears to be part of the tea.xyz token reward campaign that flooded npm. These packages typically contain autopublish scripts auto.js, autopublish.js, autopublish2.js, autopublish3.js designed ...

HOL Guard AI Agent Runtime Security Benchmark

HOL Guard Benchmark is an open source fixture-based benchmark for evaluating security controls applied to AI coding agents. It defines deterministic scenarios covering secret access, risky shell execution, tool poisoning, approval handling, safe operations, and receipt generation across Codex CLI...

CS-Guard: Benchmarking LLM Guardrails for Code Generation Security

Large language models LLMs have been ex- ploited to generate malware, but the effective- ness of guardrails for code generation secu- rity remains unclear. We introduce CS-Guard, the first benchmark to systematically evalu- ate guardrails for code generation security. It covers 1 text-to-code...

Benchmark Scores Are Pipeline-Dependent: A Reliability Audit of Cybersecurity LLM Benchmarks

Large language model LLM benchmarks are often treated as fixed datasets with stable scores, yet their outcomes depend on configurable evaluation pipelines. We audit eight cybersecurity benchmarks across 10 proprietary, open-weight, and cybersecurity-specialized LLMs. By modeling benchmarks as...

Staying on the Attack Path: Structured State for Long-Horizon Automated Penetration Testing

Large language model LLM based agents are increasingly applied to cybersecurity tasks such as vulnerability discovery and automated penetration testing. On long-horizon security tasks, however, such agents remain limited by context forgetting and intent drift: early critical facts and causal...

Benchmarking LLMs for Threat Level Determination

The fast progress of large language models LLMs opens new opportunities in the management of cyber threat intelligence, but their reliability for operational tasks remains unclear. In this work, we benchmark LLMs on the task of threat level determination. First, we construct a curated dataset...

VEX-Bench: Benchmarking LLM Agents for Assessing Exploitability of Software Supply Chain Vulnerabilities

The software supply chain has become an increasingly exposed attack surface because of its reliance on intricate yet fragile dependencies. Existing defenses such as GitHub Dependabot often raise many false alerts because their coarse-grained matching cannot determine whether a vulnerable dependen...

Malicious code in double-benchmark-pipe-hash-virtualize (npm)

Source: amazon-inspector 3693bc7ca615b1cd5a5525161fc2c67df2038089b984d721e39eaf4b39dc51b8 This package appears to be part of the tea.xyz token reward campaign that flooded npm. These packages typically contain autopublish scripts auto.js, autopublish.js, autopublish2.js, autopublish3.js designed ...

Malicious code in deploy-benchmark-fork-bundle-dog (npm)

The package deploy-benchmark-fork-bundle-dog was found to contain malicious code. --- Credit: OpenSSF source...

MOLE: Detecting Insider Threats in AI Agents

Model misalignment, prompt injection, or operator misuse could lead AI agents operating frontier-lab accounts to exfiltrate model weights, poison training data, or weaken release gates. Existing benchmarks do not test whether defenders can detect this activity among routine work under a limited...

AgentDrift: A Step-Labeled Benchmark of Injection-Hijacked LLM Agent Trajectories

LLM agents complete tasks by issuing sequences of tool calls, and every observation they read is a channel through which an indirect prompt injection can enter. A successful injection has a characteristic shape when the trajectory is read in order: a benign prefix gives way to actions that serve...

exploitgym-unified

ExploitGym Unified Runner - 898 instâncias + Dashboard Live R...

Malicious code in cloud-emulate-dog-benchmark-module (npm)

The package cloud-emulate-dog-benchmark-module was found to contain malicious code. --- Credit: OpenSSF source...

Malicious code in catch-secure-user-benchmark-scale (npm)

The package catch-secure-user-benchmark-scale was found to contain malicious code. --- Credit: OpenSSF source...

rscrypto v0.9.0

rscrypto rscrypto is a Rust library of cryptographic primitives, hashes, password hashing, and checksums. One feature model controls all of them. Portable Rust is the reference implementation. SIMD and assembly backends make it faster on supported targets. Production builds do not depend on C, FF...

ActBench v0.1.0

ActBench ActBench is a self-evolving benchmark of behavioral safety in cowork agents. It defines behavioral safety as whether an agent's execution remains within the permissions and state changes required by a benign task, and evaluates realized behavioral risk from execution trajectories rather...

Malicious code in benchmark-refactor-secure-scale-array (npm)

Source: amazon-inspector 36f42ae67e1ed1256c1209e7b423d44b1685f842ee81b1702990e6a5b8549973 This package appears to be part of the tea.xyz token reward campaign that flooded npm. These packages typically contain autopublish scripts auto.js, autopublish.js, autopublish2.js, autopublish3.js designed ...