50 matches found
Agentic-CLIP-Benchmark
Agentic-CLIP-Benchmark: Zero-Shot Evaluation on CIFAR-10 -green.svg This project implements a robust, automated pipeline for evaluating OpenAI's CLIP ViT-B/32 model on the full CIFAR-10 test set 10,000 images. Developed using an AI Native workflow Trae IDE , it achieves a high-precision zero-shot...
SAFE
SAFE SAFE performs controlled, repository-aware security assessment of Semgrep and Trivy findings in research artifacts. It supports two independent classification tasks: direct binary prediction SECURITYRELEVANT or NONSECURITY and the detailed multiclass contextual taxonomy three labels — see...
RLCDAlignBench
Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures This repository holds RLCDAlignBench and the code behind the paper. The benchmark measures whether a detector can tell when a language model's output is an alignment failure. It has 44...
mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-9856 via transformers (4.10.1)
transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-9856 Source advisory: OSV:PYSEC-2026-3929...
Benchmarking LLMs for Threat Level Determination
The fast progress of large language models LLMs opens new opportunities in the management of cyber threat intelligence, but their reliability for operational tasks remains unclear. In this work, we benchmark LLMs on the task of threat level determination. First, we construct a curated dataset...
Moirae: A Multimodal Agent Collaborative Framework for Dynamic Android Malware Detection
The Android ecosystem faces persistent and rapidly evolving malware threats. Existing machine learning detectors are vulnerable to concept drift because they rely on implementation-specific features whose distributions change over time. Large language models LLMs offer strong semantic understandi...
LLMs for Zero-Shot Threat Detection Via Structured Risk Indicators
We propose a two-stage large language model LLM framework for zero-shot detection of insider threats and advanced persistent threats APTs from heterogeneous security logs. The framework models user activity as chronological timelines and incorporates retrieval-augmented generation RAG to provide...
mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-9856 via transformers (4.10.1)
transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-9856 Source advisory: OSV:GHSA-XRQW-3RRV-VX5W...
mengzi-zero-shot (>=0.1.0, <=0.2.1), opendelta (>=0.0.1, <=0.3.1) potentially affected by CVE-2026-66007 via datasets (1.17.0)
datasets PYPI version 1.17.0 is affected by a known vulnerability. The following packages have a transitive dependency on datasets and may be impacted: - mengzi-zero-shot =0.1.0, =0.0.1, =0.3.1 Source cves: CVE-2026-66007 Source advisory: OSV:GHSA-379C-QX7V-6H59...
From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python
The original ALPHA benchmark introduced a taxonomy-aware penalty for evaluating CWE-level vulnerability prediction in Python and proposed that the penalty could theoretically also serve as a training signal. This paper provides that validation. We compare three delivery mechanisms: supervised...
fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2026-40171 via jupyterlab (2.2.9)
jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2026-40171 Source advisory:...
TGCM: Topic-Guided Generative Disentanglement of Interleaved APT Technique Sequences
In enterprise environments, multiple Advanced Persistent Threat APT campaigns often unfold concurrently, producing audit logs in which attack techniques across actors sources are interleaved over time. This setting naturally gives rise to an Unknown-K Interleaved Sequence Demixing UKISD problem:...
Data-Centric Benchmarking of Exploit Generation in LLMs: Understanding the Impact of Fine-Tuning
We study the task of CVE-conditioned exploit generation, where a model drafts proof-of-concept PoC exploits given software vulnerability context. We adopt a data-centric approach, constructing a high-quality dataset via multi-stage preprocessing and introducing a scalable evaluation framework wit...
mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-5241 via transformers (4.10.1)
transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-5241 Source advisory: OSV:PYSEC-2026-2290...
mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-4372 via transformers (4.10.1)
transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-4372 Source advisory: OSV:PYSEC-2026-2289...
Swiss-Bench 003: Evaluating LLM Reliability and Adversarial Security for Swiss Regulatory Contexts
The deployment of large language models LLMs in Swiss financial and regulatory contexts demands empirical evidence of both production reliability and adversarial security, dimensions not jointly operationalized in existing Swiss-focused evaluation frameworks. This paper introduces Swiss-Bench 003...
CVE-2026-23654
Dependency on vulnerable third-party component in GitHub Repo: zero-shot-scfoundation allows an unauthorized attacker to execute code over a network...
NASimJax: GPU-Accelerated Policy Learning Framework for Penetration Testing
Penetration testing, the practice of simulating cyberattacks to identify vulnerabilities, is a complex sequential decision-making task that is inherently partially observable and features large action spaces. Training reinforcement learning RL policies for this domain faces a fundamental...
Zero Shot scFoundation Code Execution
The vulnerability of the Zero Shot scFoundation software is related to the presence of a vulnerability in the borrowed component. Exploiting this vulnerability allows a remote attacker to execute arbitrary code...
