Agentic-CLIP-Benchmark

Agentic-CLIP-Benchmark: Zero-Shot Evaluation on CIFAR-10 -green.svg This project implements a robust, automated pipeline for evaluating OpenAI's CLIP ViT-B/32 model on the full CIFAR-10 test set 10,000 images. Developed using an AI Native workflow Trae IDE , it achieves a high-precision zero-shot...

SAFE

SAFE SAFE performs controlled, repository-aware security assessment of Semgrep and Trivy findings in research artifacts. It supports two independent classification tasks: direct binary prediction SECURITYRELEVANT or NONSECURITY and the detailed multiclass contextual taxonomy three labels — see...

RLCDAlignBench

Just Ask Jev: Reinforcement Learning for Calibrated Decisions as a Zero-Shot Detector of AI Alignment Failures This repository holds RLCDAlignBench and the code behind the paper. The benchmark measures whether a detector can tell when a language model's output is an alignment failure. It has 44...

mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-9856 via transformers (4.10.1)

transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-9856 Source advisory: OSV:PYSEC-2026-3929...

Benchmarking LLMs for Threat Level Determination

The fast progress of large language models LLMs opens new opportunities in the management of cyber threat intelligence, but their reliability for operational tasks remains unclear. In this work, we benchmark LLMs on the task of threat level determination. First, we construct a curated dataset...

Moirae: A Multimodal Agent Collaborative Framework for Dynamic Android Malware Detection

The Android ecosystem faces persistent and rapidly evolving malware threats. Existing machine learning detectors are vulnerable to concept drift because they rely on implementation-specific features whose distributions change over time. Large language models LLMs offer strong semantic understandi...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2026-73415 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2026-73415 Source advisory:...

LLMs for Zero-Shot Threat Detection Via Structured Risk Indicators

We propose a two-stage large language model LLM framework for zero-shot detection of insider threats and advanced persistent threats APTs from heterogeneous security logs. The framework models user activity as chronological timelines and incorporates retrieval-augmented generation RAG to provide...

mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-9856 via transformers (4.10.1)

transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-9856 Source advisory: OSV:GHSA-XRQW-3RRV-VX5W...

mengzi-zero-shot (>=0.1.0, <=0.2.1), opendelta (>=0.0.1, <=0.3.1) potentially affected by CVE-2026-66007 via datasets (1.17.0)

datasets PYPI version 1.17.0 is affected by a known vulnerability. The following packages have a transitive dependency on datasets and may be impacted: - mengzi-zero-shot =0.1.0, =0.0.1, =0.3.1 Source cves: CVE-2026-66007 Source advisory: OSV:GHSA-379C-QX7V-6H59...

mengzi-zero-shot (>=0.1.0, <=0.2.1), opendelta (>=0.0.1, <=0.3.1) potentially affected by CVE-2026-66007 via datasets (1.17.0)

datasets PYPI version 1.17.0 is affected by a known vulnerability. The following packages have a transitive dependency on datasets and may be impacted: - mengzi-zero-shot =0.1.0, =0.0.1, =0.3.1 Source cves: CVE-2026-66007 Source advisory: OSV:PYSEC-2026-3716...

From Evaluation to Optimisation: Hierarchy-Aware Training Signals for CWE Prediction in Python

The original ALPHA benchmark introduced a taxonomy-aware penalty for evaluating CWE-level vulnerability prediction in Python and proposed that the penalty could theoretically also serve as a training signal. This paper provides that validation. We compare three delivery mechanisms: supervised...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2026-73626 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2026-73626 Source advisory:...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2026-40171 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2026-40171 Source advisory:...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2024-43805 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2024-43805 Source advisory:...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2024-22421 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2024-22421 Source advisory:...

fact-checking (0.0.1), hc-nlp (>=0.1.0, <=0.2.0) +3 more potentially affected by CVE-2026-67338 via jupyterlab (2.2.9)

jupyterlab PYPI version 2.2.9 is affected by a known vulnerability. The following packages have a transitive dependency on jupyterlab and may be impacted: - fact-checking 0.0.1 - hc-nlp =0.1.0, =0.0.2, =0.0.5 - muvimaker 0.2.6b0 - zero-shot-re 0.0.4 Source cves: CVE-2026-67338 Source advisory:...

TGCM: Topic-Guided Generative Disentanglement of Interleaved APT Technique Sequences

In enterprise environments, multiple Advanced Persistent Threat APT campaigns often unfold concurrently, producing audit logs in which attack techniques across actors sources are interleaved over time. This setting naturally gives rise to an Unknown-K Interleaved Sequence Demixing UKISD problem:...

Data-Centric Benchmarking of Exploit Generation in LLMs: Understanding the Impact of Fine-Tuning

We study the task of CVE-conditioned exploit generation, where a model drafts proof-of-concept PoC exploits given software vulnerability context. We adopt a data-centric approach, constructing a high-quality dataset via multi-stage preprocessing and introducing a scalable evaluation framework wit...

mengzi-zero-shot (>=0.1.0, <=0.2.1), nalcos (>=0.1.1, <=0.2.0) potentially affected by CVE-2026-5241 via transformers (4.10.1)

transformers PYPI version 4.10.1 is affected by a known vulnerability. The following packages have a transitive dependency on transformers and may be impacted: - mengzi-zero-shot =0.1.0, =0.1.1, =0.2.0 Source cves: CVE-2026-5241 Source advisory: OSV:GHSA-FGCW-684Q-JJ6R...