ai-llm-red-team-handbook

Manual de Campo y Manual del Consultor para Equipos Rojos de IA/LLM Un completo kit de herramientas operativas para realizar evaluaciones de equipos rojos de IA/LLM en modelos de lenguaje grandes, agentes de IA, pipelines RAG y aplicaciones habilitadas para IA. Este repositorio proporciona tanto...

AI-Red-Teaming-Playground-Labs

AI 红队演练实验室 本仓库包含“AI 红队实践”课程中使用的实验室挑战。该课程最初在 Black Hat USA 2024 上由 Amanda Minnich 博士 和 Gary Lopez 讲授。Martin Pouliot 负责这些挑战的基础设施和评分。这些挑战由 Amanda Minnich 博士、Gary Lopez 和 Martin Pouliot 设计。任何人都可以使用这些挑战。演练环境基于 Chat Copilot，并经过修改以用于该课程。 这些挑战也出现在 Microsoft Learn 限定系列：AI 红队 101 中，该系列于 2025 年 7 月 9...

SecML

SecML: 安全可解释机器学习库 SecML 是一个开源 Python 库，用于机器学习 ML 算法的安全评估 。 它具备一系列强大功能： 广泛的 ML 算法支持。 所有 scikit-learn 支持的监督学习算法均可用，同时通过 PyTorch 深度学习平台支持神经网络 NNs。 内置攻击算法。 基于自定义快速求解器的逃避和投毒攻击。此外，我们提供与其他第三方对抗性机器学习库的连接器。 稠密/稀疏数据支持。 我们在单一数据结构中提供对稠密数据（通过 numpy 库）和稀疏数据（通过 scipy 库）的完整、透明支持。 结果可视化。 我们提供基于广泛知名的 matplotlib...

Zero-Trust Federated Learning for Connected Aftermarket Devices

Connected aftermarket devices extend vehicle diagnostics, repair workflows, and over-the-air software maintenance beyond original equipment manufacturer boundaries, yet their heterogeneous ownership and long service life complicate conventional perimeter security. This paper develops Zero Trust...

SECUREVENT: Hybrid AI/ML Security Monitoring for Distributed Event-Based Systems

Distributed event-based systems have become a common substrate for Internet-scale publish/subscribe services, IoT telemetry, cloud-native microservices, and security operations pipelines. Their loose coupling and asynchronous delivery improve scalability, but they also expand the attack surface:...

New whitepaper outlines the taxonomy of failure modes in AI agents

We are releasing a taxonomy of failure modes in AI agents to help security professionals and machine learning engineers think through how AI systems can fail and design them with safety and security in mind. The taxonomy continues Microsoft AI Red Team's work to lead the creation of systematizati...

Cyberattacks against machine learning systems are more common than you think

Machine learning ML is making incredible transformations in critical areas such as finance, healthcare, and defense, impacting nearly every aspect of our lives. Many businesses, eager to capitalize on advancements in ML, have not scrutinized the security of their ML systems. Today, along with...

Cyberattacks against machine learning systems are more common than you think

Machine learning ML is making incredible transformations in critical areas such as finance, healthcare, and defense, impacting nearly every aspect of our lives. Many businesses, eager to capitalize on advancements in ML, have not scrutinized the security of their ML systems. Today, along with...