MAI-2024-0023

The multi-round jailbreak attack targets Large Language Models LLMs by exploiting their iterative prompt-response mechanisms to bypass established safety protocols. This attack method involves progressively refining prompts over multiple interactions, thereby inducing the LLM to produce unintende...

AI Meets Spring Petclinic: Implementing an AI Assistant with Spring AI (Part II)

Recap of Part I In the first part of this blog series, we explored the basics of integrating Spring AI with large language models. We walked through building a custom ChatClient, leveraging Function Calling for dynamic interactions, and refining our prompts to suit the Spring Petclinic use case. ...

AI Meets Spring Petclinic: Implementing an AI Assistant with Spring AI (Part I)

Introduction In this two-parts blog post, I will discuss the modifications I made to Spring Petclinic to incorporate an AI assistant that allows users to interact with the application using natural language. Introduction to Spring Petclinic Spring Petclinic serves as the primary reference...

MAI-2024-0006

Large Language Models LLMs are susceptible to a sophisticated multi-turn jailbreaking attack known as the "RED QUEEN ATTACK." This technique involves engaging the LLM in a series of conversational exchanges that obscure malicious intent by portraying the user as a protector aiming to prevent...

Lunar Access Control Vulnerability

lunary is lunary open source a production toolkit for LLM . An access control error vulnerability exists in lunary that stems from improper access control and can be exploited by an attacker to change the name of an organization...

ChuanhuChatGPT Path Traversal Vulnerability

ChuanhuChatGPT provides a fast and easy-to-use Web GUI for ChatGPT/ChatGLM/LLaMA/StableLM/MOSS and other LLMs. ChuanhuChatGPT suffers from a path traversal vulnerability that stems from the use of an outdated gradio component that is susceptible to path traversal attacks...

ChuanhuChatGPT Access Control Error Vulnerability

ChuanhuChatGPT is a lightweight and easy-to-use Web GUI for ChatGPT/ChatGLM/LLaMA/StableLM/MOSS and many other LLMs. ChuanhuChatGPT suffers from an access control error vulnerability that stems from an improper access control mechanism...

ChuanhuChatGPT Information Disclosure Vulnerability

ChuanhuChatGPT provides a fast and easy-to-use Web GUI for ChatGPT/ChatGLM/LLaMA/StableLM/MOSS and other LLMs. ChuanhuChatGPT suffers from an information disclosure vulnerability that stems from a timing attack vulnerability in the password comparison logic...

Number withdrawn

Lunary is a production toolkit for LLMs from lunary open source. This CVE number has been withdrawn...

Lunary security vulnerabilities

Lunary is lunary open source a production toolkit for LLM. Lunary has an authorization issue vulnerability that stems from the lack of proper authorization checks in the dataset deletion end node, which can be exploited by an attacker to delete any dataset...

Ollama Reverse DNS Rebinding

The vulnerability of Ollama’s system for running and managing large language models is related to the use of reverse DNS resolution for IP addresses. Exploiting this vulnerability could allow a remote attacker to perform a DNS Rebinding attack or cause a service failure...

Number withdrawal

Lunary is a production toolkit for LLMs from lunary open source. This CVE number has been withdrawn...

MAI-2024-0056

This vulnerability pertains to multimodal large language models MLLMs, where attackers can efficiently perform jailbreaking attacks by utilizing visual inputs to circumvent established safety protocols. The attack methodology involves integrating a visual module into the target LLM, followed by...

Getting Started with LLMs: Managing Data Collection

...

Number withdrawal

Lunary is a production toolkit for LLMs from lunary open source. This CVE number has been withdrawn...

Number withdrawal

Lunary is a production toolkit for LLMs from lunary open source. This CVE number has been withdrawn...

Three Tips to Protect Your Secrets from AI Accidents

Last year, the Open Worldwide Application Security Project OWASP published multiple versions of the "OWASP Top 10 For Large Language Models," reaching a 1.0 document in August and a 1.1 document in October. These documents not only demonstrate the rapidly evolving nature of Large Language Models,...

MAI-2024-0059

Multimodal Large Language Models MLLMs operating within multi-agent environments are susceptible to a sophisticated attack known as "infectious jailbreak." This vulnerability is triggered by the introduction of a single adversarial image into the memory of one agent, which can rapidly propagate...

AI likely to boost ransomware, warns government body

The British National Cyber Security Centre NCSC says it expects Artificial Intelligence AI to heighten the global ransomware threat. In a report, the NCSC makes the assessment that AI will almost certainly increase the volume and heighten the impact of cyberattacks over the next two years. We’re...

How AI hallucinations are making bug hunting harder

Bug bounty programs that pay people for finding bugs are a very useful tool for improving the security of software. But with the availability of artificial intelligence AI as seen in the popular large language models LLMs like ChatGPT, Bard, and others it looks like there is a new problem on the...