MAI-2024-0003

Large Language Models LLMs are susceptible to the "SequentialBreak" jailbreak attack, wherein a malicious prompt is embedded within a sequence of benign prompts in a single query. This technique exploits the LLM's attention mechanism, which prioritizes benign prompts, thereby allowing the harmful...