MAI-2024-0015

Large Language Models LLMs that employ prefix-forcing safety measures are susceptible to jailbreak attacks when the set of "safe" prefixes lacks diversity or fails to accommodate model-specific response styles. Attackers can exploit this vulnerability by crafting prompts that induce alternative...