MAI-2024-0066

This vulnerability pertains to the safety alignment mechanisms of large language models LLMs, facilitating a "weak-to-strong" jailbreaking attack. The attack methodology involves employing a smaller, adversarially trained LLM, referred to as "unsafe," to manipulate the decoding probabilities of a...