Imperceptible Jailbreaking against Large Language Models

Jailbreaking attacks on the vision modality typically rely on imperceptible adversarial perturbations, whereas attacks on the textual modality are generally assumed to require visible modifications e.g., non-semantic suffixes. In this paper, we introduce imperceptible jailbreaks that exploit a...