What Really Matters in Many-Shot Attacks? an Empirical Study of Long-Context Vulnerabilities in LLMs

We investigate long-context vulnerabilities in Large Language Models LLMs through Many-Shot Jailbreaking MSJ. Our experiments utilize context length of up to 128K tokens. Through comprehensive analysis with various many-shot attack settings with different instruction styles, shot density, topic,...