Never Stop Speaking: A Denial-Of-Service Attack on End-To-End Speech Language Models

Many studies have shown that specially crafted inputs can induce large language models LLMs to generate excessively long outputs, resulting in significant computational overhead and resource consumption. While most existing denial-of-service DoS attacks target text-only LLMs, end-to-end E2E speec...

Backdoor Attacks against Speech Language Models

Large Language Models LLMs and their multimodal extensions are becoming increasingly popular. One common approach to enable multimodality is to cascade domain-specific encoders with an LLM, making the resulting model inherit vulnerabilities from all of its components. In this work, we present the...