WebMirage

WebMirage Adversarial Images Hijack Web Agents from Visual Grounding to Browser Execution Wanjing Han, Levi Taiji Li, Mu Zhang, Yue Jiang, Guanhong Tao — University of Utah WebMirage is a red-teaming framework for vision-grounded web agents. It crafts localized adversarial perturbations on...

IAG: Input-Aware Backdoor Attack on VLMs for Visual Grounding

Vision-language models VLMs have shown significant advancements in tasks such as visual grounding, where they localize specific objects in images based on natural language queries and images. However, security issues in visual grounding tasks for VLMs remain underexplored, especially in the conte...