Robustness Via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instruction

Large language models LLMs have demonstrated impressive performance and have come to dominate the field of natural language processing NLP across various tasks. However, due to their strong instruction-following capabilities and inability to distinguish between instructions and data content, LLMs...