Beyond End-To-End Success: Diagnosing Failures in Long-Horizon Security LLM Agents

Long-horizon security LLM agents must carry information and decisions across many dependent interactions, where later actions often depend on services, state, or access discovered much earlier. This makes final task success difficult to interpret: an agent may fail before it ever reaches the poin...