Executable Prefix Values for Locating Agent Failures
Work on debugging LLM agents treats the"first mistake"marked by a human or LLM judge as ground truth for where a trajectory failed. We ask whether such labels point at causes or symptoms, and make the distinction executable: we restart the agent from reconstructed intermediate states of a failed trajectory and estimate...
Bingyu Shen, Jia-Qi Tang, Lan Wei et al.
· 0 citations