Repairs for Whom? Evaluator-Executor Mismatch in Selecting Repairs for Failed LLM Agents
This work labels every candidate with independent rollouts of the deployed policy and measures how much deployment value each evaluator's choice loses, asking whether these evaluators pick repairs that help the agent that will actually execute them.