Bo-Ming Xia

Does the Judge See What the Evaluation Requires? Input Assurance for LLM Agent Evaluation

An LLM judge assesses agent steps from text packets. A renderer converts recorded runs into these packets, while software checkers test records and packets against requirements. We ask what evidence shows a packet is what the evaluation requires and propose four input-assurance obligations: required content survives re...