Zi-Meng He

Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and Trajectories

Web agents are an important application of large language models, yet their evaluation often depends on rule based or language model evaluators that inspect only the final outcome. Human verification of task completion and detailed analysis of failed trajectories remain limited. We audit all 165 WebArena Lite tasks und...