An agent harness is the code that organizes context, maintains state, and coordinates tool calls for a language model. We study how to improve the harness under a limited evaluation budget while keeping model weights fixed. Our method, MESH-Harness, organizes each harness into functional modules with explicit role-spec...
Zhi-Wei Shang, Yun-Chen Huo, Ming-Rong Gong et al.· 0 citations
Long-horizon competition tests agents'ability to coordinate business decisions under uncertainty and adapt to changing rival strategies. We introduce CEO Arena, a benchmark that uses matched replacement evaluation to assess operating returns alongside an agent's effects on rivals and the market. Each CEO agent is compa...
An Yan, Yu-Jia Huo, Zhi-Wei Shang et al.· 0 citations
Sparse Probing and Outcome-calibrated Targets OPD is introduced, which addresses two coupled decisions, where to probe and what to distill, through an acquisition--exploration--exploitation procedure and demonstrates the effectiveness of SPOT in improving reasoning performance while balancing solution quality and cover...
Zi-Kun Qu, Min Zhang, Ming-Ze Kong et al.· 8 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.