A large-scale benchmark ICRL4AHT is introduced, built upon a high-throughput JAX implementation of Overcooked-V2 AHT, establishing this benchmark as a critical testbed for next-generation coordination algorithms.
Yu-Heng Jing, Kai Li, Zi-Wen Zhang et al.· arXiv.org· 0 citations
SWE-Universe, a scalable and efficient framework for automatically constructing real-world software engineering (SWE) verifiable environments from GitHub pull requests (PRs), utilizes a building agent powered by an efficient custom-trained model to ensure the reliable generation of high-fidelity, verifiable tasks.
Mouxiang Chen, Lei Zhang, Yunlong Feng et al.· arXiv.org· 14 citations· ⚡1
A dense, decision-level reward is introduced in which an LLM judge evaluates the necessity of each tool call, which effectively suppresses cue-driven tool use while preserving task performance, providing a practical approach to improving the robustness of LLM agent tool-use policies.
Yi-Wei Yang, Hao-Xiang Zhang, Bing-Bing Wen et al.· 0 citations
SWE-Bench ProMax is introduced, an expert-curated, multilingual code refactoring benchmark of 170 instances drawn from real commits across seven programming languages, which presents a meaningful and unsaturated challenge for current AI coding agents.
Yu-Ling Shi, Jing-Heng Xu, Kelin Fu et al.· 6 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.