AI agents are playing an increasingly important role in physics research. However, existing physics benchmarks only evaluate fixed questions, isolated sub-tasks, or paper reproduction with given solutions, and rarely check research quality alongside correctness. We introduce FrontierPhysics, an end-to-end benchmark wit...
Bing-Ran You, Wen-Jun Ke, Ria Rosenauer et al.· 0 citations
VerifierBench, a benchmark of 222 tasks from six agent benchmarks spanning tool-call, state-based, and code verification, with 4,993 hidden test cases that include alternative valid solutions and attacks is introduced; Verifier4Verifier (V4V), a six-check audit, screens its source verifiers and test suites.
Jia-Ning Yin, Zi-Yi Chen, Hao Wang et al.· 1 citation
Early successes on agentic robotics point to a potential paradigm shift toward using coding agents to control robots. Existing robotics benchmarks are built around visuomotor policy learning, leaving it open whether coding agents can reliably control diverse robots under physical-world constraints. We therefore introdu...
Kang-Rui Wang, Qineng Wang, Chang-He Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.