Real-world embodied agents often pursue independent objectives within a shared physical environment, where their actions can alter the conditions faced by others. Existing benchmarks, however, typically assume shared goals or explicitly prescribed interaction protocols, leaving such emergent physical coupling underexpl...
Jie Yang, Jia-Jun Chen, Jia-Zheng Zhou et al.· 0 citations
CorVer (Corpus Verify) is a lightweight training-time approach to process supervision that derives sentence-level rewards from corpus co-occurrence statistics and outperforms the unmodified models in all standard factual-QA settings.
Shi-Chen Fan, Hao-Chang Hao, De-Hai Min et al.· 5 citations
An agent can complete a task while exhibiting undesirable behavior during execution. Developers need tests for the specific behaviors encountered in deployment, beyond fixed benchmark suites. We present TraceDance, an agent system that constructs targeted benchmarks from deployment traces for user-specified undesirable...
De-Hai Min, Dao-An Zhang, Yiming Zeng et al.· 0 citations
TimeEvo is proposed, which clusters an agent's diagnosed failures into capability gaps, plans a measurement for each, synthesizes evidence-only tools that fill them, and admits the candidate library only through a paired admission gate.
Jie Yang, Yan Zheng, Jia-Rui Sun et al.· 0 citations
ContextWeave is introduced, a longitudinal benchmark that evaluates whether recalled experience improves downstream agent performance in realistic office-work streams and motivates memory systems that optimize not only retrieval relevance but also reliable use during execution.
Bo Wang, Yu Yao, Enxi Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.