It is found that generated harnesses remain substantially behind mature human-engineered references on code and on search and research, while matching or exceeding the selected references on writing and machine-learning experimentation, with large variation in execution cost.
Yu-Hao Wu, Jing-Yuan Zhang, Jia-Jun Shi et al.· 8 citations
This work introduces ASPIRE, a benchmark for vague-goal-driven self-evolution and shows that vague goals redirect search effort toward goal interpretation, and evaluates the resulting systems on a hidden, expert-authored set of 520 items spanning six goals.
Yu-Hao Wu, Jingyuan Zhang, Jia-Jun Shi et al.· 0 citations
These findings show that recognizing successful actions is insufficient; agents must also transform feedback into executable and transferable policies, and provide a unified framework for diagnosing this process and identifying the bottlenecks that prevent agents from translating interaction experience into reliable se...
Jia-Jun Shi, Siyang Tao, Yu-Hao Wu et al.· 2 citations
Through a rigorous three-stage empirical evolution and analysis of the diagnostic failure of an asymmetric logical ensemble, the experimental results demonstrate that epistemic noise suppression is strictly superior to heuristic recall compensation in abductive reasoning tasks.
Chiyao Zhou, Zebing Wang, Kexin Deng et al.· SemEval@ACL· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.