As large language models become more powerful, self-evolving agents are able to tackle challenging tasks including AI for machine learning (AI4ML). In AI4ML, while empirical verification is available, it often requires computationally costly model training and evaluation, limiting the speed and scale of agent evolution...
Jiamu Bai, Li-Zhu Zhang, Xin Yu et al.· 0 citations
Harness optimization provides a practical setting for recursive self-improvement (RSI), where agent-generated modifications inform subsequent changes through execution feedback. Recent work such as Meta-Harness implements this process through iterative code generation and evaluation, but retains a fixed development set...
Hao-Yu Dong, Yu-Hang Zhou, Zi-Hao Lin et al.· 0 citations
This work introduces ToolMLBench, a suite of executable tools for data inspection, code verification, and experiment diagnosis, together with an SFT and RL pipeline for learning their use, and measures how privileged context changes the likelihood of a sampled tool action and uses this difference as a turn-level reward...
Xin Yu, Li-Zhu Zhang, Jiamu Bai et al.· 0 citations
Progress-Aware Consistent Evolution (PACEvolve), a systematic framework for governing agent memory and search dynamics, maintains a global view of search momentum and achieves state-of-the-art results across complex evolutionary benchmarks.
Minghao Yan, Bo Peng, Benjamin Coleman et al.· arXiv.org· 22 citations
Ablations show that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, advisor-only guidance, and general retrieval, and general retrieval and that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, and general retriev...