Diffusion language models (DLMs) have attracted wide attention for their fast, parallel decoding, but they are believed to be far less efficient to train than autoregressive language models (ARMs): a widely cited study reports that a DLM needs roughly 16x the training compute of an ARM to match its likelihood, a figure...
Guang-Han Wang, B. He, Zhan Shi et al.· 0 citations
AI research agents automate the cycle of proposing, implementing, and evaluating experiments, opening a path toward recursive self-improvement. Yet their ability to propose experiments outpaces their capacity to execute them in real environments, making outcome prediction a key capability for sustained self-improvement...
Zi-Jun Wang, Ze-Wen Liu, Min-hua Lin et al.· 0 citations
Results provide evidence that access to a scalable, objective training signal can be a more important constraint than model scale alone, and can make otherwise ambiguous diagnostic reasoning tasks amenable to scalable reinforcement learning.
This formulation enables a systematic study of key self-improvement factors through the proposed Evo-Harness, and provides a principled understanding of how LLM agents can effectively learn on the fly.
Tian-Xin Wei, Zhan Shi, Min-hua Lin et al.· 14 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.