It is argued that a long-horizon agent must run continually without forgetting before it can learn continually, and that continual learning for these agents needs a substrate outliving every context and process.
E. Nijkamp, Anurag Koul, Egor Pakhomov et al.· 0 citations
This work proposes CVPO - Curriculum-guided Value-Variance Policy Optimization, a dynamic curriculum weighting method that adapts to question difficulty that achieves better performance and stronger exploration, enabling more accurate and robust reasoning in language models across various math tasks.
Ziqi Jia, Yalu Ouyang, Bo Pang et al.· 0 citations
River, a simple training recipe that improves reward quality by filtering low-quality environments and augmenting outcome rewards with process-level behavior regularization is proposed, which achieves the best performance among evaluated open-source RL-trained 8B models across four terminal-agent benchmarks.
Yi-Fan Yao, Bo Pang, Xuan-Phi Nguyen et al.· 2 citations
Procedural Memory Distillation is proposed, which converts crossepisode signals into reusable procedural memory and distills it into the policy's weights during training, yielding a memory-free model at inference.
Ye Liu, Srijan Bansal, Bo Pang et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.