AIM-ZO is proposed, a ZO fine-tuning method based on Activation-Informed Subspace Maintenance that uses forward activations as local directional information and continuously integrates them into a broad, evolving subspace over training.
Yue Xie, Zhi Zheng, Yun-Peng Ba et al.· 0 citations
SkillEvoReg, a general regularization framework for skill evolution inspired by anti-overfitting techniques in neural-network training, is introduced and suggested that explicit regularization is a useful complement to increasingly capable skill updaters.
Guan-Yu Nie, Fang-Zhou Zhu, Shi-Xiong Kai et al.· 1 citation
This work decomposes each operator's utility into a coverage effect on evidence omitted by retention and a signed replacement effect on raw evidence that already fits, which explains why the preferred action changes with relative budget pressure.
Qingcan Kang, Mingyang Liu, Shixiong Kai et al.· arXiv.org· 1 citation
These findings position ES as a distinct reasoning post-training paradigm rather than a less effective, memory-efficient alternative to GRPO, and study how hyperparameter design affects the effectiveness of ES, demonstrating that ES requires a smaller population size in a larger LLM.
Yunpeng Ba, Zhi Zheng, Yue Xie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.