On-policy distillation (OPD) trains a student on its own generated prefixes with token-level teacher feedback, but transmitting or storing the teacher's full-vocabulary distribution at every token is costly. Entropy-aware OPD (EOPD) adds forward supervision to reverse KL to help the student recover plausible tokens it...
Zi-Xiang Ni, Zhuo-Lun Hu, Ren-Jie Cao et al.· 0 citations
CaptchaArena, the first large-scale, fine-grained training dataset for interactive CAPTCHA solving, is presented and CaptchaAgent, a single 9B policy for all 20 CAPTCHA types, is trained with supervised fine-tuning followed by reinforcement learning.
Zhen-Hao Zhang, Zhao-Yu Fan, Hao-Han Ying et al.· 0 citations
The proposed SeekJudge framework, in which four role-specialized agents, a Condense, a Ground, a Seek and an Analyze agent, reach a verdict through a Seek--Analyze loop over the trajectory, is the first practical model-based reward to match or surpass native rule-based supervision in online RL.
Yang Wan, Zhenhao Zhang, Jie-Rui Wang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.