Transfer-Stratified On-Policy Distillation for RL-Improved Reasoning Teachers
Reinforcement learning can substantially improve a reasoning teacher, but it is unclear which of those improvements survive when the teacher supervises a smaller on-policy student. We study this question in mathematical reasoning by comparing teacher lineages before and after GRPO, multiple student scales, direct GRPO,...
Xiao-Yu Chen, Bo Shao, Tian-Gang Zhu et al.
· 0 citations