Preprint
Oct 2026
ATI-OPD: Adaptive Teacher Intervention for Stable Long-Sequence On-Policy Distillation
On-policy distillation (OPD) trains a student on its own responses using token-level feedback from a teacher. As responses grow longer, the student's prefix can depart from the teacher's own reasoning, weakening its feedback on later tokens. Updates based on this feedback can reinforce the same deviations in later resp...
Jian-Nan Guan, You-Xin Jiang, Yu-Tai Hou et al.
· 0 citations