Shuffled OPSD: When Semantic Consistency Hurts On-Policy Self-Distillation?
Knowledge distillation improves a student model's reasoning ability through supervision from a teacher. On-policy self-distillation (OPSD) uses the same model as both teacher and student under different contexts: the student generates reasoning trajectories from the question alone, while the teacher additionally receiv...