Can We Trust the Teacher? Decoupled Credit Direction-Magnitude for Self-Distillation
Decoupled Credit Self-Distillation is introduced, which theoretically decouples credit direction and magnitude into two reliable signals and uses them to calibrate privileged teacher supervision, enabling step-to-token credit assignment for policy optimization.
Yu-Gu Li, Ze-Hong Cao, Pei-Zhen Li et al.
· 0 citations