PreSO: Privileged Representation Isolation for On-Policy Self-Distillation
On-policy self-distillation (OPSD) uses a self-teacher conditioned on privileged information to turn the sparse outcome signal of reinforcement learning with verifiable rewards (RLVR) into dense token-level supervision. Yet the teacher's advantage may depend on information unavailable to the student at inference, raisi...
Yu-Hang Yang, Ming-Xuan Xia, Chao-Nan Ye et al.
· 0 citations