Jul 2026
Contrastive On-Policy Distillation
COPD is proposed, a contrastive OPD framework that substantially reduces reasoning length without compromising model performance and consistently improves efficiency across different tasks and model scales.
Jiacheng Ruan, Jun Tang, Wenzhen Yuan et al.
· arXiv.org · 2 citations