CompassOPD: Cross-Family On-Policy Distillation via Within-Family Likelihood Shifts
CompassOPD is proposed, which removes this offset and transfers the within-family shift, while a frozen student reference anchors updates to the student's initial policy, and shows that CompassOPD consistently outperforms standard cross-family OPD.