Not Every Divergence Should Be Suppressed: Counterfactual Recoverability in On-Policy Distillation
Findings establish recoverability as an outcome-grounded decision variable for selective supervision in OPD and show that retaining teacher-correctable prefixes provides the largest individual contribution.