ResOPD: Tail Residualization for Sparse On-Policy Distillation
ResOPD is established as an efficient, plug-and-play variance reduction primitive for sparse on-policy distillation, which provides unbiased full-vocabulary reverse KL gradient estimation under on-policy sampling, with substantial variance reduction under the same sparse payload in the evaluated settings.