Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation
The proposed Uncertainty-Calibrated MOPD (UCMOPD), which addresses limitations of standard MOPD through two complementary mechanisms, improves the general-capability average over standard MOPD by $4.48\% and $7.86\% while maintaining vertical-domain performance.
Zi-Yuan Liu, Jiao Ou, Jian Liang et al.
· 0 citations