On-policy distillation (OPD) trains a student on the responses it generates. Existing LLM multi-teacher OPD transfers what specialists predict through their output distributions. We introduce Latent-MOPD, to our knowledge the first representation-level multi-teacher OPD method for LLMs. It integrates existing specialis...
Zheng-Yu Fang, Seoyeon Hong, Jie Yang et al.· 0 citations
This work proposes TUSA (Trust-based Uncertainty Sparse Alignment), a dynamic arbitration process that reframes alignment as a dynamic arbitration process, introducing an uncertainty-aware arbiter that authorizes intervention only when two conditions are met: the supervisor is confident and the token is semantically sa...
Zeen Zhu, Zhuo Li, Wei-Yang Guo et al.· 0 citations
PivoARL is proposed, a self-feedback retry framework for experience exploitation in LLM agents that identifies the pivotal erroneous turn through structured reflection and performs local retry only from the corresponding pivotal state, thereby reusing the correct prefix and reducing redundant interactions.