On-policy self-distillation (OPSD) trains mathematical reasoning models using a privileged teacher that sees a reference solution and supervises student-sampled prefixes. Standard OPSD uses one fixed parameter setting at every state, but nearby settings may offer additional supervision. We find that local parameter per...
Xin Wei, Yi-Fan Ding, Yoshua Y. Li et al.· 0 citations
SA is proposed, a Stable Advantage Fusion framework that avoids entropy collapse and consistently outperforms fixed-coefficient GRPO+OPD fusion, improving the aggregate score by 0.70% across all six model-domain settings while achieving more stable training.
Yifan Ding, Xin Wei, Yoshua Y. Li et al.· arXiv.org· 3 citations
DagEvo is introduced, whose diagnostician extracts recurring error causes from this history and stores them in a hierarchical error-cause memory, whose diagnostician extracts recurring error causes from this history and stores them in a hierarchical error-cause memory.
Xin Wei, Yinze Ding, Yoshua Y. Li et al.· 0 citations
Results show that observed evidence can guide graph retrieval toward the part of a supporting chain left underspecified by the original question, and introduce EviReform, which separates revising the retrieval request from aggregating evidence in the graph.
This work presents RAGSieve, which constructs a reference matched to each detection scope, which requires poison labels, a trusted corpus, or training to be constructed.
Xinlong Xu, Yoshua Y. Li· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.