On-policy self-distillation (OPSD) has attracted growing interest as a promising approach to improve the reasoning ability of language models. Without external rewards nor a separate stronger teacher, the self-teacher with privileged information could provide dense signals on student's trajectories. However, its behavi...
Yang Li, Gong-Le Xue, Yu-Heng Yuan et al.· arXiv.org· 0 citations
It is argued that OPSD is a sensitive algorithm rather than a generally reliable reasoning-improvement post-training method because it produces ineffective length growth, stable degradation, or behavioral collapse.
Yang Li, Gong-Le Xue, Yu-Heng Yuan et al.· 0 citations
Gaussian Splatting has enabled real-time novel view synthesis, but its tightly coupled geometry and appearance representation often require a large number of primitives to reproduce high-frequency texture details, leading to substantial memory and optimization costs. Recent textured 2D Gaussian methods alleviate this l...
Zhi-Wei Li, Yi-Jia Guo, Yi-Shi Lu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.