Reinforcement learning with verifiable rewards improves the reasoning capabilities of large language models, but remains computationally expensive and sample inefficient. On-policy distillation (OPD) provides dense token-level supervision from a stronger teacher, yet standard OPD distills every token regardless of whet...
Yilan Chen, Zian Su, Manish Prajapat et al.· 0 citations
The second KDD Day on AI Reasoning brings together researchers and practitioners from academia and industry to examine how large language models and foundation models can be made more capable, reliable, interpretable, and efficient.
Jun Huan, James Caverlee, Lei Li et al.· Proceedings of the 32nd ACM...· 0 citations
This work proposes AHEAD, a step-aware framework that matches different supervision sources to different step types and solves tasks within tighter interaction budgets than outcome-only RL and prior self-distillation baselines.
Xiaolong Jin, Dingmin Wang, Vijay Lingam et al.· 1 citation
Large language models and foundation models are increasingly embedded in reasoning systems that plan, invoke tools, use memory, gather evidence, and iteratively refine their outputs. The second KDD Day on AI Reasoning brings together researchers and practitioners from academia and industry to examine how these systems...
Jun Huan, James Caverlee, Lei Li et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.