DivOPD, a simple learner-side batch-selection method that spreads a fixed turn budget across more rollouts and, within each rollout, prioritizes turns with larger cumulative teacher-student disagreement, is introduced.
Han-Yang Wang, Ze-Yuan Liu, Zheng-Yu Chen et al.· 0 citations
Remarkably, despite operating entirely without pre-loaded metadata, the proposed TRUST-SQL framework consistently matches or surpasses strong baselines that rely on schema prefilling.
Ai Jian, Xiao-Yun Zhang, Er-Yu Guo et al.· arXiv.org· 3 citations
Adaptive Multi-Reward Projection is proposed, a lightweight online method that reallocates aggregation weights using three signals, relative shortfall, reward volatility, and recent progress, increasing pressure on lagging, unstable, or stagnant dimensions while relieving saturated ones.
CARE is proposed, which grounds every rubric evolution step in a high-quality anchor response generated by a frontier model conditioned on the prompt and its rubrics, enabling two complementary mechanisms: an Adaptive branch that reactively repairs reward misspecification; and a Chase branch that proactively converts f...
Si-Yuan Li, Xin-Xin Song, Rui-Nian Chen et al.· 0 citations
SelSkill is proposed, a dual-granularity preference-learning framework for selective skill invocation that formulates skill use as a skill-or-skip decision, uses predictive uncertainty to prioritize candidate decision points, and constructs controlled invoke-skip preference pairs from shared trajectory prefixes.
Chishui Chen, Jiaye Lin, Te Sun et al.· arXiv.org· 1 citation· ⚡1
AOPD replaces ineffective negative reinforcement with localized divergence minimization in non-positive advantage regions while preserving positive reinforcement learning and maintains higher policy entropy during training and better capability retention during sequential tool-use adaptation.
Nan Jia, Haojin Yang, Xing-Chen Ma et al.· arXiv.org· 18 citations· ⚡5
Experimental results demonstrate that the ToolVerse framework significantly strengthens LLMs'capabilities in long-horizon tool use, achieving a marked performance boost and showcasing robust reasoning within dynamic environments.
Shuaiyu Zhou, Fengpeng Yue, Zengjie Hu et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.