Many annotation projects begin before experts have a stable guideline or enough labels to train a task-specific model. We present Goldsmith, an agentic pipeline that turns a small gold set---expert-annotated calibration examples representing the intended task boundaries---into a reusable structured annotation definitio...
Yi-Han Li, Han-Yi Zhang, Xiao-Xi Jiang et al.· 0 citations
Outcome-Guided On-Policy Distillation is proposed, which applies trajectory-relative weighting to teacher supervision and calibrates these weights using final task outcomes from paired student continuations and selectively strengthens supervision on the student's original trajectories at turns where teacher guidance be...
Tong Zhang, Zhou Liu, Yi-Hao Liu et al.· 0 citations
This work presents Token-Disentangled Latent Test-Time Scaling, an inference-time framework that makes latent refinement token-role-aware and outperforms strong output-space test-time scaling baselines under matched decoded-candidate budgets.
Hao-Xuan Ma, Yi-Hao Liu, Yu-Tao Sun et al.· 0 citations
Generative query suggestion aims to enhance user engagement by anticipating user intents and recommending relevant follow-up queries. A central challenge is to generate slates whose individual queries are useful while the slate covers distinct intents. We propose an Intent-Driven Query Suggestion Framework with dual-st...
Xin-Peng Liu, Lu-Yao Ma, Jia-Yi Qiao et al.· 0 citations
Specialize-and-Merge Online Policy Distillation (SMOPD) is proposed, a two-stage training method for multi-reward optimization that outperforms GDPO across 1.5B, 3B and 7B backbones.
Wen Wang, Jia-Hua Bao, Tu Yongsiqi et al.· 1 citation
NapMem is introduced, a framework for learning to use long-term user memory as a structured action space rather than passively retrieved context, and suggests that long-term user memory benefits from coupling structured storage with a learned policy for using memory at the appropriate granularity.
This work introduces Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a dynamic skill controller that effectively bridges the gap between structured verification and open-ended exploration.
Siyuan Huang, Pengyu Cheng, Haotian Liu et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.