This work introduces budgeted KV-cache repair: recovering task performance by recomputing a user-chosen fraction of the retained suffix, and finds that refreshing coherent regions can substantially outperform refreshing isolated tokens.
Han Yu, Wen-Hui Zhu, Jincheng Cao et al.· 0 citations
Multi-teacher on-policy distillation (MOPD) is used in two settings. In common-domain composition, several teachers score each student rollout from one prompt domain and their signals form a single target; in routed-domain distillation, prompts from different domains are assigned to the corresponding specialist. Both s...
Yuanda Xu, He-Jian Sang, Zheng-Ze Zhou et al.· 0 citations
Segment-level Hindsight Advantage Reweighting for Policy Optimization (SHARPO), a credit-assignment mechanism that refines Group Relative Policy Optimization at the level of environment-facing segments that outperforms existing baselines on the ALFWorld and WebShop benchmarks.
Xin-Chen Du, Zheng-Ze Zhou, Wen-Hui Zhu et al.· 0 citations
This work studies online compaction across token eviction (TE) and attention matching (AM), adapting both to compact agent turns and comparing cheap proxy sources such as boundary, repeat-prefill, and delayed future-generation queries, finding TE is often more robust than AM under imperfect proxies.
Yujian Liu, Jiabao Ji, Li An et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.