HAServe is presented, which turns HorizonSchema, a workload abstraction that connects exact prefix paths, permitted serializations, and released consumers as shared inputs to both decisions, into a scheduling--memory co-design method of systematic optimization for online LLM serving.
Xing-Yu Qu, Tian-Hao Lin, Yiqi Li et al.· 1 citation
STEPS is proposed, a selective OPSD framework that controls the location, direction, and duration of distillation that improves mean accuracy over GRPO and support brief, targeted self-distillation as an efficient complement to reward-driven reasoning training.
Jia-Xuan Wang, Xuan-Xin Ouyang, Z. Chen et al.· 15 citations
Two metrics to measure the exploration bias in instruction following are proposed and a two-stage framework to alleviate it is introduced: Behavioral Bootstrapping, a lightweight rejection sampling fine-tuning stage before RL to activate hard instructions; and Scarcity-Aware Rewards, a new RL reward function that assig...
Mian Zhang, Yueqin Yin, Kaiyu He et al.· Conference on Empirical Meth...· 0 citations
CacheBridge is introduced, which co-designs architecture-indexed mapper support, attention-aligned calibration, and bounded mapper construction while retaining a closed-form affine interface for online deployment.
Xing-Yu Qu, Si-Yuan Lu, Z. Chen et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.