Supervised fine-tuning (SFT) is a key component of language model post-training, enabling effective task adaptation and serving as an important foundation for subsequent reinforcement learning. Recent methods seek to improve SFT by introducing token-level weights into the training objective, where these weights are typ...
Test-time training (TTT) enables a deployed language model to internalize incoming context on-the-fly into a small set of fast-weight parameters, rather than merely treating it as transient context for attention. In-Place TTT recently made this idea practical for large language models by repurposing the down-projection...
Yue Wu, Yang Zhang, Wei-Nan Gan et al.· 0 citations
CoDR (Confidence Drift Remasking), a training-free and sampler-agnostic refinement pass that estimates drift for all committed positions in only k forward passes via k-partition probing, and regenerates only the tokens the model no longer endorses.
Yue Wu, Qing-He Zheng, Yu Zhang et al.· Conference on Empirical Meth...· 0 citations
Experiments on the LongLaMP dataset show that PrefReward outperforms non-personalized and retrieval-based baselines in both generation quality and personalization interpretability.
Yue Wu, Chengbing Wang, Yimeng Bai et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.