How often models reward-hack without instructions to do so, how effective and detectable their methods are when hacking is allowed, and how they adapt when an LLM review panel returns its decision and reasons are studied.
Yue Huang, Zhangchen Xu, Yu-Chen Ma et al.· 1 citation
Mid-training is increasingly recognized as a critical stage for shaping the capabilities of large language models. Recent work has shown that targeted mid-training can strengthen reasoning-intensive abilities such as math and science, and can also improve agentic capabilities in software-engineering settings. In this w...
Fengqing Jiang, Yi-Te Wang, Bo-Yi Liu et al.· 0 citations
Student-Centric Answer Sampling (SCAS) is proposed, a framework that selects from verified teacher-generated answers according to their estimated student-centric learning cost and is derived by a token-wise gradient decomposition and used to guide answer selection during training.
Zhengyu Hu, Zheyuan Xiao, Linxin Song et al.· 0 citations
Safety-aware Contrastive Decoding (SafeCoDe) is introduced, a lightweight and model-agnostic decoding framework that dynamically adjusts token generation based on multimodal context that consistently improves context-sensitive refusal behaviors while preserving model helpfulness.