On-policy distillation (OPD) has emerged as a core component of modern LLM post-training pipelines, yet we reveal a failure mode: degenerate agreement, where students exploit repetitive loops to achieve near-perfect token agreement with the teacher despite globally flawed responses. We therefore shift our focus from ag...
Zichao Yu, Chengzhi Yu, Shengze Xu et al.· 1 citation
Ada-BPSG is introduced, a line-search-free BPSG method that couples the SAGA gradient table with a stabilized Barzilai--Borwein (BB) candidate and yields a direct analytical chain from relative smoothness and component-wise variance control to convergence in finite-dimensional normed spaces.
Chen-Han Jin, Sheng-Ze Xu, Bing-Hui Xie et al.· 0 citations
This work proposes Causal Localization and Retain-Aware Projection (CLRP), a lightweight training-free framework that uses activation patching to identify the layer that causally mediates target-attribute disclosure, then applies a retain-aware projection that removes the target-attribute subspace while preserving same...
Junkai Lin, Junkai Chen, Siqi Hou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.