This work leverage Mixture of Factor Analyzers (MFA) as a scalable, unsupervised alternative that models the activation space as a collection of Gaussian regions with their local covariance structure, and positions local geometry, expressed through subspaces, as a promising unit of analysis for scalable concept discove...
Or Shafran, S. Ronen, Omri Fahn et al.· arXiv.org· 10 citations· ⚡2
This work finds that simple difference of means vectors coherently represent reward hacking in Kimi K3, GLM 5.2, and Qwen 3.8 Max, and provides evidence that simple, white-box methods can be used to scalably study and monitor reward hacking behaviors in frontier open source models.
Leon Bergen, Usha Bhalla, Andrew Lee et al.· 0 citations
It is shown that when resampling many reasoning chains, uncertainty dynamics converge to stable patterns, and noise is largely an artifact of sampling rather than an LLM's sensitivity to each individual token or reasoning step.
Eric J. Bigelow, Amir Zur, Satchel Grant et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.