The results suggest that LLMs tend to present narratives of success by default, and that steering models toward honesty makes their reports substantially more transparent.
Jenny Y. Huang, Jia-Meng Fan, Ahmed Imtiaz Humayun et al.· 0 citations
This work proposes and demonstrates an alternate objective for a new interpretability objective: understanding model internals to predict behavior and assess reliability under distribution shift, and successfully uses attention patterns to predict which rule each model follows on OOD data.
Victoria R. Li, Jenny Kaufmann, Tian Qin et al.· arXiv.org· 13 citations· ⚡1
Compute-Data (CD) scaling laws are proposed, a unified framework that bridges compute-optimal scaling, where data scales freely with compute, and data-optimal scaling, where the corpus is fixed while compute can grow without bound.
Tian Qin, K. Hamidieh, David Alvarez-Melis· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.