Preprint
Aug 2026
Interpreting Language Model Hidden States at Scale
OmniLens is presented, which applies a single lens family to any model-width activation, whether residual stream, attention, or MLP, and combines two independent scaling techniques, which reproduces key published results at substantially lower cost.
Jordan Pettyjohn, Mansi Sakarvadia, Nathaniel Hudson et al.
· 0 citations