The identity component of a Jacobian lens inflates the noise floor computed from it
A transformer's residual stream adds each layer's output to what came before, so the corpus-averaged Jacobian lens J = E[dh_final/dh_l] contains a copy of the identity by construction, and its share grows with depth as less transformation remains above the layer: at the deepest fitted layer of the six lenses read here...
Ikailo John Sessford
· Zenodo (CERN European Organi... · 0 citations