Scaled Idempotence in Transformer Attention: Paired OV Geometry and Shared-Value Algebras
These results characterize scaled idempotence as a sparse trained orientation within broadly available geometric capacity and show how value sharing extends a headwise relation into a local operator algebra.
Ji-Ming Feng, Jun-Liang Li
· 0 citations