Vraj Parikh

Which the Eye Fears: Writing with Read-Blindness Explains Massive Activations in Transformers

This investigation using an operator-level mechanistic analysis of attention and feed-forward blocks reveals that these blocks systematically ignore MA coordinates while reading, but not while writing; creating a read-write asymmetry that blocks corrective feedback while allowing continued accumulation.