The Communication Map of a Transformer
The communication map, which charts every potential communication channel from the geometry of the model's weights alone, generalizing the composition score of Elhage et al. (2021), is presented and an account of the properties of the coupling coefficient is provided, including its geometric interpretation and its exac...