Preprint
Aug 2026
Local and Global Regimes of Geometric Complexity in Language Model Representations
A scale-dependent transition between two ID regimes is found: at low lexical diversity, conditions with fewer unique final words produce higher ID, while at high lexical diversity, this ordering reverses, and conditions with more unique words produce higher ID.
Arwa Osman, Marco Baroni, Iuri Macocco
· 0 citations