Emergent phases of superposition: from partial to full representation
This work shows that increasing the width drives a continuous phase transition from a partial-representation phase, where only a subset of features receives appreciable representation vectors while the rest vanish, to a full-representation phase, where every feature is represented.
Li-Hao Guo, Yizhou Liu, Jeff Gore
· 0 citations