In-Context Learning Amplifies a Latent Symbolic Circuit
A three-stage symbolic reasoning circuit (abstraction, induction, retrieval) is traced across shot counts in three model families and finds it is detectable and functional well before the model achieves high accuracy.
Melissa Wessel
· 0 citations