Author

Gurbir Arora

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Causal and Interpretable Structures in LLM Compositional Tasks

Large language models are able to solve tasks whose answers depend on not only individual input tokens, but also on relations among them. How is such relational information represented and processed across transformer layers? We study activations from ensembles of prompts that require inferring relationships between th...

Gurbir Arora, To-Ni J. B. Liu, Jiajun Bao et al. · 0 citations

#artificial intelligence Preprint Sep 2026

The Geometry of Ignorance: LLMs Know When to Temper Bayesian Priors

The direction of ignorance is causally active: raising or lowering $\lambda$ at the final prediction state steers the prediction toward or away from the unigram prior in KL divergence, with larger models generally exhibiting lower prior reliance in the high-context limit.

To-Ni J. B. Liu, Jiajun Bao, Yizhou Liu et al. · 0 citations