Hyunil Kim

Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs

Multilingual LLMs answer the same multi-hop reasoning question across languages, but we lack a mechanistic account of whether they share an internal circuit. We identify Bridge Routing Heads (BRH) in two large multilingual LLMs through a three-stage pipeline. The resulting language-specific head sets exhibit near-compl...