Bridge Routing Heads: Where Multilingual Multi-hop Reasoning Lives in LLMs
Multilingual LLMs answer the same multi-hop reasoning question across languages, but we lack a mechanistic account of whether they share an internal circuit. We identify Bridge Routing Heads (BRH) in two large multilingual LLMs through a three-stage pipeline. The resulting language-specific head sets exhibit near-compl...
Seunghan Kim, Minyeong Choe, Hyunil Kim et al.
· 0 citations