#machine learning
Jun 2026
Expert-Aware Causal Tracing of Factual Recall in Sparse MoE Language Models
Findings show that successful MoE-block restoration does not necessarily imply localization to a single expert, as it is shown that successful MoE-block restoration does not necessarily imply localization to a single expert.
Yuetian Lu, Ali Modarressi, Yihong Liu et al.
· arXiv.org · 0 citations