Attention as a Routing Graph: Live Circuit Extraction from a Single Forward Pass
This work treats attention as a routing map from one forward pass, keep a small set of routes that point toward the answer, and asks whether those routes actually matter, and whether those routes actually matter.