Circuit-Diff: Factual Edit-based Intervention Method for Localizing Knowledge in Attribution Graphs
To make CLTs easier to use for circuit discovery, Circuit-Diff is introduced, which intervenes on the model itself with a low-rank factual edit and takes the features whose role in the attribution graph changes under that edit as related to the edited knowledge.
Edward G. Friedman, Xiang-Chen Song
· 0 citations