Preprint
Jul 2026
Building Fast, Evaluating Slow: Pipeline Choices Dominate Autointerpretability Score Variance
It is found that methodological variance collectively exceeds architectural variance across all metrics and tested models, suggesting that cross-paper comparisons based on autointerpretability scores may reflect pipeline differences rather than architectural differences, with implications for the ongoing debate on SAE utility.
Sinie van der Ben, Neele Roch, Anna Hedström et al.
· 0 citations