Sinie van der Ben

Building Fast, Evaluating Slow: Pipeline Choices Dominate Autointerpretability Score Variance

It is found that methodological variance collectively exceeds architectural variance across all metrics and tested models, suggesting that cross-paper comparisons based on autointerpretability scores may reflect pipeline differences rather than architectural differences, with implications for the ongoing debate on SAE utility.