Mechanistic Interpretability with Sparse Autoencoder Neural Operators
The results show that moving from vector-valued to functional parameterizations, with concept and domain sparsity, extends SAEs from representing concept presence to modeling structured concept expression, highlighting the importance of parameterization.
Bahareh Tolooshams, Ai-Zhong Shen, Anima Anandkumar
· 4 citations