Finite Probes Suffice: Identifiability and Universality for Weight-Space Learning
This work studies when finite probe-based representations are sufficient for learning neural functionals, establishes general identification and universality results for probing, and shows that using intermediate hidden representations can provide significantly more informative representations than relying only on fina...