RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons
RACE (Residual Alignment for Consistency Estimation), a forward-pass statistical framework that evaluates the domain-wide functional consistency of Transformer neurons, produces neuron rankings that yield more domain-specific effects under perturbation.