Distribution-aware Language Neuron Identification in Multilingual Large Language Models
Distribution-aware Language Neuron selection is proposed, which leverages pairwise relationships between per-language activation distributions over the full activation range, including negative values, to quantify each neuron's language specificity by clustering languages using pairwise overlap coefficients between the...