Distribution-aware Language Neuron Identification in Multilingual Large Language Models
Distribution-aware Language Neuron selection is proposed, which leverages pairwise relationships between per-language activation distributions over the full activation range, including negative values, to quantify each neuron's language specificity by clustering languages using pairwise overlap coefficients between the...
Minjun Kim, Inho Won, Junghun Yuk et al.
· 0 citations