Preprint
Oct 2026
The State and Fate of Multilingual, Contextual Evaluation in the NLP World
Multilingual evaluation benchmarks are the primary instrument for assessing whether large language models generalize beyond English, yet the adequacy of these benchmarks has received little systematic scrutiny. We present a data-driven audit of 51 recent multilingual benchmarks spanning 242 datasets and 219 languages,...
Manan Uppadhyay, Himanshu Beniwal, P. Kodali et al.
· 1 citation