Gold vs. Translation: Are We Measuring Language, Knowledge, or Locality in Translated Benchmarks?
Translated versions of English-origin benchmarks such as MMLU are widely used to evaluate large language models in non-English languages, yet it remains unclear whether they measure the same constructs as natively created benchmarks. We frame this as a proxy validity question and compare DeepL-translated MMLU proxies a...