2026
Judging Instruction Responses in a Low-Resource Language: A Case Study on Basque
This work investigates the performance of various LLM-as-a-judge in a low-resource scenario, namely Basque, and evaluates its correlation with human judgements, and shows that state of the art models exhibit fairly poor correlations with humans and amongst themselves.
David Ponce, Harritxu Gete, Thierry Etchegoyhen et al.
· International Conference on... · 2 citations