This work investigates the performance of various LLM-as-a-judge in a low-resource scenario, namely Basque, and evaluates its correlation with human judgements, and shows that state of the art models exhibit fairly poor correlations with humans and amongst themselves.
David Ponce, Harritxu Gete, Thierry Etchegoyhen et al.· International Conference on...· 2 citations
The CRITICS project addresses science accessibility and literacy by converging advanced Machine Translation based on Large Language Models (LLMs) with educational technology and explores the design and evaluation of innovative science teaching-learning proposals grounded in curriculum-aligned teaching-learning.
Rodrigo Agerri, Itziar Aldabe, Elena Cabrio et al.· 0 citations
This work presents a method to generate multilingual reasoning traces based on medical knowledge extracted from Wikipedia, and produces 500k traces in English, Italian, and Spanish, using a retrieval-augmented generation approach over medical information from Wikipedia.
Pietro Ferrazzi, Aitor Soroa, Rodrigo Agerri· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.