QuranicMMLU: A Cognitively-Aware Benchmark for Evaluating Generative AI Solutions on Quranic Linguistic Knowledge
The QuranicMMLU offers a rigorous, linguistically grounded framework for evaluating Arabic NLP in the Quranic domain and benchmark 12 systems on these items find that the Islamic-specialized model leads, yet every system scores higher on multiple-choice accuracy than open-ended answer quality.
R. El Ghali, Umm Kulsoom, Anas Madkoor et al.
· 0 citations