Cultural Benchmarking of LLMs in MSA and Arabic Dialectal Dialogue
M. Dehan, Aldry Kautsar, ∗. SaeedAlmheiri et al.
· 0 citations
2 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
EDRAC: Benchmarking Arabic Dialect Reading Comprehension
This work introduces EDRAC, the first large-scale benchmark for dialectal Arabic machine reading comprehension (MRC) and generative QA, covering five major dialects: Egyptian, Moroccan, Emirati, Syrian, and Saudi Arabic, and benchmarks Arabic-centric and multilingual LLMs on EDRAC using lexical and semantic metrics.
Noor Abo Mokh, K. Chirkunov, Teresa Lynn et al.
· 0 citations