Skip to content

Some Dialects Are More Equal Than Others: Non-Prestigious Arabic Dialectal Bias in LLMs

Sep 2026 · 0 citations · 31 references
Computer Science

Abstract

Previous work on Egyptian Arabic in NLP has focused largely on the prestigious Cairene Egyptian Arabic (CEA) dialect, resulting in a lack of representation for the less prestigious Sa'idi Egyptian Arabic (SEA) dialect both in LLM and resource development. Does this lack of representation influence an LLM's view of the acceptability of SEA (upstream), and does an upstream bias against SEA lead to worse performance (downstream)? We investigate the upstream effect of SEA dialectal features on LLM preferences in a Targeted Syntactic Evaluation (TSE) task which reveals a significant bias against SEA across multiple LLMs. We then analyze the effect of these same features on downstream model performance on MMLU benchmarks and show that models experience a degradation in performance when presented with SEA. This work highlights the need for further exploration on how sub-dialectal variation impacts language technologies.

View source

Similar papers

#natural language process... Preprint Oct 2026

Does Modern Standard Arabic (MSA) Dominate Arabic Dialects in LLMs? A Representation-Level Analysis

Large language models (LLMs) often default to Modern Standard Arabic (MSA) when generating Arabic, even when prompted with dialectal Arabic. A natural explanation is that their internal representations are dominated by MSA. We test this hypothesis by adapting the language-dominance framework of Shani and Basirat (2025)...

Abdu Sallouh, Nicholas Popovic, Michael Färber · 0 citations
Open access Aug 2026

Syllable Structure Variation between Two Iraqi Arabic Dialects: A Comparative Optimality-Theoretic Investigation

This study is an Optimality-Theoretic comparison of two major dialects of Iraqi Arabic: Baghdadi Gilit Arabic (BGD) and Basri Arabic (BAS), focusing on syllable structure variation. The data were collected from 20 native speakers (10 for each dialect), representing both rural and urban backgrounds, as participants in r...

Israa Ali Kareem Al-Aaydi · 0 citations
Open access Oct 2026

Loanwords of Arabic Origin in Northern Talyshi through the Lens of Tolışon Sədo Newspaper

This study explores Arabic-origin loanwords in Northern Talyshi, addressing a significant gap in existing scholarship. Although the Talyshi language has been the subject of linguistic research for nearly two centuries, its lexicon – particularly borrowed vocabulary – remains largely understudied. Prior work has foc...

Hakob Avchyan · 0 citations
#artificial intelligence Preprint Aug 2026

Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models

Large language models are increasingly deployed in Arabic-speaking markets, yet standard benchmarks overwhelmingly reward Modern Standard Arabic (MSA) fluency while leaving dialectal and culturally grounded competence unmeasured. This gap is consequential: everyday Arabic is largely dialectal, and dialect encodes socia...

Ghassan Al-Sumaidaee, Sajjad Abdoli, Ahmed Rashad et al. · 0 citations
#artificial intelligence Preprint Sep 2026

EDRAC: Benchmarking Arabic Dialect Reading Comprehension

This work introduces EDRAC, the first large-scale benchmark for dialectal Arabic machine reading comprehension (MRC) and generative QA, covering five major dialects: Egyptian, Moroccan, Emirati, Syrian, and Saudi Arabic, and benchmarks Arabic-centric and multilingual LLMs on EDRAC using lexical and semantic metrics.

Noor Abo Mokh, K. Chirkunov, Teresa Lynn et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 24, 2026

Estimating suicide risk from text

A new language-processing tool could help identify the highest-risk individuals from natural language, enabling swifter interventions.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.