Skip to content

STAR: instruction tuning for Arabic across tasks, datasets, and models

Aug 2026 · Language Resources and Evaluation · Vol 60 · 0 citations · 58 references

TL;DR

An in-depth evaluation of instruction tuning for Arabic NLP tasks using three prominent LLMs: LLaMA 3.1-8B, AceGPT-v2-8B, and Qwen3-8B shows that instruction tuning consistently improves performance across most tasks, with notable variations in effectiveness across different tasks and prompts.

View source

Similar papers

Jul 2026

Benchmarking and AI-assisted human-like evaluation of retrieval-augmented generation for Arabic and English documents

An important practical reproducible framework for multilingual RAG benchmarking and insights for optimizing performance on resource-constrained devices are contributed and support the latent language hypothesis by suggesting an internal model bias toward high-resource languages.

B. J. Mohd, Khalil M. Ahmad Yousef, Salah G. Abu Ghalyon · 0 citations
Preprint Aug 2026

AraSSM: A bidirectional state-space encoder for Arabic masked language modeling

A bidirectional Mamba encoder pretrained via masked language modeling on a corpus combining Arabic Wikipedia and CulturaX text is introduced, trained end-to-end on four consumer-grade NVIDIA RTX 2080Ti GPUs (11GB) over approximately ten days.

A. A. Aliane, H. Aliane, N. Semmar · 0 citations
Open access 2026

Prompting vs Ensemble Architectures for Arabic English Code-Switched Classification

A controlled comparison between architecture based optimization and prompting based inference for Arabic-English code-switched topic classification is provided, and the results indicate that inference time conditioning can be more effective than increasing architectural complexity for this task.

D. Ali, Salma Haytham, Sandra George et al. · 0 citations
Preprint Jul 2026

Jais 2: A Family of Arabic-Centric Open Large Language Models

Jais 2 is a family of Arabic-centric large language models developed jointly by MBZUAI, Cerebras, and Inception, designed to advance Arabic-centric language modeling, with strong performance across the Arabic and culturally grounded benchmarks evaluated in this report. The family includes, to our knowledge, the largest...

Mohamed Anwar, A. Freihat, George Ibrahim et al. · 3 citations
Conference Aug 2026

Beyond Lexical Overlap: A Multi-Dimensional Evaluation Framework for Arabic Retrieval-Augmented Generation Systems

Retrieval-Augmented Generation (RAG) has become a standard technique to ground large language model outputs in external knowledge. However, evaluating RAG systems for Arabic remains problematic because traditional lexical metrics such as ROUGE and BLEU were designed for English, a language with limited morphological va...

Ahmed Ali Al-Ansi, Khalil Al-Wagih · 0 citations
Open access Jul 2026

Evaluating ASR Pipeline Configurations for Kazakh: Implications for Low-Resource Turkic Languages

It is established that, for Kazakh under the evaluated conditions, model choice dominates pipeline add-ons: fine-tuning is essential, VAD and zero-shot LLM correction consistently hurt, and a strong multilingual model sets the best result; the extent to which these conclusions extend to typologically similar Kipchak-Tu...

Nursultan Nyssanov, L. Rzayeva, Alisher Batkuldin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.