Aug 2026· Language Resources and Evaluation· Vol 60· 0 citations· 58 references
TL;DR
An in-depth evaluation of instruction tuning for Arabic NLP tasks using three prominent LLMs: LLaMA 3.1-8B, AceGPT-v2-8B, and Qwen3-8B shows that instruction tuning consistently improves performance across most tasks, with notable variations in effectiveness across different tasks and prompts.
An important practical reproducible framework for multilingual RAG benchmarking and insights for optimizing performance on resource-constrained devices are contributed and support the latent language hypothesis by suggesting an internal model bias toward high-resource languages.
B. J. Mohd, Khalil M. Ahmad Yousef, Salah G. Abu Ghalyon· Language Resources and Evalu...· 0 citations
A bidirectional Mamba encoder pretrained via masked language modeling on a corpus combining Arabic Wikipedia and CulturaX text is introduced, trained end-to-end on four consumer-grade NVIDIA RTX 2080Ti GPUs (11GB) over approximately ten days.
A controlled comparison between architecture based optimization and prompting based inference for Arabic-English code-switched topic classification is provided, and the results indicate that inference time conditioning can be more effective than increasing architectural complexity for this task.
D. Ali, Salma Haytham, Sandra George et al.· International Conference on...· 0 citations
Jais 2 is a family of Arabic-centric large language models developed jointly by MBZUAI, Cerebras, and Inception, designed to advance Arabic-centric language modeling, with strong performance across the Arabic and culturally grounded benchmarks evaluated in this report. The family includes, to our knowledge, the largest...
Mohamed Anwar, A. Freihat, George Ibrahim et al.· 3 citations
Retrieval-Augmented Generation (RAG) has become a standard technique to ground large language model outputs in external knowledge. However, evaluating RAG systems for Arabic remains problematic because traditional lexical metrics such as ROUGE and BLEU were designed for English, a language with limited morphological va...
Ahmed Ali Al-Ansi, Khalil Al-Wagih· 2026 6th International Confe...· 0 citations
It is established that, for Kazakh under the evaluated conditions, model choice dominates pipeline add-ons: fine-tuning is essential, VAD and zero-shot LLM correction consistently hurt, and a strong multilingual model sets the best result; the extent to which these conclusions extend to typologically similar Kipchak-Tu...
Nursultan Nyssanov, L. Rzayeva, Alisher Batkuldin et al.· Information· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.