2026· ITEGAM- Journal of Engineering and Technology for Industrial Applications (ITEGAM-JETIA)· Vol 12, pp. 420-428· 0 citations
TL;DR
Results show that hybrid lexical-contextual representations offer a powerful, computationally effective solution to Arabic news classification.
Abstract
Arabic text classification is still a daunting undertaking because of the rich morphology, derivational complexity as well as lexical variability that is inherent in the language. Though transformer-based pretrained models have been a major breakthrough in Arabic Natural Language Processing (NLP), recent data indicates that conventional lexical representations continue to give a good discriminating ability in structured tasks like news classification. The given study will be a comparative analysis of classical machine learning models, transformer-based fine-tuning, and lexical contextual fusion framework as a hybrid method in Arabic multi-class news classification. A subset of the MAAD dataset (13,866 Arabic news articles) in six categories was carefully selected and cleaned and sampled to conduct experiments on a balanced and well-cleaned subset of the entire data set. To guarantee the data quality, the Arabic-character ratio filtering and length constraints were used to eliminate the corrupted and non-Arabic samples. TF-IDF features with Logistic regression and Linear Support Vector machine (SVM) were used to implement baseline models and contextual modeling was done using fine-tuning AraBERTv2. Moreover, the hybrid feature-level fusion model was suggested by adding TFIDF vectors with contextual embeddings were obtained using AraBERT. Experimental findings indicate that the traditional linear models are still very competitive whereby Linear SVM has an accuracy of 95.57 percent. The fine-tuned AraBERT obtained an accuracy of 91.6%, which puts lexical features in structured news datasets in the spotlight as still significant. The hybrid model with the highest performance in the proposed structure was 96.03% accurate and 96.02% Macro-F1 score, which shows that combining lexical statistical cues and contextual embeddings is complementary. These results show that hybrid lexical-contextual representations offer a powerful, computationally effective solution to Arabic news classification. The analysis offers reproducible experimental environments and intricate statistical investigation, to add the empirical data regarding the interaction between classical and deep methods of learning Arabic NLP.
Arabic language, due to its complex morphology and richness of grammar features poses significant challenges in natural language processing (NLP). In this paper, we propose a two-stage deep learning pipeline that combines Arabic text stemming and morphological classification within a single deep learning architecture. The relationship between morphological reduction and grammatical categorization is exploited by combining character-level sequence processing with transformer-based classification. A bidirectional long short-term memory (Bi-LSTM) model is employed for Arabic stem extraction to build a sequence-to-sequence (seq2seq) stemming model named Char Stemmer. To evaluate the proposed model, a gold standard dataset consisting of 260,000 traditional Arabic words extracted from Quranic words and classical Arabic books is utilized. This dataset contains a wide range of challenging word structures suitable for robust evaluation. The Char Stemmer achieved an accuracy of 93.88% on the stemming task. The proposed model obtained 93.88% accuracy, demonstrating a 38% improvement over the best traditional stemmer, P-Stemmer. Beyond stemming, the impact of stemmers on subsequent tasks is evaluated, particularly Arabic word classification. Words are categorized into three morphological classes: noun, verb, and particle. Experimental results show that the proposed system achieved macro average precision, recall, and F1-score of 0.91, 0.89, and 0.90, respectively, with an overall classification accuracy of approximately 99%.
Azal Alaswaad, B. Minaei-Bidgoli· Bulletin of Electrical Engin...· 0 citations
A hybrid architecture that combines a Transformer-based DistilBERT model with a Graph Convolutional Network (GCN) that enhances detection by modeling structural relationships within text data is proposed.
This study integrates parallel multi-kernel word-level convolutional features into conventional and hybrid deep learning models for Arabic text analysis tasks, providing a systematic within-study assessment of model sensitivity to architecture, preprocessing, and learning-rate selection.
Ahmed I.Taloba, George Samy Rady, Khaled F. Hussain· International Journal of Adv...· 0 citations
Arabic Speech Recognition (ASR) faces compounded challenges due to rich dialectal variation, morphological complexity, and data scarcity. While self-supervised speech models such as HuBERT excel in acoustic representation, they lack the deep linguistic reasoning needed to resolve ambiguities unique to Arabic. Large Language Models (LLMs) offer complementary grammatical and semantic knowledge, yet their role in systematic, real-time Arabic ASR error correction remains underexplored. In this work, we propose a novel two-stage framework for accurate and efficient Arabic ASR enhancement. First, we fine-tune a HuBERT model on the Common Voice Arabic corpus, establishing a baseline word error rate (WER) of 19.3%. Second, we introduce Distribution-Aware In-Context Learning (DA-ICL), a prompting strategy that supplies the Arabic LLM Aya-23-8B with a curated set of few-shot examples derived from a systematic taxonomy of ASR error types, including phonetic confusions and morpho-orthographic errors. DA-ICL enables precise, structurally faithful corrections, reducing WER to 9.6% without undesirable sentence rephrasing. To address domain shift and catastrophic forgetting, we further apply Low-Rank Adaptation (LoRA) to adapt a pre-trained HuBERT model to new domains parameter-efficiently. This approach reduces out-of-domain WER from 67% to 24% while preserving in-domain performance, demonstrating improved generalization without full fine-tuning. Our results confirm that combining HuBERT-based acoustic modeling with LLM-based DA-ICL correction and LoRA-efficient adaptation yields a robust, accurate, and scalable solution for Arabic ASR, effectively bridging the gap between acoustic signal and linguistic knowledge. Our framework achieves a WER of 9.6% on Common Voice Arabic, significantly outperforming Whisper-large (47.49% zero-shot, 37.89% with LoRA fine-tuning) and demonstrating the effectiveness of our linguistically-aware approach for Arabic speech recognition.
Rima Sbih, Assef Jafar, A. Kazem· IEEE Access· 0 citations
This paper introduces MAAD, a high-quality, carefully constructed and curated by the authors large-scale Arabic dataset for abstractive news summarisation. The authors selected a high-quality subset of 50,000 articles from the dataset Original, which contains 602,792 articles. To maintain the quality, diversity, and training suitability of the subset, the subset underwent a multi-stage preprocessing pipeline involving noise removal, duplicate filtering, linguistic normalisation, and expert validation. The experimental evaluation was executed in two phases. In the first phase, three transformer-based models (ArabicT5, AraBART, and mT5) were evaluated on a controlled subset of 1,110 articles to establish fair baseline comparisons among models, where ArabicT5 achieved the best performance (ROUGE-1: 23.64, ROUGE-2: 11.82, ROUGE-L: 22.10). In the second phase, ArabicT5-base was trained on all 50,000 articles to evaluate scalability, achieving substantially improved results of 68.4, 52.3, and 64.1, respectively, with a BLEU score of 58.7. The findings emphasise the significance of scale, effective preprocessing, and the benefits of Arabic-specific pretraining on the quality of summarisation. Moreover, a human evaluation on 500 randomly sampled instances verified fluency and adequacy scores of 4.86 and 4.35, respectively, with a strong inter-annotator agreement (Cohen's Kappa: 0.78 and 0.74). Overall, the findings indicate that MAAD is a reliable and scalable dataset with strong potential to serve as a benchmark for Arabic abstractive summarisation and to support the development of robust transformer-based models.
M. Al-Nahari, Ayedh abdulaziz Mohsen, Nada Abdu Al-Humidi et al.· 2026 6th International Confe...· 0 citations