A hybrid architecture that combines a Transformer-based DistilBERT model with a Graph Convolutional Network (GCN) that enhances detection by modeling structural relationships within text data is proposed.
Abstract
Detecting AI-generated text has become a critical task as artificial intelligence systems are increasingly used in content creation. Current detection methods often suffer from limited accuracy and weak multilingual performance. This problem is especially challenging in Turkish, Arabic, and English due to their distinct linguistic structures, including agglutinative morphology in Turkish, root-based morphology in Arabic, and semantic ambiguity in English. To address these challenges, this study proposes a hybrid architecture that combines a Transformer-based DistilBERT model with a Graph Convolutional Network (GCN). While DistilBERT captures rich contextual and semantic information, GCN enhances detection by modeling structural relationships within text data. The proposed model is evaluated against other well-known approaches. Experimental results show that the hybrid DistilBERTGCN framework achieves high detection accuracy, reaching 99% for English and 98% for Turkish and Arabic. In addition, this study introduces new multilingual datasets, contributing to the advancement of the literature research.
Arabic language, due to its complex morphology and richness of grammar features poses significant challenges in natural language processing (NLP). In this paper, we propose a two-stage deep learning pipeline that combines Arabic text stemming and morphological classification within a single deep learning architecture. The relationship between morphological reduction and grammatical categorization is exploited by combining character-level sequence processing with transformer-based classification. A bidirectional long short-term memory (Bi-LSTM) model is employed for Arabic stem extraction to build a sequence-to-sequence (seq2seq) stemming model named Char Stemmer. To evaluate the proposed model, a gold standard dataset consisting of 260,000 traditional Arabic words extracted from Quranic words and classical Arabic books is utilized. This dataset contains a wide range of challenging word structures suitable for robust evaluation. The Char Stemmer achieved an accuracy of 93.88% on the stemming task. The proposed model obtained 93.88% accuracy, demonstrating a 38% improvement over the best traditional stemmer, P-Stemmer. Beyond stemming, the impact of stemmers on subsequent tasks is evaluated, particularly Arabic word classification. Words are categorized into three morphological classes: noun, verb, and particle. Experimental results show that the proposed system achieved macro average precision, recall, and F1-score of 0.91, 0.89, and 0.90, respectively, with an overall classification accuracy of approximately 99%.
Azal Alaswaad, B. Minaei-Bidgoli· Bulletin of Electrical Engin...· 0 citations
This study integrates parallel multi-kernel word-level convolutional features into conventional and hybrid deep learning models for Arabic text analysis tasks, providing a systematic within-study assessment of model sensitivity to architecture, preprocessing, and learning-rate selection.
Ahmed I.Taloba, George Samy Rady, Khaled F. Hussain· International Journal of Adv...· 0 citations
The rapid advancement of generative Artificial Intelligence (AI) presents challenges to academic integrity due to potential misuse like plagiarism. This study develops a text detection system specifically for the Indonesian language using a Deep Learning approach with a Bidirectional Long Short-Term Memory (Bi-LSTM) architecture. The research methodology follows the Cross-Industry Standard Process for Data Mining (CRISP-DM) framework. A dataset comprising 5,008 text rows was compiled via web scraping from journalism platforms and academic journals indexed in SINTA 4 for human-written texts, while AI-generated counterparts were engineered using ChatGPT and Google Gemini paraphrases. Text features were extracted using a Keras Tokenizer and Embedding Layer with 64 dimensions. Evaluation of the trained Bi-LSTM model on a 30% validation split demonstrated an overall accuracy of 78.24% and a Mean Absolute Error (MAE) of 0.3295. Specifically, the model achieved a 93.77% success rate in identifying human-written texts, though it logged a lower detection rate of 62.62% for academic AI text structures. The final model was successfully deployed as a web application using Streamlit.
Rafil Moehamad Alif, Syariful Alam, Chandra Dewi Lestari· Jurnal Teknologi Informatika...· 0 citations
The findings underscore the potential of advanced NLP techniques to overcome language-specific challenges, providing a foundation for future research in multilingual plagiarism detection and enhancing the development of tools for other languages facing similar challenges.
Hanan Mohammed Fawzy, Ahmad Salah, Heba El-Fiqi et al.· Informatica· 0 citations
Readability assessment for Arabic remains challenging due to the language's complex morphology. This paper presents a comparative study benchmarking traditional Machine Learning (ML), advanced Deep Learning (DL), and finetuned Large Language Models (LLMs). Utilizing a dataset of 4,519 Arabic sentences categorized into three proficiency levels, we evaluate models across accuracy and computational efficiency. Our results demonstrate that a hybrid CNN-BiLSTM architecture utilizing AraVec (Word2Vec) embeddings achieves a peak accuracy of 96.68%, outperforming fine-tuned LLMs like Llama3.2-1B (94.69%). We provide empirical evidence of the prohibitive resource demands in LLMs, which required significantly higher training times (14,697s) compared to specialized DL models (162.98). These findings suggest that for discrete Arabic text classification, tailored DL architectures provide a superior balance of precision and resource efficiency.
Mohamed-Amine Ouassil, Rabia Rachidi, Othmane Daanouni et al.· IEEE International Conferenc...· 0 citations