This paper introduces *TranslatePsy-AfriSLM*, a collection of open-source MT resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs.
Abstract
The rapid progress in Artificial Intelligence has largely bypassed African languages, creating a digital divide that limits AI adoption on the continent. Recent open-source LLMs systematically underperform on African language machine translation, while the lack of large-scale, high-quality, open-source parallel data has constrained the development of competitive small language models (SLMs). We introduce TranslatePsy-AfriSLM, a collection of open-source machine translation resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs. Our empirical study shows that unified quality-estimation filtering removes up to 96% of training tokens without degrading quality, and that filtered synthetic data dominates the quality-efficiency Pareto frontier. Fine-tuned on the resulting data mixture, TranslatePsy-AfriSLMs outperform substantially larger systems, including TranslateGemma-27B and Qwen3.5-122B-A10B, with as few as 0.8B parameters.
Neural machine translation (NMT) systems are widely used, but their performance remains strongly dependent on the availability of large-scale digital corpora, making translation for low-resource languages a persistent challenge. In parallel, large language models (LLMs) have recently emerged as a promising paradigm for multilingual text generation and translation; however, their behavior in low-resource settings remains largely underexplored. The challenge becomes even more acute for historical languages. Chagatai, a historical Turkic literary language of Central Asia with no native speakers, unstable orthography, and parallel data, represents an extreme case of such a condition. This study investigates whether transliteration significantly affects translation performance and how LLM-based and NMT-based systems compare under an extremely low-resource setting. To address these questions, we evaluated four source-text configurations (original Arabic script, expert manual transliteration, LLM-based transliteration, and rule-based Uroman transliteration) for translation into six target languages: Kazakh, English, Uzbek, Uyghur, Turkish, Russian, and Arabic. The results show that manual transliteration consistently yields the best translation performance, while noisy automatic romanization reduces these gains. For model comparison, GPT-4o was assessed alongside two fine-tuned NMT baselines, NLLB and TranslateGemma. The findings further show that LLM-based translation can be competitive with, and in some settings outperform, fine-tuned NMT systems, although this advantage comes with lower interpretability. Overall, these findings show that, for extremely low-resource historical languages written in non-Latin scripts, source-side representation is a decisive factor and may be as important as the choice of translation model itself.
A. Mansurova, Meruert Bekmukhamedova, Bekarys Baibolat et al.· Electronics· 0 citations
Machine Translation (MT) systems for low-resource languages are scarce, particularly for
highly divergent languages like Kalabari, a Niger-Congo language of the Ijo family. The
persistent exclusion of these languages from modern language technologies is largely driven
by a lack of parallel corpora, standardized tools, and the massive computational resources
typically required for Neural Machine Translation (NMT). This research addresses this
hardware bottleneck by detailing the end-to-end implementation of a foundational NMT system
built entirely on consumer-grade CPU hardware. To establish this benchmark, a parallel
corpus of 10,222 sentence pairs was manually created from available texts, carefully cleaned,
and tokenized using SentencePiece Byte Pair Encoding (BPE) to mitigate morphological
sparsity. A lightweight Transformer architecture was trained from scratch in OpenNMT-py on
an AMD Ryzen 9 processor with 8GB RAM, utilizing SSD swap space and gradient
accumulation to overcome memory limitations. The system achieved BLEU scores of 15.8
(Kalabari-to-English) and 13.5 (English-to-Kalabari), alongside promising chrF2 scores of
37.2 and 39.7 respectively. For deployment, the model was served on CPU using INT8
quantization via CTranslate2, a standard technique for reducing model size and accelerating
inference on commodity hardware. The results demonstrate a reproducible, CPU-centric
pipeline, proving that the lack of specialized GPU infrastructure is not an insurmountable
obstacle for digital language preservation and baseline NMT development.
O. T. Olise· International Journal of Com...· 0 citations
The rapid evolution of AI-driven language technologies has inadvertently widened the gap between high-resource and marginalised languages. Despite significant progress in AI-driven translation for high-resource languages, low-resource languages remain underrepresented due to limited data, a lack of benchmarks, and evaluation challenges. This study presents a comprehensive systematic review of machine translation for low-resource languages, focusing on advances in neural machine translation (NMT) and large language models (LLMs) between 2017 and 2025. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, 63 studies were selected from the 1696 articles in the Scopus, Web of Science, and Google Scholar databases. The review identifies five dominant methodological approaches: data augmentation, back-translation, transfer learning, pre-training, and parameter-efficient fine-tuning. The findings reveal that model performance is highly dependent on resource availability: transformer-based NMT excels in moderate data settings, while LLMs demonstrate promising zero-shot and few-shot capabilities in extremely low-resource scenarios. Hybrid NMT–LLM approaches emerge as a particularly effective paradigm. The study also highlights critical challenges, including the absence of standardised benchmarks, over-reliance on inadequate evaluation metrics such as Bilingual Evaluation Understudy (BLEU), limited human evaluation, and significant geographic and linguistic underrepresentation. Additionally, ethical concerns related to bias, cultural representation, and community engagement are increasingly relevant. The findings contribute to advancing inclusive and equitable AI-driven language technologies.
Sweet Agrawal, A. Agbeyangi· Technologies· 0 citations
Most endangered languages lack the parallel data required for machine translation, despite the existence of descriptive grammar books. We introduce a pipeline that uses large language models to extract grammatical rules, example sentences, and lexicons from grammar books and generate synthetic parallel corpora for fine-tuning-rather than feeding grammar content into prompts at inference time, as in prior work. Validated on three typologically diverse low-resource languages-Kalamang (Papuan), Tuatschin (Romance), and Mandan (Siouan)-we show that fine-tuning on synthetic data improves over seed-data baselines in 75% of configurations for Kalamang and 59% for Tuatschin, with best-case ChrF++ gains of +8.8, +5.3, and +3.3 respectively. Through a systematic factorial study across 96 configurations varying target part-of-speech, retrieval granularity, and sample volume, we identify which factor combinations drive gains and where they break down. Our results demonstrate that static linguistic documentation can be repurposed for machine translation fine-tuning, offering a practical path towards translation tools for severely under-resourced languages.
V. Ravikumar, Sina Ahmadi, L. Jäger et al.· 0 citations
BERT models have revolutionised Natural Language Processing (NLP) through their ability to process unstructured text across diverse domains. However, developing high-quality BERT models for non-English languages remains challenging due to limited annotated data and high computational demands. Translating non-English data into English and fine-tuning existing English BERT models offers a resource-efficient alternative, yet few studies have structurally compared translation-based fine-tuning with native-language BERT performance across tasks and languages. This study provides such a comparison, evaluating the feasibility of translation-based fine-tuning across six NLP tasks: Sentiment Analysis, Hate Speech Detection, Question Answering, Named Entity Recognition, Part-of-Speech Tagging, and Natural Language Inference, using datasets translated from Bulgarian, Chinese, Dutch, Italian, and Russian. Across all settings, the translation-based approach was comparable or superior in 53.3 percent of cases. Gains were most frequent in Question Answering, Part-of-Speech Tagging, and Natural Language Inference, while performance declines were common in Named Entity Recognition and Hate Speech Detection. The results show that translation-based fine-tuning is most effective for tasks relying on syntactic or structural patterns and for languages typologically close to English, such as Dutch, but less effective for token-level or culturally nuanced tasks, particularly in Chinese. Overall, this study demonstrates that translation-based fine-tuning offers a scalable, resource-efficient, and empirically validated path for extending NLP to low-resource languages while advancing linguistic inclusivity and sustainability in artificial intelligence.
H. Muizelaar, Giulia Rivetti, Marco Spruit et al.· 0 citations
This systematic review examines recent progress in the pretraining and adaptation of LLMs for Low-Resource Languages (LRLs) and focuses on the ethics in AI practice, the development of corpora through communities, and interdisciplinary research collaboration among computational linguists, social scientists, and digital humanists.
Ismail Hossain, Mridul Banik, Fahmid Al Farid et al.· Computer Modeling in Enginee...· 0 citations
What if pathology foundation models could do more with less? GigaPath-Flash and GigaTIME-Flash cut computational demands while maintaining strong performance, opening the door to larger studies and broader exploration. The post GigaPath-Flash and GigaTIME-Flash: Toward population-scale discovery with efficient pathology foundation models appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduAug 31, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.