Skip to content
Open access

Democratizing Machine Translation: A CPU-Centric Training Pipeline for Low-Resource Languages (A Kalabari Case Study)

Aug 2026 · International Journal of Computer Science and Mathematical Theory · 0 citations

TL;DR

The results demonstrate a reproducible, CPU-centric pipeline, proving that the lack of specialized GPU infrastructure is not an insurmountable obstacle for digital language preservation and baseline NMT development.

Abstract

Machine Translation (MT) systems for low-resource languages are scarce, particularly for highly divergent languages like Kalabari, a Niger-Congo language of the Ijo family. The persistent exclusion of these languages from modern language technologies is largely driven by a lack of parallel corpora, standardized tools, and the massive computational resources typically required for Neural Machine Translation (NMT). This research addresses this hardware bottleneck by detailing the end-to-end implementation of a foundational NMT system built entirely on consumer-grade CPU hardware. To establish this benchmark, a parallel corpus of 10,222 sentence pairs was manually created from available texts, carefully cleaned, and tokenized using SentencePiece Byte Pair Encoding (BPE) to mitigate morphological sparsity. A lightweight Transformer architecture was trained from scratch in OpenNMT-py on an AMD Ryzen 9 processor with 8GB RAM, utilizing SSD swap space and gradient accumulation to overcome memory limitations. The system achieved BLEU scores of 15.8 (Kalabari-to-English) and 13.5 (English-to-Kalabari), alongside promising chrF2 scores of 37.2 and 39.7 respectively. For deployment, the model was served on CPU using INT8 quantization via CTranslate2, a standard technique for reducing model size and accelerating inference on commodity hardware. The results demonstrate a reproducible, CPU-centric pipeline, proving that the lack of specialized GPU infrastructure is not an insurmountable obstacle for digital language preservation and baseline NMT development.

Read PDF

Similar papers

Open access Jul 2026

Transliteration for Low-Resource Translation in the Age of Large Language Models

The findings show that manual transliteration consistently yields the best translation performance, while noisy automatic romanization reduces these gains, and that LLM-based translation can be competitive with, and in some settings outperform, fine-tuned NMT systems, although this advantage comes with lower interpreta...

A. Mansurova, Meruert Bekmukhamedova, Bekarys Baibolat et al. · 0 citations
Open access Jul 2026

Building ‌a ‌Transformer-Based ‌Neural Machine Translation System for English–Kibajuni Translation: A Low-Resource Deep Learning Approach for Indigenous Language Preservation

The design, construction, and assessment of a compact Transformer-based Neural Machine Translation (NMT) system for English–Kibajuni translation suggest that appropriately scaled Transformer models, paired with subword tokenization and carefully tuned training procedures, can materially advance digital inclusion and la...

A. Ahmed, W. Bana, Mathew M. Egessa et al. · 0 citations

Building a Transformer-Based Neural Machine Translation System for English–Kibajuni Translation: A Low-Resource Deep Learning Approach for Indigenous Language Preservation

The design, construction, and assessment of a compact Transformer-based Neural Machine Translation (NMT) system for English–Kibajuni translation suggest that appropriately scaled Transformer models, paired with subword tokenization and carefully tuned training procedures, can materially advance digital inclusion and la...

A. Ahmed, W. Bana, Mathew M. Egessa et al. · 0 citations
Open access Jul 2026

Development of a Transformer-Based Neural Machine Translation System for English to Ebira Language

It is demonstrated that the application of transfer learning on transformer NMT model significantly improves the quality of (MT) systems; and also provides a foundational step for the development of computational resources for Ebira and supports the broader goal of linguistic inclusivity in artificial intelligence.

Musari Abdulmusawir Tijani, Amina Hassan Abubakar, A. Kana et al. · 0 citations

A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books

A pipeline that uses large language models to extract grammatical rules, example sentences, and lexicons from grammar books and generate synthetic parallel corpora for fine-tuning-rather than feeding grammar content into prompts at inference time, as in prior work is introduced.

V. Ravikumar, Sina Ahmadi, L. Jäger et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.