Aug 2026· 1 citation· ⚡ 1 influential· 60 references
Computer Science
TL;DR
EnSiTa is presented, a trilingual multi-domain parallel dataset and benchmark for English, Sinhala and Tamil, and is the most extensive systematically documented multi-domain parallel data creation and benchmarking effort for low-resource MT.
Abstract
Machine Translation (MT) for low-resource languages remains far behind that of high-resource languages, and the gap is widest in specialised domains, where parallel data is scarce or entirely absent. We present EnSiTa, a trilingual multi-domain parallel dataset and benchmark for English, Sinhala and Tamil. EnSiTa provides human post-edited training data for seven domains, plus manually translated test sets for those and one additional domain, all produced by professional translators under a multi-year, rigorously quality-controlled process. Using this dataset, we conduct an extensive study of domain-specific MT for all six language directions, fine-tuning a from-scratch Transformer, a pre-trained translation model (NLLB-600M), and decoder-only LLMs (Gemma 3 family, 1B-12B, and TranslateGemma) across training-data sizes, model scales, and in-domain, cross-domain, multilingual and multi-domain settings. To the best of our knowledge, this is the most extensive systematically documented multi-domain parallel data creation and benchmarking effort for low-resource MT. Our data and models will be publicly released.
This work focuses on machine translation models for Pacific creoles: Tok Pisin, Bislama, and Solomon Pijin, with particular attention to broad domain performance, and relies on a number of data collection and preparation techniques, including LLM-assisted respelling and alignment, back-translation, and distillation fro...
Raphael Merx, Nick Thieberger, Ekaterina Vylomova· 0 citations
COILD, an Indic-centric parallel corpus comprising over 1.16 million human-translated and human-verified sentence pairs, covers 20 Indian language pairs across the Indo-Aryan, Dravidian, Tibeto-Burman, and Austro-Asiatic language families, and provides a valuable training and evaluation resource for advancing multiling...
Kshetrimayum Boynao Singh, Nitin Kumar Mishra, P. Dutta et al.· arXiv.org· 0 citations
(English) Machine Reading Comprehension (MRC) is a fundamental benchmark for evaluating natural language understanding systems, requiring models to generate answers grounded in context. Despite advances with transformer-based architectures and large language models (LLMs), challenges persist in multilingual and cross-l...
This work introduces the first-of-its-kind English-Assamese parallel corpus for the translation of Indian court judgments and performs a comprehensive evaluation of state-of-the-art multilingual models in both zero-shot and fine-tuned settings, comparing their performance against commercial systems.
Telem Joyson Singh, Hemanta Baruah, Sanasam Ranbir Singh et al.· International Conference on...· 1 citation
This work combines vocabulary surgery for tokenizer adaptation without full retraining, cross-lingual transfer of quality classifiers via translation, enabling filtering without target-language annotations, and generation of instruction data through translation, task conversion, and targeted synthesis.
Yurii Paniv, Bohdan Didenko, Mykola Haltiuk et al.· 4 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
Senior Research Scientist Jim Glass discusses how his MIT-IBM Computing Research Lab collaboration connects perception and language, and addresses the shortcoming of current models.
MIT News · Artificial Intelligence· news.mit.eduNov 19, 2026
An MIT and Dana-Farber Institute-led team used large language models to examine nearly 4,000 studies and hundreds of code repositories, revealing gaps in the information needed to scrutinize and reuse published research.
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.