Skip to content
Open access

Monolingual anchoring for low-resource cross-lingual semantic alignment: A case study on uyghur

Aug 2026 · Journal of King Saud University: Computer and Information Sciences · Vol 38 · 0 citations · 32 references

TL;DR

Results provide evidence for the effectiveness of MACA in the evaluated Uyghur setting and suggest that monolingual anchoring may be further explored for related low-resource languages, such as Kazakh, Kyrgyz, and Uzbek.

Abstract

Low-resource languages remain challenging for cross-lingual semantic alignment because of limited parallel corpora. In addition, conventional symmetric alignment may distort the semantic space of a high-resource language through noisy low-resource updates. To address this issue, we propose Monolingual Anchoring for Cross-Lingual Semantic Alignment (MACA), focusing on Uyghur as a low-resource case study. MACA follows an asymmetric paradigm that treats the high-resource language as a fixed semantic anchor and transfers its semantic structure to the Uyghur side. The method consists of three components: (1) Anchored Embedding Initialization for newly introduced Uyghur subwords, (2) Cross-Lingual Neighborhood Anchoring for structural alignment between Uyghur and the anchor language, and (3) Monolingual Structure Anchoring for improving the internal semantic organization of Uyghur representations. Experiments centered on Uyghur-Chinese show that MACA outperforms LaBSE, the strongest off-the-shelf multilingual baseline in our comparison, by 7.67 points on cross-lingual STS. In an exploratory Uyghur-English zero-shot setting, MACA also surpasses LaBSE by 2.45 points without using Uyghur-English training data. These results provide evidence for the effectiveness of MACA in the evaluated Uyghur setting and suggest that monolingual anchoring may be further explored for related low-resource languages, such as Kazakh, Kyrgyz, and Uzbek.

Read PDF

Similar papers

Open access

Multilingual and cross-lingual machine reading comprehension in few-resource settings: synthetic data, cross-lingual transfer, and domain-specific evaluation

(English) Machine Reading Comprehension (MRC) is a fundamental benchmark for evaluating natural language understanding systems, requiring models to generate answers grounded in context. Despite advances with transformer-based architectures and large language models (LLMs), challenges persist in multilingual and cross-l...

C. Carrino · 0 citations
#natural language process... Preprint Sep 2026

Cross-Lingual Representation Alignment by Token-Level Optimal Transport in a Language-Agnostic Space

This work proposes CAROT (Cross-Lingual Alignment of Representations in a Language-Agnostic Space via Optimal Transport), which consists of identifying language-specific representations in LLMs'internal states and aligning language-agnostic representations across languages at the token level by optimal transport, while...

Taisei Yamamoto, Ryoma Kumon, Danushka Bollegala et al. · 0 citations
Preprint Aug 2026

OmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignment

Surprisingly, later-stage supervised fine-tuning on short texts further improves alignment quality while retaining the long-context understanding acquired in earlier training, keeping the model robust on long-text word alignment.

Mengpeng Yang, Jingxu Yang, Chao Chen et al. · 1 citation

Code-Switch Pretraining for Improved Cross-Lingual Alignment in Low-Resource Languages

This work proposes an approach that integrates code-switching directly into masked language model pretraining, and introduces a multiview probabilistic translation strategy that samples candidate translations based on alignment likelihoods, applying substitutions only to unmasked tokens.

Ruan Visser, Trienko L. Grobler, Marcel Dunaiski · 0 citations
Preprint Aug 2026

Cross-Lingual Alignment Without Joint Training: Do Monolingual Language Models Converge on Universal Representations?

It is confirmed that cross-lingual alignment can emerge from the structure of language and the information it carries rather than from joint training, and this points to practical future directions including model stitching, merging, and modular multilingual systems built from monolingual components.

Ej Zhou, Suchir Salhan, Catherine Arnett et al. · 1 citation
Open access 2026

Every Word Presented in Context: Syntactic Coverage as Objective for Low-Resource Machine Translation with Large Language Models

Fragment-Shot Prompting is introduced, a novel few-shot prompting method that aims to retrieve examples for every word occurring in the sentence to be translated, illustrating their use and meaning in context.

Samuel Frontull, Thomas Ströhle · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.