Skip to content

Choosing the Right Language Mode at Inference Time for Multilingual Reliability

Sep 2026 · Conference on Empirical Methods in Natural Language Processing · Vol abs/2609.04653, pp. 1821-1839 · 0 citations · 29 references
Computer Science

TL;DR

Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that performs Expected Calibration Error-aware routing and prompt fusion, and uses a mid-layer Risk Index to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy, is addressed.

Abstract

Multilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: How much translation is needed for multilingual large language models to reason reliably, and when does more translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we run extensive experiments varying text scope and language mode (target-only, English-only, bilingual) to evaluate both accuracy and reliability. Our results reveal a clear trade-off: English context often improve understanding and recover errors caused by non-English comprehension, yet adding redundant bilingual context intensifies interference. We address this trade-off with Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs Expected Calibration Error (ECE)-aware routing and prompt fusion, and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy. Across two model families, RAAI enhances accuracy by 25-37.7% on low-resource languages and lowers calibration error by approximately 3-6%, with the most pronounced benefits in the lowest-resource language tiers.

Read PDF

Similar papers

#natural language process... Conference Open access Sep 2026

Assessing the Impact of Language Disparity on Multilingual Linguistic Ability in Large Language Models

Claims about the grammatical competence of multilingual language models vary sharply with how competence is measured, yet the interaction between evaluation paradigm, post-training, and language resource availability has not been systematically examined. We evaluate base and post-trained models from six families on Mul...

Zhan-Yu Chen, Jaap Jumelet · 0 citations

What Does Post-Training Change in Multilingual Reasoning?

These stages establish a constructive post-training path from English-pivoted capability to multilingual reasoning that is reliably delivered, and jointly track correctness, language adherence, termination, and delivery efficiency.

Hong-Yang Li, Xiao Li, Caesar Wu et al. · 0 citations
#natural language process... Preprint Nov 2026

Language Defaults Before Content: A Causal Layer Map of Multilingual Generation

Multilingual generation requires large language models (LLMs) to determine both what to say and in what language to say it, yet these two commitments are difficult to disentangle from model outputs alone. We use translation as a controlled probe: for multi-parallel segments that a model translates well in one language...

Shen-Bin Qian, Yves Scherrer · 0 citations
#artificial intelligence Open access Oct 2026

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...

HyeonSeok Lim, Seung-Woo Song, Inho Won et al. · 0 citations
Conference Open access Sep 2026

A Scalable Multilingual Query Response Model Using LLaMA 3.2-Based Language Translation and Agentic Retrieval-Augmented Generation

Modern Question-Answering (QA) systems rely on Large Language Models (LLMs), the inference latency of which can vary substantially with input complexity. Although previous work has explored end-to-end throughput and model size tradeoffs, little attention has been paid to the precise relationship between the linguistic...

R. Sheeba, L. Gladence · 0 citations
Open access 2026

Fully Unsupervised Cross-Lingual Capabilities Enhancement Based on Language-Specific Neurons

Multilingual large language models have shown impressive capabilities in different aspects, but suffer from the performance gaps between dominant languages and low-resource languages. Although fine-tuning methods can be effective solutions, they require high-quality parallel data and substantial computation. To tackle...

Qi-Hang Sun, Zhong-Xuan Liu, Hai-Long Cao et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.