Sep 2026· Conference on Empirical Methods in Natural Language Processing· Vol abs/2609.04653, pp. 1821-1839· 0 citations· 29 references
Computer Science
TL;DR
Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that performs Expected Calibration Error-aware routing and prompt fusion, and uses a mid-layer Risk Index to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy, is addressed.
Abstract
Multilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: How much translation is needed for multilingual large language models to reason reliably, and when does more translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we run extensive experiments varying text scope and language mode (target-only, English-only, bilingual) to evaluate both accuracy and reliability. Our results reveal a clear trade-off: English context often improve understanding and recover errors caused by non-English comprehension, yet adding redundant bilingual context intensifies interference. We address this trade-off with Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs Expected Calibration Error (ECE)-aware routing and prompt fusion, and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy. Across two model families, RAAI enhances accuracy by 25-37.7% on low-resource languages and lowers calibration error by approximately 3-6%, with the most pronounced benefits in the lowest-resource language tiers.
Claims about the grammatical competence of multilingual language models vary sharply with how competence is measured, yet the interaction between evaluation paradigm, post-training, and language resource availability has not been systematically examined. We evaluate base and post-trained models from six families on Mul...
Zhan-Yu Chen, Jaap Jumelet· Proceedings of the 2026 Conf...· 0 citations
These stages establish a constructive post-training path from English-pivoted capability to multilingual reasoning that is reliably delivered, and jointly track correctness, language adherence, termination, and delivery efficiency.
Hong-Yang Li, Xiao Li, Caesar Wu et al.· arXiv.org· 0 citations
Multilingual generation requires large language models (LLMs) to determine both what to say and in what language to say it, yet these two commitments are difficult to disentangle from model outputs alone. We use translation as a controlled probe: for multi-parallel segments that a model translates well in one language...
Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...
HyeonSeok Lim, Seung-Woo Song, Inho Won et al.· Conference on Empirical Meth...· 0 citations
Modern Question-Answering (QA) systems rely on Large Language Models (LLMs), the inference latency of which can vary substantially with input complexity. Although previous work has explored end-to-end throughput and model size tradeoffs, little attention has been paid to the precise relationship between the linguistic...
R. Sheeba, L. Gladence· 2026 International Conferenc...· 0 citations
Multilingual large language models have shown impressive capabilities in different aspects, but suffer from the performance gaps between dominant languages and low-resource languages. Although fine-tuning methods can be effective solutions, they require high-quality parallel data and substantial computation. To tackle...
Qi-Hang Sun, Zhong-Xuan Liu, Hai-Long Cao et al.· IEEE Transactions on Audio,...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
Senior Research Scientist Jim Glass discusses how his MIT-IBM Computing Research Lab collaboration connects perception and language, and addresses the shortcoming of current models.
MIT News · Artificial Intelligence· news.mit.eduNov 19, 2026
An MIT and Dana-Farber Institute-led team used large language models to examine nearly 4,000 studies and hundreds of code repositories, revealing gaps in the information needed to scrutinize and reuse published research.
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.