Skip to content

Evaluating Trustworthy Multilingual Alignment in LLMs via Synthetic Natural Language Inference

Unknown authors
· 0 citations · 22 references

TL;DR

A controlled evaluation framework for multilingual natural language inference that stress-tests semantic consistency using synthetic logic-based premise–hypothesis pairs in both monolingual and code-switched conditions is presented.

View source

Similar papers

#natural language process... Open access Sep 2026

Choosing the Right Language Mode at Inference Time for Multilingual Reliability

Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that performs Expected Calibration Error-aware routing and prompt fusion, and uses a mid-layer Risk Index to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy, is addr...

Ekata Mitra, Ameeta Agrawal · 0 citations

Output Language Confusion under Multilingual Prompt Contamination

Standard factual benchmarks assume clean monolingual prompts and exact-match scoring, two assumptions that break simultaneously in real-world multilingual deployment, from retrieval-augmented generation pipelines returning mixed-language passages to users pasting multilingual web content. We introduce Multilingual Dist...

Riju Marwah, Ritvik Garimella, Khusham Bansal et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Systematic Evaluation of Cross-Lingual Consistency Enhancement Methods in Multilingual Language Models

This work presents a unified evaluation of representative CLC-enhancement methods for question answering, spanning inference-time interventions and post-training approaches across three model families and three closed-form benchmarks, highlighting the need to evaluate CLC enhancement for both cross-domain robustness an...

Jirui Qi, Ming-Yang Wang, Hinrich Schütze et al. · 0 citations
Conference Open access Aug 2026

Language as a Hidden Variable: Measuring Behavioral Divergence in Multilingual Large Language Models

Multilingual large language models (LLMs) are widely assumed to behave consistently regardless of the language in which a prompt is expressed. We challenge this assumption through a controlled empirical study in which language itself is isolated as the sole independent variable. We present 30 semantically equivalent pr...

Aman Chandra H, Sameer Kulkarni, S. Nithin et al. · 0 citations
#machine learning Preprint Sep 2026

Evaluation of Contextual Understanding in Large Language Models

A novel knowledge graph-based evaluation framework is proposed introducing Semantic Structural Similarity for KGs (S3KG), a hybrid similarity measure integrating structural and semantic similarity into a continuous evaluation score, alongside a diagnostic framework for categorizing reasoning errors.

Subavarshana Arumugam, Mamta Nallaretnam, K. Wickramasinghe et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.