Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Sep 2026

What are Key Factors for Updates in RL for LLM Reasoning?

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a promising framework for enhancing the reasoning ability of large language models. However, much of the existing work is guided by heuristic intuition, leading to divergent algorithmic choices, even contradictory ones that nevertheless report empiric...

Peidong Wang, Demi Wang, Xufang Luo et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Knowledge-Graph Grounding Helps LLMs Only for Out-of-Training Knowledge: A Controlled Study on Clinical Question Answering

A recent Nature Medicine study reports that general-purpose frontier LLMs outperform specialized retrieval-augmented clinical tools on medical benchmarks, and that retrieval can hurt strong models. We ask the natural follow-up: does structured knowledge-graph (KG) grounding change this, and when does grounding help at...

Madhulatha Mandarapu, Sandeep Kunkunuru · 0 citations
#natural language process... Preprint Open access Sep 2026

Want Better Synthetic Data? Steer It: Activation Steering for Low-Resource Language Generation

Large language models (LLMs) have become an effective tool for synthetic data generation, including for low-resource languages, where generated data can improve downstream task performance. Current best-performing approaches typically rely on few-shot prompting with target-language examples, which increases inference c...

Jan Cegin, Daniil Gurgurov, Yusser Al Ghussin et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

The BD-LSC Dataset: Facilitating the Benchmarking of Models for Lexical Semantic Change Detection in Slang and Standard Usage

Automatic semantic change detection aims to identify how word meanings shift over time, offering insights into both linguistic and societal change. Despite recent progress in computational lexical semantic change (LSC), existing benchmarks and methods struggle to capture bi-directional semantic change, particularly cas...

Afnan Aloraini, Riza Batista-Navarro · 0 citations
#artificial intelligence Preprint Open access Sep 2026

AdaMame: A Training Recipe for Adaptive Multilingual Reasoning

While Large Reasoning Models (LRMs) show strong performance in English, they often fail to reason in the language of the query, a phenomenon known as language collapse. Existing RL-based fixes typically add a binary language fidelity reward to the accuracy objective, yet still incur trade-off in accuracy, mid-trace cod...

Dayeon Ki, Kevin Duh, Marine Carpuat · 0 citations
#natural language process... Preprint Open access Sep 2026

The Harder Text Embedding Benchmark (HTEB): Beyond One-dimensional Static Robustness

Embedding benchmarks like MTEB report a single score per model, implicitly treating robustness as a static, scalar property. We argue that embedding robustness is multidimensional, since models respond differently to different types of variation, and requires dynamic evaluation to expose failures hidden by static bench...

Manuel Frank, Haithem Afli · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learning

While large language models (LLMs) augmented with agentic search capabilities show promise for legal reasoning, they overlook a fundamental constraint that applicable law must match the temporal context of each case, as retroactive application of statutes violates core legal principles and leads to erroneous conclusion...

Wei Fan, Yining Zhou, Mufan Zhang et al. · 0 citations

STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes

STOP (Structured On-policy Pruning), an on-policy algorithm for analyzing and pruning long-form reasoning traces, which improves the structural efficiency of generated reasoning, and reallocates reasoning effort away from redundant verification and backtracking toward more productive exploration.

Chenjun Xu, Zhen-Nan Zhou, Zhan Su et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

Grounded or Guessing? LVLM Confidence Estimation via Blind-Image Contrastive Ranking

Large vision-language models (LVLMs) suffer from visual ungroundedness: they can produce a fluent, confident, and even correct response driven entirely by language priors, with the image contributing nothing to the prediction. Existing confidence estimation methods cannot detect this, as they observe model behavior und...

Reza Khanmohammadi, Erfan Miahi, Simerjot Kaur et al. · 0 citations
#natural language process... Preprint Open access Sep 2026

ReLay: Personalized LLM-Generated Plain-Language Summaries for Better Understanding, but at What Cost?

Plain Language Summaries (PLS) aim to make research accessible to lay readers, but they are typically written in a one-size-fits-all style that ignores differences in readers' information needs and comprehension. In health contexts, this limitation is particularly important because misunderstanding scientific informati...

Joey Chan, Yikun Han, Jingyuan Chen et al. · 0 citations

English is Not All You Need: Systematically Exploring the Role of Multilinguality in LLM Post-Training

A systematic, controlled study of the interplay between training language coverage, model scale, and task domain, based on 220 supervised fine-tuning runs on parallel translated multilingual data mixtures spanning mathematical reasoning and API calling tasks, finds that English-only post-training is typically suboptima...

Mehak Preet Dhaliwal, S. Chaurasia, Yao Qin et al. · 0 citations
#natural language process... Preprint Apr 2026

Confident in a Confidence Score: Investigating the Sensitivity of Confidence Scores to Supervised Fine-Tuning

It is found that calibration shifts substantially after SFT: across 216 configurations, it degrades in 112 cases and improves in 104, with confidence scores shifting due to factors beyond output quality, such as proximity to the training distribution.

Lorenzo Jaime Yu Flores, Cesare Spinoso di-Piano, Jackie C. K. Cheung · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.