Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Open access Oct 2026

Learning Mental Models From Unreliable Evidence

Children expertly construct mental models under uncertainty despite limited world knowledge. Which computational principles make this possible? We study this question in an interactive physical Box Task in which participants infer a latent cause through interaction with a stochastic and partially observed environment....

Jeffrey Qin, Zhuangfei Gao, Wasu Top Piriyakulkij et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learning to Model Optimization Problems from Solver Outcomes

Automating optimization modeling with LLMs is a promising path toward scalable decision intelligence, but existing approaches either rely on agentic pipelines built on closed-source LLMs with high inference latency or fine-tune smaller LLMs using costly process supervision that often overfits to a single solver API. We...

Runda Guan, Xiangqing Shen, Jiajun Zhang et al. · 0 citations
#artificial intelligence Open access Oct 2026

Sandwich Reasoning: An Answer-Reasoning-Answer Approach for Low-Latency Query Correction

Query correction is a critical entry point in modern search pipelines, demanding high accuracy strictly within real-time latency constraints. Chain-of-Thought (CoT) reasoning improves accuracy but incurs prohibitive latency for real-time query correction. A potential solution is to output an answer before reasoning to...

Chen Zhang, Kepu Zhang, Jiatong Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TextSeal2: Distortion-Free LLM Watermarking with Copula Mixing and Memoryless Races

We present TextSeal2, a distortion-free watermark for large language models that keeps its signal under speculative decoding: tokens that replace rejected drafts remain watermarked with the same keys, and the acceptance rate is unchanged. It also preserves output diversity and adds no measurable inference latency. Its...

Tom Sander, Pierre Fernandez, Itai Gat et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

When to Assist and What to Suggest: Joint Gating and Memory-Grounded Hint Generation in One Compact Decoder

Proactive assistants offer short, memory-grounded hints during a conversation, deciding when to assist and what to suggest. Current systems split this between a gate and a larger generator; we evaluate both together on 28,058 decision points. Stage-wise generation scores are oracle-gate ceilings: behind a real gate, en...

A. J. A. Jubayer Talukder, Mohammad Ariful Haque · 0 citations
#artificial intelligence Preprint Open access Oct 2026

How I Aligned Your Model: Scaling Up Multilingual Safety Training with Templates

Safety alignment for Large Language Models is heavily focused on English with limited multilingual representation, particularly damaging low-resource language performance. Related open training datasets are often limited in size or do not follow region-localized harmful topics to broaden the scope of alignment beyond c...

Max Neuwinger, Hanna Yukhymenko, Imanol Schlag · 0 citations
#artificial intelligence Preprint Oct 2026

Scaling Mathematical Proof Supervision from Structured Textbooks

Mathematical supervision for language models is typically flattened into isolated problem-solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning...

You-Qing Fang, Zhouqi Hua, Yin-Hao Tang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Decision and System One models in rheumatology: accuracy and calibration on specialty-training examination questions and diagnostic case vignettes

Objectives: To evaluate the accuracy and calibration of Decision and System One models on rheumatology examination questions and diagnostic vignettes. Methods: Two benchmarks were analysed: 172 rheumatology questions from Spanish specialty-training examinations (expanded RheumaMIR dataset) in Spanish and English, and 7...

Alfredo Madrid-Garc\'ia, Diego Benavent, Fabian Lechner et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Upcycling Language Models for Multiple Specialized Domains

Effective multi-domain adaptation of large language models requires prioritizing relevant domain knowledge while minimizing interference from irrelevant domains. Existing approaches commonly use Low-Rank Adaptation (LoRA) to train a separate adapter for each domain and combine these adapters within one model. However,...

Mingzi Cao, Xi Wang, Nikolaos Aletras · 0 citations
#artificial intelligence Preprint Open access Oct 2026

One Vector or Many? Clustered Optimal-Transport Steering under Quantization

Activation steering changes what a language model generates by editing its hidden states at inference time. Its most common form adds one vector, the difference of class means (DiM), to every hidden state. CHaRS (concept heterogeneity-aware representation steering) uses optimal transport instead: an entropic plan pairs...

Illia Makarov · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Rethinking Pre-pretraining

We report that allocating compute to synthetic pre-pretraining (PPT) never outperforms pure natural-language training in our compute-matched experiments. This holds across four PPT curricula (k-Dyck, neural cellular automata (NCA), declarative reference corpora, and code) and three training regimes: data-constrained, d...

Alexander Stern, Tim Rockt\"aschel, Acyr Locatelli et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Prompts and probabilities in the linguistic assessment of language models: Evidence from semantic focus-sensitivity

As language models (LMs) have improved, an increasingly common means of evaluating their linguistic competence is through explicit prompting (e.g.,"Which sentence is more acceptable?"). Prior work indicates that such prompting underperforms compared to standard token-probability-based methods in smaller models, but imp...

R. Pasternak · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.