Skip to content

Category

natural language processing

9,261 papers

#machine learning Preprint Oct 2026

Can Language Models Learn While They Think? Testing Gradient Adaptation Across Architectures

Letting a language model take gradient steps on the text it is reading, known as dynamic evaluation, lowers its loss on the rest of the document. Its behaviour on hybrid linear-attention architectures, on diffusion language models, and on standard long-context benchmarks has not been measured. We measure it. With one S...

Surya Saka · 0 citations
#artificial intelligence Preprint Oct 2026

Evolving to Match Capabilities: Improving Harness Self-Evolution via Skill Adaptation

Harness self-evolution offers a practical route for LLM agents to improve from execution experience without updating model parameters. Its effectiveness depends on whether models can successfully act on the guidance provided by their harnesses. However, we find that harness benefits are not uniform across model capabil...

Zhi-Hao Yang, Haojin Wang, Jun-Cheng Wu et al. · 0 citations
#natural language process... Preprint Oct 2026

Veracity labels flip the emotional tone of language models but leave racial disparities intact

Large language models (LLMs) increasingly deliver information through personas, but it is unclear whether correcting the facts also makes their framing consistent across identity labels. We audited four LLMs (GPT-5.4 mini, NVIDIA Nemotron 3 Nano, Llama 4 Scout, and Claude Haiku 4.5), which rated simulated affect on six...

Nouar Aldahoul, M. J. Tan, Yasir Zaki · 0 citations
#artificial intelligence Preprint Oct 2026

UMAS: System-Level Uncertainty Quantification for Multi-Agent LLM Systems

Multi-Agent Systems (MAS) are a promising paradigm for improving the reasoning capabilities of large language models, yet they remain prone to hallucinations and erroneous outputs. Uncertainty Quantification (UQ) is crucial for assessing system reliability, but existing methods are largely designed for single-agent set...

Han Li, Jinhao Duan, Xiao-Shuang Shi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

When Agents Collude: Weak-to-Strong On-Policy Distillation for Mitigating Strategic Deception in Multi-Agent Systems

While recent advances in autonomous agents enable them to coordinate on increasingly complex tasks, prior work shows that this growing capacity for coordination can create safety risks, including collusion, in which agents jointly pursue misaligned actions while concealing the true basis of those actions from oversight...

Eric Onyame, Runtao Zhou, Kowshik Thopalli et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TIAgent: From Natural Language to Grounded Agentic Workflows for Computational Pathology

Computational pathology (CPath) analyses increasingly depend on multi-step computational workflows that require substantial programming expertise, limiting their accessibility to pathologists and other domain experts without extensive coding experience. Although large language models (LLMs) provide a promising natural-...

Aakash Madhav Rao, Mark Eastwood, Danielle Belgrave et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

LLM-as-a-Judge Version Shift: The Instrument Changed, Not the Standard

Automated research pipelines increasingly rely on fixed LLM judges to rank, filter, and revise proposals, yet these judges are routinely replaced by newer versions. We study whether such replacements preserve the underlying measurement standard. Using a preregistered, frozen-weight design, we evaluate three adjacent sa...

Guijia Zhang, Harry Yang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Skip the Compressor: Coding Agents Fix More Issues When They Pick Whole Files

A coding agent works on repositories that can be far larger than its context window can hold. Prompt compressors and retrievers offer solutions to this problem, but patching an issue needs two things at once: the files that must change, and their code exactly as written, since the model must reproduce the lines it edit...

Xiaocong Yang, Rishit Chatterjee, Himanshu Udupi et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Preserve to Expand: Source-Aware Adaptation and Model Merging for Multilingual LLM-Based ASR

Expanding multilingual ASR systems to new languages is challenging when adaptation must preserve previously supported languages without replaying source-language training data. We study this problem in connector-based Speech LLMs, where a trainable connector maps speech representations into a frozen large language mode...

Yuchen Zhang, Haralambos Mouratidis, Ravi Shekhar · 0 citations
#natural language process... Preprint Oct 2026

Understanding Jev-Style System One Models: Does Structure Reduce Selection Bias?

Selection bias in large language models (LLMs) can persist despite instructions to ignore presentation order or prompts that elicit reasoning. Recent efforts to reproduce Jev-style System One behavior have produced a growing family of models that predict probabilities directly over supplied candidates. Yet systematic c...

Ming-Yang Song, Mao Zheng, Zhi-Yuan Ma et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Learning When to Commit: Schedule Distillation for Fast Diffusion Language Models

Diffusion large language models (dLLMs) can generate multiple tokens in parallel, but often require many decoding rounds to complete a response. Efficient generation depends not only on which tokens are easy to predict, but also on how committing to them helps predict the remaining positions. A highly predictable token...

Aidar Myrzakhan, Zhi-Qiang Shen · 0 citations
#natural language process... Preprint Oct 2026

Quantifying Claim Smoothing by LLM Research Agents

Deep research, or any use of large language models (LLMs) to read a large document collection and produce insights, requires synthesizing information from different sources. In this work, we find that LLMs produce long-form research reports that read as confident syntheses but which fail to accurately reflect the under...

Tiasa Singha Roy, Manya Wadhwa, Greg Durrett · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.