Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Oct 2026

WEAVE: Weaving Real-World Code Evolution into Dependency-Structured Tasks for Benchmarking and Training Code Agents

Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requests (PRs), requiring coordinated modifications across a repository. Yet most executable repository-level benchmarks retain a single issue or PR as the task unit, while e...

Wei-Hao Li, Zi-Hang Xu, Zhong-Qiu Wang et al. · 0 citations
#computer vision Preprint Open access Oct 2026

Spurious Attention Heads in Vision Transformers: Mechanistic Identification of Annotation-Driven Bias in Medical Chest X-Ray Analysis

Vision Transformers deployed in medical imaging exploit spurious correlations, yet the internal mechanisms remain unidentified and impossible to fix. We apply mechanistic interpretability to locate one such mechanism in ViT-Base 16: a single attention head (L8H10) that functions as a dedicated annotation-reader on ches...

Joshua Muhumuza, Cornelius Kalenzi · 0 citations
#natural language process... Preprint Oct 2026

VoteGEO-Bench: Measuring the Impact of Generative Engine Optimization on Electoral Visibility

Large language models (LLMs) are increasingly used for election information, yet little is known about how external web content shapes the political information they present. Generative engine optimization (GEO) rewrites web content to improve its visibility in generated responses. To investigate its potential risks in...

Shi-Qi Zhang, Xiao-Kui Xiao · 0 citations
#computer vision Preprint Oct 2026

ZoomCap: Evidence-Routed Visual Zooming for Recoverable Visual Information Transfer

Detailed captions transfer visual information into vision-language model supervision, but quality is easily conflated with length: long single-pass outputs still miss small objects, text, and spatial relations or promote uncertain observations into confident claims. We formulate fine-grained captioning as recoverable v...

Hao Shi, Jia-Feng Wang, Yu-Zhuo Fu et al. · 0 citations
#natural language process... Preprint Oct 2026

Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval

Reasoning-conditioned embeddings can improve retrieval by progressively refining semantic constraints. However, additional reasoning may introduce over-generalized or semantically noisy abstractions that weaken retrieval specificity. Existing methods largely supervise reasoning through final retrieval outcomes, providi...

Yingtao Luo, Kang-Yi Zhao, Shi-Yi Du et al. · 0 citations
#computer vision Preprint Oct 2026

VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents

Existing long-document QA benchmarks rarely combine large-scale human-authored questions with detailed visual evidence annotations, limiting diagnosis of evidence localization and interpretation failures. We present VELD-QA, a large-scale benchmark for Visual Evidence grounding and question answering in Long Documents....

Zhivar Sourati, Marianne Menglin Liu, Rong Wang et al. · 0 citations
#computer vision Preprint Open access Oct 2026

MagiC: Evaluating Multimodal Cognition Toward Grounded Visual Reasoning

Recent advances in large vision-language models have led to impressive performance in visual question answering and multimodal reasoning. However, it remains unclear whether these models genuinely perform grounded visual reasoning or rely on superficial patterns and dataset biases. In this work, we introduce MagiC, a c...

Chengfei Wu, Ronald Seoh, Bingxuan Li et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Training Reasoning Models to Generate Diverse Scientific Ideas

One of the first steps of a research pipeline is generating ideas. Large Language Models (LLMs) are increasingly used to automate this step, but most of this work optimizes the quality of individual ideas, while overlooking diversity. In our work, we study document-grounded ideation, focusing on increasing the diversit...

Manya Wadhwa, Pranav Narayanan Venkit, Hiroaki Hayashi et al. · 0 citations
#natural language process... Preprint Oct 2026

MindEval2: Clinically Grounded Patients and Rubrics for Evaluating Language Models in Mental Health Support

With people increasingly turning to AI chatbots for mental health support, the need to evaluate these tools is becoming more pressing. Recent benchmarks attempt to mimic a realistic setting by simulating multi-turn interactions with synthetic patients and evaluating them with an LLM-as-a-judge. However, the usefulness...

John Mendonça, Daniel Tschernutter, José Pombal et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Grid-Bench: Can LLMs Predict How Discrete Worlds Change?

Spatial instructions describe how to move objects, transform regions, or modify their surroundings. When several operations are applied in sequence, each acts on a configuration shaped by earlier changes. How accurately can large language models (LLMs) predict the resulting spatial state? We introduce Grid-Bench, an ex...

Zixiang Xu, Zirui Song, Wanrong Zheng et al. · 0 citations
#natural language process... Preprint Oct 2026

Multi-Target Few-Shot Prompting with Diffusion Language Models

This work introduces multi-target few-shot prompting with diffusion language models, where examples guide the infilling of multiple masked regions within a shared canvas and further leverage selective masking of the canvas to derive a likelihood-ratio reward that favors example-supported infills.

Anton Xue, Alan Li, Rahul Saha · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.