Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Open access Nov 2026

BlindToChange: AI Agents Can Find Changes When Asked But Do They Look When Needed?

Given that AI agents can search the web broadly and deeply in real time, it is tempting to conclude that their outputs account for recent world events. We show that this conclusion does not hold in practice. While agents can search and easily find recent changes, the correctness of their responses depends on whether th...

Anirudh Phukan, Tanya Goyal, Danish Pruthi · 0 citations
#artificial intelligence Preprint Open access Nov 2026

SparseGDN: Chunk Sparse in Linear Attention

Gated Delta Networks (GDNs) offer linear-time sequence modeling, yet long-context prefill remains costly due to dense intra-chunk computation, recurrent-state updates, and intermediate state storage. We introduce SparseGDN, a hardware-aware framework that combines structured intra-chunk approximation with input-depende...

Jiedong Zhuang, Peng Zhao, Jialin Tang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

ProSearch: Benchmarking Multi-Constraint Protocol Retrieval in Experimental Science

Structured diagnostic analysis shows that explicit constraint matching provides a strong ranking signal, while manual error analysis identifies joint constraint binding as a key bottleneck, and ProSearch provides a testbed for systematically evaluating scientific retrieval systems.

Wen-Liang Liang, Zhi-Yuan Ning, Hao-Lin Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

In-Model Context Compression with Agentic Soft Tokens for Long-Horizon LLM Agents

This paper introduces Agentic Soft-Token Compression (ASTC), a training-free compression method using soft tokens within LLM agent for long-horizon tasks that matches or exceeds the uncompressed agent's accuracy with up to 50.68% fewer end-to-end Attention Pairs.

Xu-Ning He, Kai-Hsiang Fan, Run-Yu Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Context as Infrastructure: Knowledge Compilation for Retrieval in Agentic Systems with Harnesses

Retrieval-augmented generation is becoming agentic. A search harness writes queries, reads results, reformulates, and decides when to stop. This largely solves accuracy: a harness with only BM25/grep and MiniMax M3 answers 85% of BrowseComp-Plus and 91% on multi-hop FRAMES in our runs, without compiled or vector indexe...

Zhi-Chang Yu, Bai-Ning Cao, S. Idriss et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Lineage Is Memory: Parent Inheritance and Feedback Disclosure in Short-Budget LLM-Guided Optimization

Iterative language-model optimizers refine prompts and programs by evaluating a candidate, showing a proposer model a sample of failing cases, and keeping revisions that improve performance. Recent work attributes the limits of this loop to narrow single-round reflection, introducing full-set error clustering, targeted...

Shanglin Yang, Zhan Shi · 0 citations
#artificial intelligence Preprint Open access Nov 2026

MUON-RT Reusing the Teacher's Trajectory for Momentum-Free Muon for LLM Self-Distillation

Self-distillation methods for large language models with an exponential moving average (EMA) teacher already retain a history of student updates. Muon nevertheless stores a separate momentum buffer, increasing persistent training memory. We propose Muon with Reused Teacher (Muon-RT), which reuses the teacher-student di...

Aryan Das, Vinay Kumar Verma, Aakansha Mishra · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Kernel-based Interpolatory Methods for Context Compression of Attention Mechanisms

The bottleneck of attention mechanisms, which are the fundamental building block of modern language models, is their quadratic complexity in terms of context size. There has thus been an increasing interest in the compression of the context, also called KV-cache compression. In this article, we consider the problem of...

Michel Fabrice Serret, Laura Grigori · 0 citations
#artificial intelligence Preprint Open access Nov 2026

The Generative Gap Between Speculative Drafter and Continuous Diffusion Language Model

Continuous diffusion language models (CDLMs) and speculative drafters offer efficient language generation but are typically evaluated differently: CDLMs generate independently through iterative refinement, whereas drafters propose text for target-model verification and correction. We compare their architectures without...

Yujian Chen, Hao Jiang, Guang Cheng et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement

Recursive self-improvement (RSI) enables large language models to advance their capabilities through successive updates, but these updates can also introduce new risks and weaken existing safeguards. In line with the AI-45{\deg} Law, we pursue Safety RSI, in which safety develops as an intrinsic capability alongside ge...

Jingnan Zheng, Cheng Jin, Ming Zhang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.