Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Sep 2026

PULSE: Identifying Demonstration-Utility Features with Sparse Autoencoders

This work introduces PULSE (Paired Utility Localization over Sparse Encodings), an SAE-based framework for identifying model-internal features associated with demonstration utility and using them for demonstration selection, and PULSE-Retriever, which converts its magnitude into a feature-relevance mask for scalable po...

Chen-Duo Hao, Chuan-Bao Gao, Ping Zeng et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ForkLeft: Entropy-First Rollouts for Prefix-Aligned Autoregressive-to-Diffusion Distillation

ForkLeft, a distillation framework that resolves a fundamental mismatch between autoregressive teacher predicts from a left prefix and NTP teacher under the same context, is introduced, showing that DLMs can learn NTP-style reasoning without sacrificing native parallel generation.

Jun-Ming Liu, Ji-Cheng Wang, Yifeng He et al. · 1 citation

Clarify the User or Verify the World? Uncertainty Routing for Proactive Agents

This work proposes PROUR, a proactive uncertainty routing framework that decomposes action uncertainty into disagreement across plausible user-goal interpretations, which signals user-side ambiguity, and the entropy remaining within each interpretation, which signals missing world-side evidence.

Zhao-Feng Li, X. Zhang, Xiao Xiao et al. · 0 citations
#artificial intelligence Preprint Sep 2026

EngramRAG: Dynamic Usage-Weighted Topology and Synaptic Consolidation for Multi-Hop Agentic Memory

The proposed EngramRAG is an adaptive memory architecture coupling a low-latency Waking State reflex with an asynchronous background Dreaming State consolidation cycle, and introduces triple-source hybrid retrieval fusing dense vectors, BM25, and U-PPR via dynamic Reciprocal Rank Fusion (RRF).

Bhavyateja Potineni, Lohit Giri, Anupreksha Jain et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Improving Medical Calculation of LLMs with Embedded Coding

Large Language Models (LLMs) perform well on medical examinations and question-answering benchmarks, but remain unreliable on medical calculation tasks that require exact numerical outputs. These calculations support high-stakes decisions such as medication dosing, organ-function assessment, and prognostic scoring, for...

Tianshi Ming, Ying-Ying Zhang, Xian Wu · 0 citations
#artificial intelligence Preprint Sep 2026

Choir: An Open Protocol for Distributed Multi-Agent Autoformalization

Choir is an open protocol for distributed formalization that decomposes a project into tasks that can be completed by independent contributors, each running their own agent with their own LLM subscription, while coordinating entirely through the project's GitHub repository.

Yi-Di Qi, Melanie Weber · 0 citations

IndustryLLM: Failure-Driven LLM Training for Industrial Procurement

This work introduces a failure-driven adaptation recipe spanning continued pre-training (CPT) and supervised fine-tuning (SFT) and formalizes an evidence-gated constraint-evaluation interface enforcing three-valued logic where unverified product evidence remains unknown rather than satisfied.

Liang Ding, Zhiang Xu, Yu-Yang Sheng et al. · 0 citations
#computer vision Nov 2025

Does Understanding Inform Generation in Unified Multimodal Models? From Analysis to Path Forward

UniSandbox, a decoupled evaluation framework paired with controlled, synthetic datasets to avoid data leakage and enable detailed analysis, reveals a significant understanding-generation gap, which is mainly reflected in two key dimensions: reasoning generation and knowledge transfer.

Yu-Wei Niu, Weiyang Jin, Jiaqi Liao et al. · 10 citations
#natural language process... Preprint May 2025

From ASR to ASP: Evaluating Prompt Attack Vulnerabilities Against Open-Source LLMs

This paper comprehensively studies effective prompt injection attacks against 14 widely used open-source and three closed-source LLMs on five attack benchmarks and proposes a straightforward and effective hypnotism attack, showing that this attack causes aligned language models to generate objectionable behaviors.

Jia-Wen Wang, Pritha Gupta, E. Hüllermeier et al. · 9 citations
#natural language process... Preprint Open access Sep 2026

Generating Legal Commentaries from Case Databases via Retrieval, Clustering, and Generation

We present a fully automated pipeline that transforms large collections of court decisions into legal commentaries for statutes - without providing any handcrafted doctrinal framework. Using 4.555 decisions of the German Federal Court of Justice that cite sections 242, 280, 812 and 823 of the German Civil Code (BGB), w...

Max Prior, Niklas Wais, Matthias Grabmair · 0 citations

Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs

Direct Preference Optimization (DPO) is applied to align models, constructing preference pairs in which chosen responses preserve mixed-language content while rejected responses mimic failure patterns, suggesting DPO can effectively elicit correct code-switching transcription behavior from multilingual Audio LLMs.

T. N. Quang, Won Cheng Yi Lewis, M. Pham et al. · 2 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.