Skip to content

Category

natural language processing

9,261 papers

#machine learning Preprint Oct 2026

Task-Centric Multimodal Learning for Cognitive Impairment Detection

Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rely on text or voice-based responses, capturing only a limited view of human cognition despite the inherently multimodal nature of human expression. This work proposes a co...

Sankalp Vaish, Rishank Singh, Sumukh Veeramalla et al. · 0 citations
#machine learning Preprint Open access Oct 2026

CogDrift-4D: Hierarchical Multimodal Modeling of Temporal Behavioral Decay for MCI Detection

Early detection of mild cognitive impairment remains a critical bottleneck in dementia care, demanding scalable tools capable of capturing subtle behavioral decay. To capture the subtle temporal changes of cognitive decline, we introduce a behavioral dataset collected across seven unscripted multimodal interactions ove...

Sankalp Vaish, Sumukh Veeramalla, Rishank Singh et al. · 0 citations
#machine learning Preprint Oct 2026

Gibbs-Gap Policy Optimization for Off-Policy RL with Verifiable Rewards

Reinforcement learning with verifiable rewards often trains language models on responses generated by a different, possibly stale behavior policy. Correcting this mismatch with learner-to-behavior importance weights can introduce high variance for long responses. We introduce Gibbs-Gap Policy Optimization (GGPO), which...

Xuan-Chang Zhang, Tong Zhang · 0 citations
#machine learning Preprint Open access Oct 2026

TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory

We introduce TurboMamba, a language-model architecture for faster inference, faster training, and better token prediction. A global Mamba-3 model runs once per completed token block. A small Transformer uses this global context and earlier tokens within the block to predict the next token. Three lightweight additions i...

Hanxin Zhang · 0 citations
#machine learning Preprint Open access Oct 2026

Same Answer, New Box: How Much of RLVR's Out-of-Domain Gain Is Answer Format?

Reinforcement learning with verifiable rewards (RLVR) is credited with gains beyond the domain its rewards check, such as higher MMLU accuracy after training on mathematics. Such accuracies are usually read out of the model's text by an answer extractor. A model that learns to write its answer where the extractor looks...

Zongye Lyu · 0 citations
#artificial intelligence Preprint Jul 2026

Amplitude-Only FFN Intervention for Tool-Structured LLM Inference: Method, Gated Evaluation Protocol, and Cross-Model Empirical Results

An inference-time intervention that masks feed-forward network activation coordinates while keeping pretrained weights fixed provides a task-dependent intervention surface, with causal mechanisms, equal-budget advantages, repeated-run uncertainty, and serving cost still open.

Sheng Xu, Zhen Chen, Jun-Hua Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Symbolic Mechanistic Data Attribution: Tracing Training Influence to Learned Behavioral Policies

While existing data attribution methods can identify which training examples build specific mechanistic circuits, they cannot explain how training data shapes the behavioral decisions a model learns. We introduce Symbolic Mechanistic Data Attribution (SMDA), a framework that attributes training pairs to the interpretab...

Reza Habibi, Darian Lee, Magy Seif El-Nasr · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Signals to Transfer: A Factorised Study of Probe-Based Uncertainty Estimation in Large Language Models

Probe-based uncertainty estimation (UE) has emerged as a prominent approach to detect hallucinations in Large Language Models (LLMs) by learning uncertainty from internal model signals. Yet, recent methods vary simultaneously across feature design, training data construction, and evaluation setting, obscuring what actu...

Ponhvoan Srey, Xiaobao Wu, Cong-Duy Nguyen et al. · 0 citations

Hitting a Moving Target: Test-Time Adaptation for AI Text Detection under Continual Distribution Shift

This work proposes a test-time adaptation (TTA) approach that adapts to distribution shifts by leveraging homogeneity among unlabeled samples observed at inference time and establishes that TTA is a promising framework for AI text detection in the wild.

Ke Ren, Manish Raghavan, Nikhil Garg · 1 citation · ⚡1
#artificial intelligence Preprint Open access Oct 2026

LLMSurgeon: Diagnosing Data Mixture of Large Language Models

The pretraining data mixture of Large Language Models (LLMs) constitutes their "digital DNA", shaping model behaviors, capabilities, and failure modes. Yet this composition is rarely disclosed, making post-hoc auditing of data combination or provenance difficult. In this work, we formalize Data Mixture Surgery (DMS): g...

Yaxin Luo, Jiacheng Cui, Xiaohan Zhao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

Vision-Language-Action Models (VLAs) inherit their visual and linguistic capabilities from Vision-Language Models (VLMs), yet most VLAs are built from off-the-shelf VLMs that are not adapted to the embodied domain, limiting their downstream performance. In this work, we propose EmbodiedMidtrain to bridge the gap betwee...

Yiyang Du, Zhanqiu Guo, Haochen Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Documents to Spans: Span-Centric Learning for LLM-based Explainable Medical Coding

Medical coding, which assigns standardized ICD codes to clinical documents, is a fundamental yet challenging task in modern healthcare. It requires extensive knowledge of a large code space and the ability to identify and interpret sparse supporting evidence in long, noisy clinical documents. Most existing methods rely...

Xu Zhang, Wenxin Ma, Chenxu Wu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.