Skip to content

Category

natural language processing

9,261 papers

#computer vision Preprint Open access Oct 2026

Prompt-Induced Score Variance in Zero-Shot Binary Vision-Language Safety Classification

Safety pipelines often block content by thresholding a model's first-token unsafe score. We show that a single prompt's score is not a reliable probability and compare two repairs: mean ensemble and calibration with development labels. Across seven vision-language models and two benchmarks, an input's unsafe probabilit...

Charles Weng, Dingwen Li, Alexander Martin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Repetition over Diversity: High-Signal Data Filtering for Sample-Efficient German Language Modeling

Recent research has shown that filtering massive English web corpora into high-quality subsets significantly improves training efficiency. However, for high-resource non-English languages like German, French, or Japanese, aggressive filtering creates a strategic dilemma: should practitioners prioritize diversity by tra...

Ansar Aynetdinov, Patrick Haller, Alan Akbik · 0 citations
#natural language process... Preprint Open access Oct 2026

Why Are Some Emotions Harder for LLMs? Uncovering the Causal Mechanisms of Emotion Inference via Sparse Autoencoders

Large language models (LLMs) are increasingly used in emotionally sensitive human-AI applications, where reliable emotion detection is essential. However, their emotion recognition abilities remain uneven: models often perform well on some emotions while consistently struggling with others. Although recent work has exp...

Bangzhao Shu, Arinjay Singh, Mai ElSherief · 0 citations
#natural language process... Preprint Open access Oct 2026

BERAG: Bayesian Ensemble Retrieval-Augmented Generation for Knowledge-based Visual Question Answering

A common approach to question answering with retrieval-augmented generation (RAG) is to concatenate documents into a single context and pass it to a language model to generate an answer. While simple, this strategy can obscure the contribution of individual documents, making attribution difficult and contributing to th...

Jinghong Chen, Jingbiao Mei, Guangyu Yang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Semantic Needles in Document Haystacks: Sensitivity Testing of LLM-as-a-Judge Similarity Scoring

We propose a scalable, multifactorial experimental framework that systematically probes LLM sensitivity to subtle semantic changes in pairwise document comparison. We analogize this as a needle-in-a-haystack problem: a single semantically altered sentence (the needle) is embedded within surrounding context (the hay), a...

Sinan G. Aksoy, Alexandra A. Sabrio, Erik VonKaenel et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces

The emergence of Large Language Models (LLMs) has illuminated the potential for a general-purpose user simulator. However, existing benchmarks remain constrained to isolated scenarios, narrow action spaces, or synthetic data, failing to capture the holistic nature of authentic human behavior. To bridge this gap, we int...

Jiawei Chen, Ruoxi Xu, Boxi Cao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration

The extension of context windows in Large Language Models is typically facilitated by scaling positional encodings followed by Continued Pre-Training (CPT). While effective, this paradigm is notoriously data-hungry and computationally expensive, requiring massive long-text corpora to recalibrate the model to the shifte...

Ning Yang, Hengyu Zhong, Wentao Wang et al. · 0 citations

ActTail: Global Activation Sparsity in Large Language Models

ActTail is proposed, a TopK magnitude-based activation sparsity method with global activation sparsity allocation grounded in Heavy-Tailed Self-Regularization (HT-SR) theory that improves both perplexity and downstream task performance at high sparsity compared to uniform allocation.

Wen-Wen Hou, Xin-Yuan Song, Wen-Qian Weng et al. · 2 citations
#natural language process... Preprint Open access Oct 2026

The Lexical Imprint of Pre-training Data

How much of zero-shot benchmark accuracy is captured by word-level alignment between a pre-training corpus and the benchmark target? We study this question through word-level unigram cross-entropy (UCE), a tokenizer-agnostic, model-free measure of lexical alignment between a reference corpus and a target benchmark. Lik...

Jeonghoon Kim, Woojin Chung, Woomin Song et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactions

The advancement of Large Language Models (LLMs) has catalyzed the development of autonomous agents capable of navigating complex environments. However, existing evaluations primarily adopt a deductive paradigm, where agents execute tasks based on explicitly provided rules and static goals, often within limited planning...

Fangzhi Xu, Hang Yan, Qiushi Sun et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

DeALOG: Decentralized Multi-Agents Log-Mediated Reasoning Framework

Complex question answering across text, tables and images requires integrating diverse information sources. A framework supporting specialized processing with coordination and interpretability is needed. We introduce DeALOG, a decentralized multi-agent framework for multimodal question answering. It uses specialized ag...

Abhijit Chakraborty, Ashish Raj Shekhar, Shiven Agarwal et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

The Straight and Narrow: Do LLMs Possess an Internal Moral Path?

Enhancing the moral alignment of Large Language Models (LLMs) is a critical challenge in AI safety. Current alignment techniques often act as superficial guardrails, leaving the intrinsic moral representations of LLMs largely untouched. In this paper, we bridge this gap by leveraging Moral Foundations Theory (MFT) to m...

Luoming Hu, Jingjie Zeng, Liang Yang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.