Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Open access Oct 2026

Mechanistic Knobs in LLMs: Retrieving and Steering High-Order Semantic Features via Sparse Autoencoders

Recent work in Mechanistic Interpretability (MI) has enabled the identification and intervention of internal features in Large Language Models (LLMs). However, a persistent challenge lies in linking such internal features to the reliable control of complex, behavior-level semantic attributes in language generation. In...

Ruikang Zhang, Shuo Wang, Qi Su · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Measuring all the noises of LLM Evals

Applying well-established statistical methods effectively to LLM evals requires consideration of model correlations and prediction noises. Leading evals often ignore data noise, have low statistical power, or make unnecessary trade-offs. We define and measure three types of noise: 1) prediction noise from generating di...

Sida I. Wang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Semantics as a Shield: Label Disguise Defense (LDD) against Prompt Injection in LLM Sentiment Classification

Prompt injection can cause large language models (LLMs) to deviate from their intended tasks by following instructions embedded in untrusted input. We investigate whether changing a classifier's output labels improves accuracy under such attacks, using sentiment classification as a case study. Label Disguise Defense (L...

Yanxi Li, Ruocheng Shan · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Training LLMs Beyond Next Token Prediction - Filling the Mutual Information Gap

Autoregressive language models are usually trained with next-token prediction under a fixed left-to-right target order. This paper studies target-token organization as a training-time design choice across arithmetic reasoning, multi-label text classification, and text generation. Controlled order studies show that the...

Chun-Hao Yang, Bo-Han Feng, Tzu-Yuan Lai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Iterative Critique-Refine Framework for Enhancing LLM Personalization

Personalized text generation requires models not only to produce coherent text but also to align with a target user's style, tone, and topical focus. Existing retrieval-augmented approaches such as LaMP and PGraphRAG enrich profiles with user and neighbor histories, but they stop at generation and often yield outputs t...

Durga Prasad Maram, Dhruvin Gandhi, Zonghai Yao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generation with LLMs

Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, \textit{two-stage} retrieval-augmented generated large language models (RAG-LLMs) have shown impressive advancements in this domain. Such a two-stage framework, especially the second stage (reranker), is particularl...

Haotian Chen, Qingqing Long, Meng Xiao et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

One Size Does Not Fit All: Distribution-Guided Tensor-Wise Adaptive Sparsification for Model Merging

Merging multiple task-specific fine-tuned checkpoints into a single multi-task model provides an attractive alternative to joint multi-task training. To mitigate cross-task interference, a common strategy is to sparsify task vectors before aggregation. However, many widely used methods rely on a uniform global sparsity...

Yingfeng Luo, Dingyang Lin, Junxin Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

Large language model (LLM) agents are increasingly organized into multi-agent systems for complex reasoning and decision-making tasks. However, scaling such systems can substantially increase inference cost, especially when multiple agents repeatedly process overlapping or role-irrelevant context. Many existing multi-a...

Jun Liu, Zhenglun Kong, Changdi Yang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

From Individuals to Interactions: Benchmarking Gender Bias in Multimodal Large Language Models from the Lens of Social Relationship

Ensuring the trustworthiness of Multimodal Large Language Models (MLLMs) requires rigorous evaluation of gender bias, particularly in socially sensitive domains. Existing benchmarks primarily assess bias in isolated contexts and are less suited to capturing biases that emerge through interpersonal interactions. We intr...

Yue Xu, Wenjie Wang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RCStat: A Statistical Framework for using Relative Contextualization in Transformers

Identifying which tokens and activations truly influence model predictions is critical for both the efficiency and interpretability of large auto-regressive language models. Yet in practice, token importance is typically inferred from attention distributions that entangle contextual relevance with softmax-normalization...

Debabrata Mahapatra, Shubham Agarwal, Apoorv Saxena et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

GUARD: Guided Unlearning and Retention via Data Attribution for Large Language Models

Unlearning large language models (LLMs) is important due to copyright and privacy concerns. A key challenge is unintended forgetting, where removing data inadvertently impairs model utility. While prior work has focused on architectural innovations, the influence of data-level factors remains underexplored. We introduc...

Peizhi Niu, Evelyn Ma, Boya Hou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Simulating Student-Tutor Interactions with LLMs for Multilingual Math Feedback

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective instructional support across different languages, especially for mathematically grounded...

Junior Cedric Tonga, KV Aditya Srivatsa, Kaushal Kumar Maurya et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.