Skip to content

Category

natural language processing

9,261 papers

Deception by Omission: Language Models Knowingly Hide Their Mistakes

Large language models (LLMs) increasingly act as agents with little human oversight, so potential mistakes they make can go unnoticed. Users then depend on the model to report what went wrong. An honest model discloses its mistakes, while a deceptive one conceals them. However, it is unclear how current LLMs behave in...

L. Florin, Amelie Knecht, Ulysse Schaller et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

ReCal: Calibrating Structured Pruning for On-Policy Distillation Recovery

Structured pruning reduces the deployment cost of reasoning language models, but the resulting capability degradation can hinder subsequent on-policy distillation (OPD) recovery. Because OPD relies on student-generated trajectories, pruning damage that persists after offline distillation can limit its effectiveness. We...

Houcheng Jiang, Mao Zheng, Mingyang Song et al. · 0 citations
#natural language process... Conference Open access Oct 2026

From Retrieval to Reconstruction: Constructing Evolvable Cognitive Memory for Long-term Dialogue

Large Language Models (LLMs) serving as long-term dialogue agents require memory systems that support reliable reasoning over extended interactions. However, existing Retrieval-Augmented Generation (RAG) frameworks typically treat memory as passive storage, making it difficult to distinguish source-attributed beliefs f...

Zi-Rui Liao, Zheng-Xian Wu, Zhuo Chen et al. · 0 citations
#natural language process... Preprint Oct 2026

BeliefScope: Diagnosing Evidence-Driven Revision and Pressure-Induced Shifts in Large Language Models

A language model may revise the same proposition after receiving genuinely relevant evidence or after receiving directional user pressure that adds no relevant fact. The observable response shift alone therefore does not reveal which source drove the change. We introduce BeliefScope, a controlled black-box framework fo...

Shuai-Fei Guo, Yi-Dong Cui · 0 citations
#natural language process... Preprint Oct 2026

When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often Better

On-policy distillation (OPD) has become increasingly popular for transferring teacher capabilities to student models. In this work, we ask a critical research question: Is on-policy sampling always beneficial for distilling arbitrary teacher-student pairs? We show that a simple alternative, Semi-OPD, which distills fro...

Siyan Zhao, Yong-Gan Fu, Jin-Dong Jiang et al. · 0 citations
#natural language process... Preprint Oct 2026

Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining

Speech-to-LLM systems often connect a frozen speech encoder to a frozen large language model (LLM) through a small trainable bridge. The bridge is usually treated as plumbing, but it in fact defines the geometry of the speech-to-LLM interface, and the pretraining objective decides whether that interface provides a reus...

Xin-Nian Zhao, Chia-Hua Wu, Pu Wang et al. · 0 citations
#natural language process... Preprint Oct 2026

The"10th Juror": Open-Set Standpoint Screening for Bureaucratic Bias Detection

Presupposing the boundaries of bias is itself a form of bias. We study closed-loop bias governance for Dutch government documents, where a system must detect biased language, ground decisions in legal and contextual evidence, rewrite problematic sentences when intervention is warranted, and verify that the rewrite miti...

Yu-Chen Miao, Zi-Jun Wang, Chang Han et al. · 0 citations
#natural language process... Preprint Oct 2026

Clinician use of language models diverges from how the models are evaluated

Large language model (LLM) assistants are being deployed to clinicians across health systems, and judgments about their readiness rest largely on benchmark scores, most of them derived from examination questions or curated cases. A benchmark predicts performance in deployment only to the extent that its items resemble...

K. Vishwanath, Hai-Tong Lin, A. Alyakin et al. · 0 citations
#natural language process... Preprint Oct 2026

Prompts versus Rules: Auditing and Controlling Speech Naturalness Behaviors in Voice User Simulators

As voice agents gain more popularity commercially, the user simulators used to evaluate the deployed agents are also being developed to include more realistic, variable, and diverse speech naturalness behaviors -- disfluency, interruption and backchanneling. The quality of the user simulator directly affects the validi...

Riqiang Wang, Elena Khasanova, Harsh Saini et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Back in Style: A Sociolinguistic Approach to Authoring and Measuring Persona Fidelity in User Simulation

As agentic systems gain commercial popularity, user simulators increasingly serve as measurement instrument for their evaluation. However, the fidelity of simulated users in comparison to real human users is generally low, and typically assessed by costly, subjective LLM judges. In this pilot study, we ask whether fide...

Lex Konnelly, Elena Khasanova, Riqiang Wang et al. · 0 citations
#natural language process... Open access Oct 2026

Large Language Models for Machine Translation Quality Annotation: Humans and Models Are Both Challenged

Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation. With MT evaluation spanning a large number of language pairs, domains and levels of annotation granularity, LLMs must be thoroughly evaluated across these dimensio...

Hala Almaghout, C. Federmann, Qin Gao · 0 citations
#natural language process... Preprint Oct 2026

Sparse Attention Is Matrix Approximation, Not Choosing from a Bag of Values

It is argued that sparse attention should be formulated as matrix approximation, not as blindly choosing the largest values from a bag of entries, and proposed Matrix Approximation Sparse Attention (MASA), which replaces raw attention-mass ranking with a closed-form score that measures how much each sparse unit reduces...

Fang Wan, Xu-Feng Liu, Fan Li et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.