Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Open access Oct 2026

Behavioral Forgetting Is Not Privacy in Machine Unlearning

Machine unlearning aims to remove targeted information from large language models, but existing evaluations often measure forgetting only on a designated benchmark distribution. We argue that such behavioral forgetting is an insufficient standard for privacy-oriented unlearning, and that evaluation should instead test...

Tyler Lizzo, Larry Heck · 0 citations
#natural language process... Preprint Open access Oct 2026

SceneWeave: Audience-Guided Scene Exploration for Dramatic Adaptation

Adapting prose into a script requires transforming narration and inner experience into scenes that convey relationships and psychological contradictions. Planning specifies intended effects but leaves their realization in dialogue and action unresolved. Drawing on screenwriters' accounts of revising scenes and their co...

Aolin Li, Xiao Xu, Haihua Xie · 0 citations
#natural language process... Preprint Open access Oct 2026

Abstracts or full text? Evaluating input scope and computational efficiency in biomedical lay summarization

Biomedical research articles are mainly written for experts and often contain terms that are difficult for the general public to understand. Automated lay summarization has become a solution to make biomedical knowledge easier for patients and the public to understand. However, generating lay summaries from full-text a...

Egecan \c{C}elik Evgin, \.{I}lknur Karadeniz, Olcay Taner Y{\i}ld{\i}z · 0 citations

Data Strategies for Large Language Models: A Unified Perspective on the Training Lifecycle

This work reviews data strategies across the training lifecycle and formulates them as policies that allocate a training budget over candidate examples, then divides methods by their decision granularity, model dependence, and temporal adaptivity, then compares their computational requirements and empirical support.

Yuan-Jian Xu, Jia-Ning Hao, Tian-Ze Sun et al. · 0 citations
#natural language process... Preprint Oct 2026

No Single Tokenizer Feature Reliably Predicts Downstream Language Model Performance

Tokenization is a critical component of the language modeling pipeline, but it is poorly understood. Tokenizers can impact downstream performance, but there is currently mixed evidence about which tokenizer features predict a better language model without requiring a full training run. In this paper, we analyze approxi...

Antonio Lopardo, Luis Frentzen Salim, Shikhar Srivastava et al. · 0 citations
#natural language process... Preprint Oct 2026

Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence

Reinforcement learning with verifiable rewards (RLVR) improves multimodal reasoning, but group-relative policy optimization broadcasts a single sequence-level advantage to every token of a response, although errors usually localize to a few decisive steps. Recent self-distilled variants refine credit with a teacher--st...

Yi-Ran Zhang, Han-Bo Huang, Jie-Lan Li et al. · 0 citations
#natural language process... Preprint Oct 2026

Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory

Addressed conditional memory provides a local surface for post-hoc knowledge injection, but a successful write need not transfer to a new question or preserve untargeted behavior. This study combines a controlled GPT-2 comparison with production-memory experiments on Qwen3.8-Flash-Next-FP8 and DeepSeek-V4.1-Flash. Newl...

Wei Gao, Cheng Tian, Ya-Wen Duan et al. · 1 citation
#natural language process... Preprint Oct 2026

OPRD: On-Policy Reminder Distillation for Long-Horizon Coding Agents

Reliable repository-level coding requires agents not only to generate correct code but also to preserve constraints and respond to tool feedback across long interactions. However, our diagnostic analysis shows that agents often fail to act on relevant information already available in context, while final Pass/Fail outc...

Yu-Jia Luo, Zhi-Yi Lai, Zi-Qi Miao et al. · 0 citations
#natural language process... Open access Oct 2026

Translation Circuit Discovery and Targeted Optimization for Low-Resource Multilingual Translation

Recent multilingual large language models achieve strong translation performance, yet the internal mechanisms responsible for low-resource multilingual translation remain insufficiently understood. In this paper, we study translation circuits in multilingual decoder-only LLMs for Hindi-to-Urdu and Hindi-to-Sindhi (Deva...

Atai Waris Khan, Abdullah Mazhar, R. Kumar et al. · 0 citations

SITAR: A Situational Distortion Metric for Automatic Speech Recognition Evaluation

In automatic speech recognition (ASR), transcription errors with similar lexical or semantic discrepancies can have markedly different consequences for the situation conveyed by speech. Capturing these differences requires not merely contextual assessment, but an understanding of what the spoken discourse describes, es...

Ming-Zhe Lu, Jin-Hao Liu, Yun-Peng Li et al. · 0 citations
#natural language process... Preprint Oct 2026

Identifying Effective Strategies in Prompt Evolution for Stress and Emotion Prediction

Early stress detection and risk prediction are crucial for timely mental health assessment and support. While large language models have recently shown promise for social media stress prediction, relying on accuracy can obscure false positives. Also, prompt revisions yield inconsistent gains across models and tasks, wi...

Seung-Jun Yi, Seung-Jun Yi, Sriram Sattiraju et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.