Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Oct 2026

On-Policy Distillation Teaches New Skills but Not New Knowledge

On-policy distillation (OPD) strengthens language-model reasoning, yet whether students acquire new factual knowledge or compositional skill for multi-step reasoning remains unknown. We separate these capabilities using a controlled synthetic framework that measures the student's initial capabilities and independently...

Yixuan Tang, Yi Yang · 0 citations
#natural language process... Preprint Oct 2026

RELATE: An Evaluation Framework for measuring Relational Orientation of Large Language Models

Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world relationships. Yet existing evaluations primarily focus on the safety, empathy, or helpfulness of responses, leaving under-examined a relational question: where does the...

Shivam Shukla, Jihye Kim, Shubham Gaur et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

A Comparative Study of Evaluation Metrics for Long-Document Financial Narrative Summarization with Transformers

There are more than 2,000 listed companies on the UK's London Stock Exchange, divided into 11 sectors who are required to communicate their financial results at least twice in a single financial year. UK annual reports are very lengthy documents with around 80 pages on average. In this study, we aim to benchmark a vari...

Nadhem Zmandar, Mo El-Haj, Paul Rayson · 0 citations

Goldsmith: Gold-Loss-Guided Definition Optimization with an Agentic Annotation Harness

Goldsmith, an agentic pipeline that turns a small gold set---expert-annotated calibration examples representing the intended task boundaries---into a reusable structured annotation definition, shows that scarce expert supervision can support both task-definition learning and scalable annotation.

Yi-Han Li, Han-Yi Zhang, Xiao-Xi Jiang et al. · 0 citations
#natural language process... Preprint Oct 2026

BanglaRhet: Benchmarking Classical and Transformer Models for Rhetorical and Persuasion Detection in Bangla Political Speech

A benchmark study of transformer-based models for detecting rhetorical form and persuasive intent in Bangla political discourse and provides initial benchmark baselines for Bangla rhetorical and persuasion-aware political discourse analysis and highlights the need for context-aware and multi-label modeling.

Rohit Kumar Sen, A. Chowdhury · 0 citations
#natural language process... Preprint Oct 2026

Right Number, Wrong State? Measuring Cross-Jurisdiction Substitution in LLM Recall of State Policy

When an LLM answers a state-specific policy question wrongly, it may be hallucinating, or it may be returning a real value that holds in another state. We test this with a minimal-set design: the question wording is fixed and only the jurisdiction varies, across the 50 U.S. states and the District of Columbia (51 juris...

Jia-Yue Feng · 0 citations
#natural language process... Preprint Oct 2026

ARCS: Towards Precise Text-to-SQL via Structured Disambiguation

As text-to-SQL systems move beyond demonstrations toward real-world deployment, ambiguity in user questions becomes a primary source of errors. Such ambiguities are often subtle, domain- or data-specific, and can silently cause system outputs to deviate from the user's true intent. Ambiguity is traditionally addressed...

Yi-Hao Hu, Yan-Lin Feng, Naoki Otani et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Expert Coupling in MoE Pretraining: Reducing All-to-All Overhead with Correlated Placement and Token Shuffling

Mixture-of-Experts (MoE) layers replace the feed-forward block of a Transformer with E expert networks, and each token is routed to k of these experts. Under expert parallelism (EP) the experts are distributed across GPUs, and every MoE layer runs all-to-all collectives in the forward and backward passes to dispatch to...

Radha Gulhane, Quentin Anthony, Beren Millidge · 0 citations
#natural language process... Preprint Oct 2026

Dialect-Robust Speech Language Models with Synthetic Pseudo-Dialect Augmentation

P pseudo-dialect speech is synthesized by converting LLM-generated dialect text via a standard-language TTS model, requiring zero real dialect speech, and intermediate standard-text prediction during training is introduced during training, acting as semantic normalization for downstream tasks.

Shunsuke Mitsumori, T. Mizumoto, Yusuke Fujita · 0 citations
#natural language process... Preprint Open access Oct 2026

When Forgetting Looks Like Improvement: Metric Masking in Streaming Diarizer Adaptation and the Price of Rehearsal

Small-data adaptation can improve speech detection while degrading speaker attribution. We study this discrepancy in a released streaming diarizer adapted on 7.5 h of two-party conversation and evaluated across six corpora. Adaptation substantially improves in-domain diarization performance and transfers to an independ...

Mo Yu, Yang Liu, Jing Qian · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.