Skip to content

Category

natural language processing

9,261 papers

#natural language process... Preprint Oct 2026

Not X, but When: Diagnosing a Mandarin LLM Writing Tic through Contextual Appropriateness

Recurring expressions in model-written text are often treated as signatures of machine authorship, yet most of them serve legitimate functions. Whether such an expression is a tic depends on whether the model knows when it is called for. This judgment of appropriateness, central to communicative competence, remains lar...

Yi-Hang Peng, Yi Jing, De-Wen Liu et al. · 0 citations
#natural language process... Preprint Oct 2026

Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

External-memory systems extend language-model applications beyond a context window, but their quality depends critically on the model executing the write path: deciding what to retain, how precisely to represent it, and how new evidence should update persistent state. Existing frameworks typically place a general-purpo...

Tian-Xiang Fei, Jia-Zheng Kang, Mao Zheng et al. · 0 citations
#natural language process... Preprint Oct 2026

CLUE: Uncovering Social Context for Pragmatic Understanding

Understanding a conversation requires connecting what is said to the speakers'relationships, expectations, and earlier exchanges. Prior work shows that supplying relevant context can improve models'social judgments, but much of this information may already be present in the conversation. This motivates training models...

Cheng-Fei Wu, Zhao-Qing Wu, Dan Goldwasser · 0 citations
#natural language process... Preprint Open access Oct 2026

PremiseSQL: Evaluating Premise Critique and Abstention in Text-to-SQL Systems

Recent advances in large language models (LLMs) have substantially improved Text-to-SQL performance, yet existing NL2SQL systems largely assume that user queries are valid and answerable. As a result, models often generate executable SQL even for queries with flawed premises. We introduce premise critique ability in NL...

Shuo Lin, Jinzhe Li, Chenlu Guo et al. · 0 citations

Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling

Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We present Intern-Decision, a family of 0.8B, 2B, and 4B multimodal decision models that return...

Tong Zhu, Zhe Xu, Ze-Feng He et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa

In minoritized (low-resource) language technologies, a common response to data sparsity is to aggregate text across multiple varieties and treat the combined data as a single corpus. However, mixed corpora of closely related indigenous variants can produce an artificial register that is accountable to no single speaker...

Luis A. Mercado-Campos, Alexis Palmer · 0 citations
#natural language process... Preprint Oct 2026

Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning

Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty. However, context length alone cannot explain why models fail on long-context tasks that require reasoning over complex information. Contexts of equal length can pose very...

Shi-Wen Qin, C. Barker, Henry Gouk et al. · 0 citations
#natural language process... Preprint Oct 2026

Name-Bias in Large Language Models

Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large language models spanning multiple providers and parameter scales. Using a fill-in-the-blan...

Kalyan Bhetwal, Ceren Mert, Ian Whitehouse · 0 citations
#natural language process... Preprint Open access Oct 2026

Learning Speech Attribute Representations via Multi-Teacher Distillation

Recent post-training approaches have shown that self-supervised speech encoders can be adapted to learn a single utterance-level speech attribute through knowledge distillation. In this work, we investigate whether a single speech encoder can simultaneously preserve multiple complementary utterance-level speech represe...

Maryem Bouziane, Salima Mdhaffar, Yannick Est\`eve · 0 citations
#natural language process... Preprint Oct 2026

TEM: Temporal State Tracking Memory for Large Language Model Agents

An agent's memory must remain useful as information changes across conversations. A new fact may replace an earlier value without making that value irrelevant to a later question. We present Temporal State Tracking Memory (TEM), a training-free framework for tracking these changes. TEM stores facts as versioned records...

Peng Song, Yun-Kai Zhuang, Li-Ye Shi · 0 citations
#natural language process... Preprint Open access Oct 2026

Dynamic ordering in sequence generation in Transformers: experiments on low-resource Tagging scenarios

This paper introduces TagInsert, a Transformer-based model that challenges the common left-to-right (L2R) generation paradigm in Transformers, for sequence labelling tasks where dependencies may not naturally align with a L2R order. TagInsert lifts the L2R constraint by removing the decoder-side attention mask and enab...

Giacomo Bais, Tejaswini Deoskar · 0 citations
#natural language process... Preprint Open access Oct 2026

Content associations with answer selection and engagement in supply chain community question answering

Community question-answering platforms are important ecosystems for knowledge sharing, yet research on what makes an answer best or a question engaging has often focused on either individual lexical features or broad topics. This exploratory study examines both levels in Yahoo! Chiebukuro, asking which nouns and semant...

Hisatoshi Naganawa · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.