Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Oct 2026

Evaluating Modeling Approaches for Experience-Level Classification in Job Description

This paper investigates the task of predicting job experience levels in recruitment texts, aiming to automatically identify the qualifications required for positions. Unlike traditional text classification, recruitment texts typically possess explicit internal structures, with different paragraphs playing disproportion...

Celia Liang, Eddie Wu, Shiqi Wang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Can LLMs Separate Pasted Artifacts from User Speech? Absorption at Unmarked Prompt Seams

Large language models (LLMs) receive each user message as plain text, even when it combines text from different sources. For example, a user may paste text into a prompt and keep typing a comment directly below it. We study absorption: a phenomenon where the model treats a trailing user comment as part of the pasted te...

Sugam Panthi, Muhaiminul Yeamin, Rabab Abdelfattah · 0 citations
#natural language process... Preprint Oct 2026

Copying Before Suppression: What Drives a Below-Chance Dip During Language Model Training?

Mechanistic interpretability usually studies fully trained models, yet the computations that drive a behaviour can change while the model is still learning the task. On the Indirect Object Identification task, a model should continue with the name mentioned once rather than the name mentioned twice. Pythia models pass...

T. Dahiya, Cole Blondin · 0 citations
#natural language process... Conference Open access Oct 2026

LongSocialBench: Do Long-Context LLMs Understand Online Discussion Threads?

Long-context LLMs can now ingest entire online discussion threads, but understanding their social discourse requires more than reading a long document: models must track parent-reply relations, turning points, scoped subtrees, cross-branch contrasts, and participant trajectories. To test this structure-aware social rea...

Xin-Yi Liu, R. Khaziev, Dilek Hakkani-Tur et al. · 0 citations
#natural language process... Preprint Oct 2026

IdeaScientist: Orchestrating Agents for Grounded Scientific Ideation

Despite rapid progress in automating scientific research, generating promising and well grounded research solutions remains a central challenge. We isolate research ideation as a standalone task and build our solution on the intuition that a challenge in one field can often be addressed by a mechanism that solved an an...

Jia-Rui Liu, Ren-Jie Tao, Yi-Wei Liao et al. · 0 citations
#natural language process... Preprint Oct 2026

Do Language Models Need a Trainable Input Embedding Table? Fixed Minimal Token Codes at 1.7B-Class Scale

A trainable input embedding table assigns each vocabulary item an independently adjustable vector. We investigate whether this token-specific parameterization is required for substantial language-modeling capability, or whether a shared Transformer can learn from fixed token identities. We compare three decoder-only la...

A. Bochkov · 0 citations
#natural language process... Preprint Oct 2026

BAIBAICHUCHU at the NTCIR-19 FinArg-3 Task: When Is Maximum Possible Profit Predictable from Investor Text?

The BAIBAICHUCHU team participated in the Social Media Subtask of NTCIR-19 FinArg-3, ranking Chinese investor posts by Maximum Possible Profit (MPP). A three-track ensemble of lexical features, a FinArg-2-pre-finetuned MacBERT ranker, and an LLM judge reaches 0.734 in post-grouped development evaluation, but our best o...

Zong-Han Bai, Po-Yen Chu · 0 citations
#natural language process... Preprint Oct 2026

General Decision Models: Benchmarking and Insights Beyond Jev

General decision models, such as Jev, have recently emerged as efficient alternatives to LLMs for structured judgment and selection. But what kinds of decisions can these models reliably make, and how does their behavior change when individual decisions are composed into larger systems? To study this, we introduce JEVa...

Fei-Yu Duan, Jia-Yu Lin, Jia Wang et al. · 1 citation
#natural language process... Preprint Oct 2026

When Evidence Changes: Evaluating Memory Repair and Re-reading in Language-Model Agents

When documents supporting an agent's derived facts are revoked or replaced, should it repair memory or re-read current evidence? We introduce an evidence-revision evaluation on medication- and problem-list tasks from public ICU records. Under revocation, replacement and control events, we compare full and source-filter...

Wen-Hui Chu · 0 citations

Fine-Grained Emotion Classification from Mobile App Reviews: An Empirical Study with Large Language Models

Context: Fine-grained emotion classification of mobile app reviews enables requirements engineering activities that go beyond polarity-based opinion mining, including emotionally informed issue prioritisation and feature-oriented feedback analysis. However, automatic fine-grained emotion extraction from app reviews rem...

Quim Motger, Carlota Catot, M. Oriol · 0 citations

Message Passing Enables Efficient Reasoning

message Passing Language Models, a framework for LLM reasoning in which threads communicate directly via lightweight send and receive primitives, and shows that appropriately prompted large pre-trained models follow the MPLM protocol, achieving competitive results on long-context question answering relative to popular...

Xue-Chen Liu, Daman Arora, Gokul Swamy et al. · 1 citation
#machine learning Preprint Open access Oct 2026

REFLEX: Reflective Evolution from LLM Experience

Large multimodal language models (MLLMs) have emerged as powerful tools for guiding evolutionary search toward interpretable programmatic policies. In existing program-evolution systems, however, reusable knowledge is usually carried by whole programs in the population, and it is difficult to trace how a visual observa...

Pan Wang · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.