Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Oct 2026

Agent Planning Benchmark: A Diagnostic Framework for Planning Capabilities in LLM Agents

Planning is central to LLM agents: before acting, an agent must decompose goals, select tools, reason over constraints, and decide when a task is infeasible. Yet existing agent evaluations often report only end-to-end success, making it difficult to determine whether failures stem from planning or execution. We introdu...

Haoyu Sun, Wenxuan Wang, Mingyang Song et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

SMADE-IE: Sparse Multi-Agent Framework with Evidence-Driven Debate for Zero-Shot Information Extraction

Zero-shot information extraction (IE) with large language models (LLMs) enables adaptation to new schemas and domains without task-specific training. Existing methods mainly follow three paradigms. Monolithic prompting is efficient but prone to missed mentions, boundary errors, and type confusion. Each-type prompting i...

Kenfeng Huang, Yi Cai, Xin Wu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

ExpHarness: Model-Agnostic Experience Learning through a Trainable Harness

Large language model (LLM) agents increasingly operate within a harness, the scaffolding that determines what enters the executor's context, yet the experience they accumulate across tasks rarely flows back into this harness. Existing approaches include executor fine-tuning and external memory retrieval, but combining...

Tao Feng, Chongrui Ye, Fangxu Yu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

ElasticMem: Latent Memory as a Learnable Resource for LLM Agents

Long-term memory is essential for LLM agents to reason coherently across extended interactions, personalize responses, and reuse past experience. However, existing memory-augmented methods typically treat memory as a fixed resource: text-space approaches concatenate retrieved memories into the context window, causing s...

Tao Feng, Chongrui Ye, Fangxu Yu et al. · 0 citations
#natural language process... Preprint May 2026

Beyond Phones: Structured Phonemic Modeling for Vietnamese Automatic Speech Recognition

A structured phonemic approach to Vietnamese ASR that moves the output representation from surface phones to abstract phonemes and introduces a phonemic Syllabic-Structure Decoder that captures the hierarchical organization of Vietnamese syllables.

Nghia Hieu Nguyen, Q. Hoang, Long Nguyen et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

ROC Analysis for Evaluating Translation Quality Estimation Systems

The increasing use of automated translation quality estimation (QE) systems calls for practical, decision-oriented methods for evaluating their performance. We propose that Receiver Operating Characteristic (ROC) analysis is a useful approach for this purpose. Our study shows that ROC analysis not only produces results...

Evelyn Y. Garland (Acta Language Services, LLC), Carola F. Berger (CFB Scientific Translations LLC) · 0 citations
#natural language process... Preprint May 2026

Single-Round Vector RAG vs an LLM-Compiled Wiki: A Preregistered Comparison on a Small Multi-Domain Research Corpus

A comparison of two ways to help an LLM answer questions over a small research corpus: single-round Vector RAG and an LLM-compiled markdown wiki browsed by a tool-using agent, which system appears to win depends on the retrieval baseline, the scoring method, and the judge.

Theodore O. Cochran · 2 citations
#natural language process... Preprint Open access Oct 2026

Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter

Large language model (LLM) unlearning aims to remove specific data influences from pre-trained model without costly retraining, addressing privacy, copyright, and safety concerns. However, recent studies reveal a critical vulnerability: unlearned models rapidly recover "forgotten" knowledge through relearning attacks....

Zeguan Xiao, Xuanzhe Xu, Yong Wang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Language Models Without a Trainable Input Embedding Table: Learning from Fixed Minimal Binary Token Codes

We study whether a decoder-only language model requires an independently trainable input vector for every token. For a vocabulary of size $V$, an injective fixed-length binary identifier requires $K=\lceil\log_2 V\rceil$ bits. We replace the usual trainable $V\times d_{\mathrm{model}}$ input table with fixed minimal bi...

A. Bochkov · 0 citations
#natural language process... Preprint Open access Oct 2026

K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs

Large language models are increasingly used in K-12 education, but existing benchmarks mainly test exam question answering rather than understanding how curriculum knowledge is structured and visually presented. We call this capability curriculum cognition. It covers prerequisite chains, concept taxonomies, experiment-...

Hao Liang, Qihan Lin, Mingrui Chen et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

CktFormalizer: Autoformalization of Natural Language into Circuit Representations

Hardware infrastructure is a critical bottleneck for LLM-driven circuit design, limiting what agents can express, compile, and iteratively refine within an agentic loop. To address this bottleneck, we introduce CKTLEAN, a typed hardware infrastructure embedded in Lean. It supports hardware description, compilation to S...

Jing Xiong, Qi Han, Chenchen Ding et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Improving Reasoning Ability via Asynchronous On-Policy Self-Distillation under Positive Rollouts

Distillation and reinforcement learning through verifiable rewards (RLVR) have achieved progress in enhancing the reasoning ability of large language models (LLMs). However, we note that negative rollouts may admit no gradation of failure severity, and the combinatorial vastness makes penalizing a few sampled negatives...

Mingwei Xu, Hao Fang · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.