Skip to content

Category

natural language processing

9,568 papers

AutoCompact: Learning When to Compact Context in Long-Horizon Coding Agents

Coding agents solve repository-level software engineering tasks through long trajectories of code inspection, search, editing, and testing. As a task progresses, earlier exploration becomes stale, so managing context is more than avoiding overflow: an agent must decide when to compact, what working state to preserve, a...

Xuan Zhang, Long-Tao Zheng, Cun-Xiao Du et al. · 5 citations
#natural language process... Preprint Oct 2026

Keyword Harnesses Fail Open: A Cheap Diagnostic Ladder for Tool-Use Claims in Small Language Models

Keyword-matching benchmarks can credit small models for tool use they never perform. We document such a false positive in a matched-architecture pair of Spanish security language models and propose a ladder of strict, cheap diagnostics. A 661.6M parameter model (approx. 65% code/technical text; no dedicated SFT) and a...

Juan S. Santillana · 0 citations
#natural language process... Preprint Oct 2026

LLM-as-Jev: LLMs Are Already Jev-Style Decision Models -- When and How to Fine-Tune Them

Jev-style decision models return categorical probability distributions over predefined options without generating free-form text, enabling software systems to act on their outputs directly. In this work, we investigate the extent to which general-purpose LLMs already possess this capability out of the box, and when fin...

Yin-Heng Li, Justin Wagle · 1 citation
#natural language process... Preprint Oct 2026

Typological Alignment of Stack-Based Language Models on Mildly Context-Sensitive Artificial Languages

Some properties of languages, e.g., subject-object-verb (SOV) word order, are more prevalent than others among the thousands of attested natural languages (NLs). Such typological commonality is often attributed to learning biases. Computational simulations, recently with language models (LMs), have facilitated the expl...

Nadine El-Naggar, Tatsuki Kuribayashi, Ted Briscoe · 0 citations

Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation

Automated ideation systems are often evaluated on the novelty of the ideas they produce, and that judgment is increasingly delegated to large language models. Such judges are typically built ad hoc and validated, if at all, on human-authored papers rather than on the generated ideas they are meant to score. So, how do...

Noy Sternlicht, Simra Shahid, P. Jansen et al. · 0 citations
#computer vision Preprint Oct 2026

Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization

Adaptive Tversky Policy Optimization (ATPO) is proposed, a reinforcement learning framework for Multi-label Video Safety Detection (Multi-VSD), which introduces the Adaptive Tversky Reward (ATR), which dynamically adjusts false-positive and false-negative penalties during training to enable controllable precision-recal...

Guang-Yu Yang, Jing-Biao Mei, Ming-Shen Sun et al. · 0 citations
#natural language process... Preprint Oct 2026

The Asymptotics of Language Model Alignment with Memory

Language model (LM) alignment broadly aims to perturb a given LM $Q$ into an aligned LM $q$ such that i) the outputs produced by $q$ and $Q$ are'close'in probability, ii) $q$ has a higher expected reward than $Q$. Two common techniques for LM alignment are: KL-constrained RL, which requires knowledge of the LM distribu...

Haricharan Balasundaram, V. Rameshwar · 0 citations
#natural language process... Preprint Oct 2026

A Matryoshka Hierarchical RAG for Efficient Multi-Hop Question Answering

Retrieval-Augmented Generation (RAG) systems for multi-hop Question Answering (QA) must balance retrieval quality with computational cost. This cost is incurred during indexing time, through the use of expensive Knowledge Graphs (KGs) or Large Language Models (LLMs) to generate summaries, or during querying, through it...

Gianluca Bonifazi, Christopher Buratti, Michele Marchetti et al. · 0 citations
#natural language process... Preprint Oct 2026

Task-Oriented Rank Adaptation for Continual Learning in Text Classification

Continual learning (CL) in text classification faces two critical challenges: catastrophic forgetting and negative transfer across sequential tasks. Parameter-Efficient Fine-Tuning (PEFT) methods such as LoRA enable efficient adaptation by learning low-rank updates of the model parameters. However, these compact repres...

Rey Sanchez Lopez, Eduardo Morales Manzanares, Hugo Jair Escalante · 0 citations
#natural language process... Preprint Oct 2026

Compound interpretation is based on analogy

How compound meanings are best predicted from constituent meanings remains a central question in computational models of lexical semantics. Comparing different computational models provides a way to evaluate alternative accounts of how semantic information is combined during compound comprehension. We propose a new mod...

Tian-Ao Shen, Harald Baayen · 0 citations
#natural language process... Preprint Oct 2026

Yo-ByT5: Efficient and High-Fidelity Diacritic Restoration for Yor\`ub\'a

Yor\`ub\'a is a widely spoken tonal language that depends on diacritics to avoid lexical ambiguity. However, it is often written without these diacritics, thereby hindering downstream Natural Language Processing (NLP) tasks. In this paper, we introduce Yo-ByT5, a byte-level Automatic Diacritic Restoration (ADR) model f...

Ahmad Samuel Gali, Shamsuddeen Hassan Muhammad University of Lagos, Bayero Unuversity Kano et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.