Skip to content

Category

natural language processing

9,568 papers

#machine learning Preprint Open access Sep 2026

SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolution

Large language models (LLMs) exhibit strong performance on self-contained programming tasks. However, they still struggle with repository-level software engineering (SWE), which demands (1) deep codebase navigation with effective context management for accurate localization, and (2) systematic approaches for iterative,...

Kang He, Kaushik Roy · 0 citations
#machine learning Preprint Oct 2025

R2T: Rule-Encoded Loss Functions for Sequence Tagging in Low-Resource Languages

Rule-to-Tag (R2T), a framework that turns linguistic rules into the training signal for neural sequence taggers in low-resource languages, is introduced, a first instance of a broader paradigm the authors call principled learning (PrL): using explicit principles as a learning signal, rather than relying on example-base...

Mamadou K. Keita, Christopher Homan, Sébastien Diarra · 2 citations
#machine learning Preprint Open access Sep 2026

Large Language Model Selection with Limited Annotations

Choosing a Large Language Model (LLM) for a given task requires comparing many strong candidates, yet standard evaluation relies on costly annotations over fixed evaluation sets. To address this challenge, we develop SELECT-LLM, the first framework for active model selection of LLMs. SELECT-LLM aims to find a small set...

Yavuz Durmazkeser, Patrik Okanovic, Andreas Kirsch et al. · 0 citations
#machine learning Preprint Jun 2024

LaSEr-Edit: Localized Span-level Error Editing with Energy-based Localization

LaSEr-Edit is proposed, a constraint-satisfying text revision method that can be applied to any LLMs, black- or white-box, and it is found that lightweight, task-specific energy-based models (EBMs) achieve error-localization performance competitive with or even better than that of much larger LLMs, while operating subs...

H. Son, Saehee Eom, Mooho Song et al. · 3 citations

Epiphany-Aware KV Cache Eviction Without the Attention Matrix

EpiKV is introduced, which combines hidden-state shifts with the model's recent query--key relevance to rank cached tokens without materializing the attention matrix, and matches or outperforms the strongest attention-based eviction baselines while running directly in vLLM with unmodified attention kernels.

Steven Kolawole, Virginia Smith · 2 citations

The Interplay of Harness Design and Post-Training in LLM Agents

It is shown that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings, highlighting the importance of harness-aware post-training under such shifts.

Kyungmin Kim, Youngbin Choi, Seoyeon Lee et al. · 7 citations

Multi-Bitwidth Quantization for LLMs Using Additive Codebooks

Drop-by-Drop is proposed, a novel multi-bitwidth post-training quantization framework enabling inference-time precision control over LLM weights from a single quantized model, and it is proved that Gaussian sources are successively refinable under a weighted mean squared error distortion motivated by LLM loss functions...

Liza Babaoglu, Shuangyi Chen, Ashish J. Khisti · 1 citation

Claw-SWE-Bench: A Benchmark for Evaluating OpenClaw-style Agent Harnesses on Coding Tasks

Claw-SWE-Bench is introduced, a unified benchmark that enables researchers to systematically assess the capabilities and efficiency of general-purpose harnesses on software engineering tasks and guide the development of more capable and efficient harnesses.

Meng-Yu Zheng, Kai Han, Bo-Xun Li et al. · 5 citations

EntmaxKV: Support-Aware Decoding for Entmax Attention

EntmaxKV is introduced, an entmax-native sparse decoding framework that exploits sparsity before KV pages are loaded, and a Gaussian-aware entmax selector that estimates the entmax threshold from lightweight page statistics, adapting the selected budget to the score distribution.

Gonçalo Duarte, Miguel Couceiro, Marcos V. Treviso · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.