Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Sep 2026

Frontier Learning: Training LLM Reasoners at the Edge of Capability

Across several reasoning tasks and model families, the proposed frontier learning approach consistently achieves higher relative gains over fixed-pool baselines, demonstrating that effective post-training requires not only selecting useful problems, but continually generating them at the edge of capability.

Robin Faro, S. Ramesh, Ilija Bogunovic et al. · 0 citations
#artificial intelligence Book Open access Sep 2026

Semantic Prefix Oracles for LLM Decoding: Contracts and Differential Validation

Constrained decoding can enforce regular or context-free output formats, but many program-generation failures are semantic: scope, typing, and declaration effects depend on context. We present semantic grammar specifications, a declarative formalism that attaches such constraints to a context-free surface and executes...

Paul Kronlund-Drouault · 0 citations
#artificial intelligence Conference Open access Sep 2026

AwarenessBench: Assessing Cognitive Capabilities of Language Models

This work introduces AwarenessBench, the first comprehensive benchmark for assessing the cognitive abilities of LMs in four dimensions: metacognition, self-awareness, social awareness, and situational awareness, covering 15 cognitive functions and 14,381 samples.

Xiaojian Li, Rongwu Xu, Tianyun Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Multilinguality in Hybrid Attention LLMs

This work presents a first study of how hybrid attention impacts the multilinguality of LLMs, showing that cross-lingual representations in hybrid models develop in patterns tied to the ordering of recurrent and full-attention layers.

Lucas Bandarkar, Jun-Ling Hu, Chen-Yuan Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Do Coding Agents Reuse Existing Code or Reinvent the Wheel?

Coding agents are increasingly deployed for iterative development on real repositories, yet existing evaluation barely answers a basic question: \emph{do coding agents reuse existing code or reinvent the wheel?} The question matters: every duplicated implementation is a fix applied twice and agents produce code far fas...

Dong-Sheng Ma, Si-Zhe Wang, Xin-Yi Huang et al. · 0 citations

A mechanistic study of language model introspection

Across three model families, two small groups of attention heads are identified with distinct roles in introspective reporting supporting introspective detection and localization of large language models.

Jia-Hong Zou, Xiang-Kun Sun, Ling-Kai Kong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Echoes of Deeds: Moral History Can Shape and Steer LLM Behavioral Choices

Evaluations of Large Language Models (LLMs) morality typically consider decisions in isolation, thus overlooking whether an individual's unrelated prior conduct influences the model's subsequent choices. This leaves open the question of whether, and to what extent, moral history shapes LLM decisional behaviors. Prior w...

Lucio La Cava, Andrea Tagarelli · 0 citations
#artificial intelligence Preprint Sep 2026

VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation

The VEX-Bench is introduced, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods, and shows that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation.

Hanxun Huang, Yu-Tao Wu, Qi-Zhou Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Semantic Uncertainty Quantification Needs Factual Equivalence

A single encoder trained contrastively to isolate the targeted fact, utilizing synthetic data generated by an LLM and dataset both disjoint from all evaluation settings improves performance on 120 of 126 evaluation settings (95%) spanning 18 model dataset combinations across language and vision-language models.

Joseph Hoche, Quentin Guimard, Gianni Franchi · 0 citations
#artificial intelligence Preprint Sep 2026

Beyond Verbalized Confidence: Calibrating Reasoners with Differentiable Readouts

CREDO reads the confidence from a dedicated token pair in the model's output distribution and trains it by differentiable regression, turning the trained confidence into a signal for accuracy, weighting rollouts by how far confidence and outcome disagree, so that accuracy and calibration improve together.

Chen-Xiao Fan, Chong-Ming Gao, Gang-Yi Zhang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.