Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Oct 2026

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training

Large Language Models (LLMs) are pre-trained on large amounts of data from different sources and domains. Such datasets often contain trillions of tokens, including large portions of copyrighted or proprietary content, which raises questions about the legal use of such models. This underscores the need for truly open p...

Pierre-Carl Langlais, Pavel Chizhov, Catherine Arnett et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Even Small Reasoners Should Quote Their Sources: Introducing the Pleias-RAG Model Family

We introduce a new generation of small reasoning models for RAG, search, and source summarization. Pleias-RAG-350m and Pleias-RAG-1B are mid-trained on a large synthetic dataset emulating the retrieval of a wide variety of multilingual open sources from the Common Corpus. They provide native support for citation and gr...

Pierre-Carl Langlais, Pavel Chizhov, Mattia Nee et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Sherpa: Teaching LLMs to Teach Adaptively

Large language models (LLMs) have become increasingly capable problem solvers, but being able to solve a problem is not the same as being able to teach it. Existing approaches to training LLMs as teachers rely on demonstrations, preference data, or predefined pedagogical criteria that specify what good teaching looks l...

Wei Xu, Yanzhe Zhang, Zora Zhiruo Wang et al. · 0 citations
#natural language process... Preprint Oct 2026

A Systematic Study of Semantic ID Spaces for Generative Information Retrieval

Generative Information Retrieval (GIR) has emerged as a transformative paradigm, shifting document retrieval from a traditional"retrieve-and-rank"workflow to sequence-to-sequence generation, where a model directly predicts document identifiers (DocIDs). While the semantic design of these DocIDs is known to be critical...

Alexia Allal, Hicham Randrianarivo, Sylvain Lamprier · 0 citations
#natural language process... Preprint Open access Oct 2026

Disentangling Paradigm, Identifier, and Decoding in Generative Retrieval

Generative retrieval trains a language model to generate the identifier of a relevant document. Recent work replaces the autoregressive decoder with diffusion, but changes identifiers, training recipe and decoding at once, so differences cannot be credited to the paradigm. On NQ320K and MS300K, we train autoregressive,...

Hicham Randrianarivo, Logan Renaud, Alexia Allal · 0 citations
#computer vision Preprint Oct 2026

The Failure Is in the Readout: Fine-Grained Emotion Recognition Benchmarks Measure Elicitation, Not Perception

Fine-grained emotion recognition supports therapy tools and social robots, but it needs facial data, which raises privacy and data-protection concerns. EmoNet-Face-HQ answers that with generated portraits, expert-rated over a $40$-category taxonomy far finer than the usual six to eight basic emotions. Under the protoco...

T. Hallmen, Fabian Deuser, Robin-Nico Kampa et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Natural Language Questions as an Interface for Knowledge Graphs: QRAKEN Graph Distillation and Semantic Self-Healing

QRAKEN is a training-free, ontology-agnostic neurosymbolic pipeline grounding generation in empirical graph evidence rather than schema expectations, supporting the value of empirical patterns beyond schema exposure.

Remo Grillo, L. Klic, Giovanni Colavizza · 0 citations
#artificial intelligence Preprint Oct 2026

POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents

LLM tool-use agents operate in dynamic environments where many actions carry operational risk. However, most safety mechanisms react only after errors manifest. Existing pre-emptive approaches either fine-tune the agent on chain-of-thought deliberation or compile natural-language guardrails into runtime checks, but the...

Yun-Ju Kang, Seonghyeon Cho, Irene Li et al. · 0 citations
#natural language process... Open access Oct 2026

HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR

Experimental results demonstrate that the cascaded system remains more reliable under the MLC-SLM Task 1 conditions, while unified speech LLMs offer a promising direction for future speaker-attributed ASR.

Takanori Ashihara, Kohei Matsuura, Masato Mimura · 0 citations
#artificial intelligence Preprint Oct 2026

VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs

Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch tokens. However, visual information is unevenly distributed: some regions require fine-grained detail, while others admit compact representations. Down...

Yuan Feng, Qi-Ze Yang, Rui-Zhe Chen et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Confidence Reasoning Graphs: Structured Confidence Estimation for LLM Agents

When using an LLM agent in a consequential domain, making an informed decision about whether to trust its output or intervene requires calibrated confidence in the agent's success. Confidence estimation for agents is difficult because evidence about success is distributed across heterogeneous, interdependent steps of a...

Brendan King, Farima Fatahi Bayat, Jean-Flavien Bussotti et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.