Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Sep 2026

CHI: A Composite Hallucination Index Unifying Entity, Relation, and Quantity Dimensions for Summarization Evaluation

CHI (Composite Hallucination Index), the first unified hallucination metric that decomposes faithfulness errors into three orthogonal dimensions, provides practitioners with a decomposable, interpretable, and efficient faithfulness metric suitable for both offline evaluation and online monitoring of summarization syste...

Praveenkumar Katwe, R. Balabantaray, Kali Prasad Vittala · 0 citations
#artificial intelligence Preprint Sep 2026

Does Learning to Predict the World Help Agents Act? Auditing World-Model Post-Training

This work replaces true next-observation targets with in-distribution mismatched observations and introduces a setting that replaces prediction-based rewards with independent random signals, which expands task coverage even when the reward carries no environment information.

Xin-Yu Che, Hang Yan, Yan-Chen Liu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Robust Hierarchical Structures for Agentic Document Analysis

This work proposes SHED, a two-stage workflow for inferring a robust and compact structure that improves F-1 scores by 13%--68% over non-LLM baselines and 9%--15% over expensive LLM-based approaches.

Ruiying Ma, Yi-Ming Lin, Aditya G. Parameswaran · 0 citations
#artificial intelligence Preprint Sep 2026

Hesitation-Aware On-Policy Distillation for Diffusion Language Models

Diffusion large language models (dLLMs) generate text by iterative unmasking. At each denoising step, a dLLM proposes a token at every masked position, but the decoder commits only a confident subset of these proposals. Trace-based on-policy distillation (TOPD) builds on this process by matching the student to a strong...

Jian-Guo Huang, Li-Peng Wan, Yan-Chen Deng et al. · 0 citations
#artificial intelligence Preprint Sep 2026

BERT4DTI : BERT-based Model for Predicting Drug-Protein Interactions

BERT4DTI is presented, which encodes SMILES strings with ChemBERTa and amino-acid sequences with ProtBERT, applies bidirectional mutual attention between token-level representations, and classifies the resulting interaction features using convolutional layers and a multilayer perceptron.

Thanina Hamitouch, Khadidja Henni, Abdelkrim Arie et al. · 0 citations

When Do Models Admit They Are Wrong? Failure Disclosure Is Unstable Under Reinforcement Learning

This work studies failure disclosure: whether a model admits that an attempted solution failed rather than staying silent or presenting it as successful, and makes reporting substantially more consistent, though its effect on task performance depends on the setting.

Steven Y. Feng, Noah D. Goodman, Michael C. Frank et al. · 0 citations

Scoring the Wrong Question: Readout Failures in Constrained-Option Evaluation

Constrained-option scoring reads a model's probabilities for a fixed set of permitted answers, so it returns a score even when the model is about to write something else. We study a prompt that quotes a multiple-choice item, ending in the item's own answer instruction, and asks for a forecast of whether a reader model...

Jia-Xuan Guo, Ke-Jia Zhang, Shuo Xin et al. · 1 citation
#artificial intelligence Preprint Sep 2026

MedRouter: Demystifying Knowledge Differences Across Medical LLMs for Routing-Based Reasoning

This paper introduces MedRouter, an agentic system that uses an embedding-based multi-label router to select and query specialist LLMs, then passes their responses to a generator to produce the final answer, and proposes SCALE (Specialist Competence-Aware Learning), a two-stage training framework.

Lang Cao, Bing-Hang Lu, Yu-Hao Shen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms

A recast long-duration ECG interpretation as a long-horizon, online (streaming, causal) sequential decision process and introduces ECG-Scroll, which evaluates a signal-threshold rule agent alongside off-the-shelf LLM agents online, characterizing how they use memory, tools, and planning and where the benchmark's head-r...

Hai-Tao Li, Cheng-Lin Li, Zheng-Yao Ding et al. · 0 citations
#artificial intelligence Preprint Open access Sep 2026

OneSign: Unifying Sign Language Understanding Tasks with One Model

SLU encompasses a diverse set of tasks, including ISLR, CSLR, and SLT. Although these tasks share basic semantic and linguistic foundations, they are typically addressed with task-specific architectures and training pipelines, which hinders knowledge sharing and requires costly pretraining and finetuning for each task....

Shiwei Gan, Yafeng Yin, Xiao Liu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.