NLPG is proposed, an external policy-memory method for improving a fixed agent without changing its model parameters or program structure that outperforms the strongest listed baseline for each benchmark by 8.71 percentage points on average.
Xu Liu, Wen-Zhang Wei, Jun Cao et al.· arXiv.org· 0 citations
CHI (Composite Hallucination Index), the first unified hallucination metric that decomposes faithfulness errors into three orthogonal dimensions, provides practitioners with a decomposable, interpretable, and efficient faithfulness metric suitable for both offline evaluation and online monitoring of summarization syste...
Praveenkumar Katwe, R. Balabantaray, Kali Prasad Vittala· 0 citations
This work replaces true next-observation targets with in-distribution mismatched observations and introduces a setting that replaces prediction-based rewards with independent random signals, which expands task coverage even when the reward carries no environment information.
Xin-Yu Che, Hang Yan, Yan-Chen Liu et al.· 0 citations
This work proposes SHED, a two-stage workflow for inferring a robust and compact structure that improves F-1 scores by 13%--68% over non-LLM baselines and 9%--15% over expensive LLM-based approaches.
Ruiying Ma, Yi-Ming Lin, Aditya G. Parameswaran· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Diffusion large language models (dLLMs) generate text by iterative unmasking. At each denoising step, a dLLM proposes a token at every masked position, but the decoder commits only a confident subset of these proposals. Trace-based on-policy distillation (TOPD) builds on this process by matching the student to a strong...
Jian-Guo Huang, Li-Peng Wan, Yan-Chen Deng et al.· 0 citations
BERT4DTI is presented, which encodes SMILES strings with ChemBERTa and amino-acid sequences with ProtBERT, applies bidirectional mutual attention between token-level representations, and classifies the resulting interaction features using convolutional layers and a multilayer perceptron.
Thanina Hamitouch, Khadidja Henni, Abdelkrim Arie et al.· 0 citations
This work studies failure disclosure: whether a model admits that an attempted solution failed rather than staying silent or presenting it as successful, and makes reporting substantially more consistent, though its effect on task performance depends on the setting.
Steven Y. Feng, Noah D. Goodman, Michael C. Frank et al.· arXiv.org· 0 citations
This property, coherence, is tested with a battery of logically linked questions that needs no labels, and finds that the checks need no labels expose biases that appear only when question forms are compared, and inconsistencies within items.
Constrained-option scoring reads a model's probabilities for a fixed set of permitted answers, so it returns a score even when the model is about to write something else. We study a prompt that quotes a multiple-choice item, ending in the item's own answer instruction, and asks for a forecast of whether a reader model...
This paper introduces MedRouter, an agentic system that uses an embedding-based multi-label router to select and query specialist LLMs, then passes their responses to a generator to produce the final answer, and proposes SCALE (Specialist Competence-Aware Learning), a two-stage training framework.
Lang Cao, Bing-Hang Lu, Yu-Hao Shen et al.· 0 citations
A recast long-duration ECG interpretation as a long-horizon, online (streaming, causal) sequential decision process and introduces ECG-Scroll, which evaluates a signal-threshold rule agent alongside off-the-shelf LLM agents online, characterizing how they use memory, tools, and planning and where the benchmark's head-r...
Hai-Tao Li, Cheng-Lin Li, Zheng-Yao Ding et al.· 0 citations
SLU encompasses a diverse set of tasks, including ISLR, CSLR, and SLT. Although these tasks share basic semantic and linguistic foundations, they are typically addressed with task-specific architectures and training pipelines, which hinders knowledge sharing and requires costly pretraining and finetuning for each task....
Shiwei Gan, Yafeng Yin, Xiao Liu et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.