As retrieval systems scale, effective and efficient reranking becomes increasingly important. However, most existing encoder- and decoder-based rerankers jointly process every query--passage pair, tightly coupling their online computation and limiting deployment efficiency and flexibility. We present KaLM-Reranker-V1,...
Xinping Zhao, Jiaxin Xu, Ziqi Dai et al.· 0 citations
How unlearning effects propagate from the forget set to same-domain and distant-domain knowledge not after but before unlearning is measured to find a consistent decay pattern: collateral damage is strongest near the forget set, weakens with semantic distance, but does not disappear at domain boundaries.
Bo Su, Ankit Shah, Thai Le· arXiv.org· 3 citations· ⚡1
Travel planning in the real world is overwhelmingly a \textit{group} activity, yet existing LLM travel-planning benchmarks reduce it to a single user, where the field is approaching saturation. This single-user assumption sidesteps what makes group planning hard for an agent: discovering private preferences across mult...
Xiang Cheng, Yulan Hu, Lulu Zheng et al.· 0 citations
Co-FactChecker is proposed, a framework for human-AI collaborative claim verification that translates expert feedback into trace-edits that introduce targeted modifications to the trace, sidestepping the shortcomings of dialogue-based interaction.
DeToxR (Decision-support for Toxicology with Reasoning), the first adaptation of Reinforcement Learning to emergency toxicology, is presented, which designs a robust data-fusion engine for multi-label prediction across 14 substance classes based on an LLM finetuned with Group Relative Policy Optimization (GRPO).
Nico Oberländer, D. Bani-Harouni, Tobias Zellner et al.· arXiv.org· 0 citations
ConRad (Confidence Calibration for Radiology Reports), a reinforcement learning framework for fine-tuning medical LVLMs to produce calibrated verbalized confidence estimates alongside radiology reports, is introduced and substantially improves calibration and outperforms competing methods.
D. Bani-Harouni, Chantal Pellegrini, Julian Lüers et al.· arXiv.org· 0 citations
It is shown that sampled semantic distributions can be distilled into lightweight student models which estimate a prompt-conditioned density before the language model generates an answer token, which can serve as a general framework for distilling predictive uncertainty in complex output spaces beyond language.
Edward Phillips, Sean Wu, Fredrik K. Gustafsson et al.· arXiv.org· 4 citations
Although Multimodal Large Language Models (MLLMs) have shown remarkable potential in Visual Document Retrieval (VDR) through generating high-quality multi-vector embeddings, the substantial storage overhead caused by representing a page with thousands of visual tokens limits their practicality in real-world application...
Jiahao Huo, Yu Huang, Yibo Yan et al.· 0 citations
Large language models are known to hallucinate, generating linguistically plausible but incorrect answers to questions. Uncertainty quantification has been proposed as a strategy to detect such behaviour, but existing methods lack a unified framework to assess reliability at both the prompt and answer level. We introdu...
Edward Phillips, Sean Wu, Soheila Molaei et al.· 0 citations
SafetyFlow is introduced, the first agent-flow system designed to automate the construction of LLM safety benchmarks, and includes the first fully automated benchmarking pipeline and a comprehensive safety benchmark.
Xiang-Yang Zhu, Yuan Tian, Chunyi Li et al.· arXiv.org· 3 citations
MultiViewDx, a partly physician-validated multimodal instruction dataset for evidence-linked multi-view medical imaging diagnosis, is introduced and Controlled ablations and clinician evaluation show that both case-level multi-view organization and evidence-linked reasoning targets contribute to the gain.
Jun-Da Wang, Zonghai Yao, Yujan Ting et al.· Transactions of the Associat...· 2 citations· ⚡1
An evaluation framework that measures agents' empirical and normative expectations in addition to behavioral convergence is introduced, offering designers of multi-agent systems a principled basis for selecting the social processes that sustain cooperation.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.