Skip to content

ActiveMedAgent: Cost-Aware Trajectory Learning for Multimodal Medical Diagnosis

Oct 2026 · 0 citations · 52 references
Computer Science

TL;DR

In 175 cases, the agent produces a correct diagnosis with fewer channels while the full-modality baseline fails, showing that learning what to omit can be as important as learning what to acquire.

Abstract

Clinical diagnosis is inherently sequential: clinicians escalate from cheap to costly tests only when additional evidence is expected to resolve diagnostic uncertainty. We present ActiveMedAgent, a framework that brings this cost-aware sequential logic to multimodal medical AI. Given a frozen, API-accessed vision-language model, ActiveMedAgent tracks probability distributions over candidate diagnoses and scores each acquisition by its per-step diagnostic utility minus cost. A lightweight MLP controller is then trained offline on these scored trajectories, learning when to request additional evidence and when to commit. Across three commonly used benchmarks, trajectory-based policy learning consistently outperforms both unguided acquisition and full-modality baselines. Notably, we identify an information overload effect. In 175 cases, the agent produces a correct diagnosis with fewer channels while the full-modality baseline fails, showing that learning what to omit can be as important as learning what to acquire.

View source

Similar papers

Preprint Sep 2026

From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning

Foundation models can serve as clinical agents through tool-use harnesses. However, conventional medical benchmarks assess reasoning over preselected evidence rather than the ability to seek it across clinical records and longitudinal imaging. We propose CASE: a series of role-specific Clinical Agents for Seeking Evide...

Min-Ye Shao, Chao-Hui Yu, Yi-Xuan Wu et al. · 0 citations
Preprint Aug 2026

CDEG: Learning Decision-Critical Evidence for Long-Horizon Diagnostic Agents

CDEG, a graph-based framework that learns reusable decision-critical evidence from historical diagnostic trajectories, is introduced, demonstrating that reliable long-horizon diagnosis requires moving beyond trajectory-level experience reuse toward evidence-level learning of the factors that truly shape clinical decisi...

Xi-Wei Dai, Zi-Jie Meng, Zhiting Fan et al. · 0 citations
Preprint Aug 2026

EviDx: Evidence-Aware Active Diagnosis with Scaffolded LLM Agents

EviDx is introduced, an evidence-aware active diagnosis framework that pairs patient-specific diagnostic environments with a clinical diagnostic scaffold and an observer-guided runtime harness that improves diagnostic performance and process stability while revealing model-dependent capability boundaries.

Lihang Zeng, Shao-Ting Zhang, Xiao-Fan Zhang · 2 citations
#artificial intelligence Preprint Sep 2026

Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent

MedTraj is proposed, a framework that treats reasoning trajectories as critical objects for construction, evaluation, and optimization, and quality-weighted context learning feeds trajectory evaluations back into the model at inference time, allowing it to learn from both strong and weak reasoning demonstrations.

Yun-Qi Zhu, Wen Tang, Jing-Hao Niu et al. · 0 citations
#artificial intelligence Review Oct 2026

TrustMed-RL: Long-Horizon Reinforcement Learning for Evidence-Grounded Clinical Diagnosis

Medical language models can produce correct diagnoses despite incomplete investigations and unsupported reasoning. To support long-horizon, evidence-grounded diagnosis, we introduce \textbf{TrustMed-RL}. Built from PubMed rare-disease cases and over 24,000 manually annotated image panels, it integrates interviews, exam...

Wen-Xin Zhan, Yi-Zheng Jiao, Hai-Feng Song et al. · 0 citations
Preprint Sep 2026

From Image Interpretation to Clinical Reasoning: Upstream Physician-Context-Aware Multimodal Learning with Causal Reinforcement Learning

Major adverse cardiovascular events (MACE) remain the leading cause of mortality worldwide. Opportunistic screening using routinely acquired clinical data offers a scalable approach for identifying high-risk individuals before acute events occur. Although chest X-rays (CXRs) capture latent cardiovascular biomarkers and...

Jia-Lu Pi, Ya-Nan Ma, Wei-Jie Chen et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.