Skip to content

Agentic Foundation Models for Explainable Multimodal Clinical Intelligence: A Human-Centered Framework for Early Disease Diagnosis and Personalized Treatment Planning

Aug 2026 · Natural Resources for Human Health · 0 citations

TL;DR

A framework that treats diagnosis as a coordination problem rather than a modeling one is described and improved on both across accuracy, F1-score, explanation faithfulness and clinician-rated trust, at an added latency of roughly five seconds per case.

Abstract

Diagnostic work rarely rests on one kind of evidence. A clinician assembles the history, the imaging, the laboratory panel and, increasingly, genomic results, and does so under time pressure. Large language models perform well on each of these in isolation, yet most deployed systems still reason over a single modality, produce explanations after the fact rather than from the evidence actually used, and give the clinician no route to contest an output. This paper describes a framework that treats diagnosis as a coordination problem rather than a modeling one. Perception agents handle text, imaging and structured data separately; an orchestrator decomposes the task and routes sub-tasks among specialist agents; and a distinct explanation agent is queried after each recommendation to retrieve the inputs that drove it. Because that agent runs independently of the diagnostic pathway, its output is less likely to be a rationalization of an answer already reached. We evaluate on a pilot cohort of three cases drawn from the dataset comparing against a zero-shot baseline and a text-only specialist model. The framework improved on both across accuracy, F1-score, explanation faithfulness and clinician-rated trust, at an added latency of roughly five seconds per case. These are feasibility results from a small cohort, and we set out the prospective validation that would be needed before any claim of clinical readiness.

View source

Similar papers

#software testing Review Sep 2026

Agentic AI in Medicine: Challenges for Responsible Development and the Case for Clinical Testing Harnesses

It is argued that each of the four challenges facing responsible development is addressed by a clinical testing harness: a structured evaluation environment comprising scenario libraries built from clinical edge cases, full-trajectory observability, explicit escalation testing, and staged evidence thresholds tied to sc...

E. Waisberg, Joseph W. Guarnieri · 1 citation
#artificial intelligence Preprint Sep 2026

A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support

Debate-Mixture-of-Agents (DMoA), a novel multi-agent framework that structures role-based interaction to support iterative diagnostic reasoning, is developed and demonstrated the potential of DMoA for clinical tasks and suggests further investigation of multi-agent frameworks.

Chang-Da Xia, L. Ouyang, Hui-Min Wang et al. · 0 citations
Open access Aug 2026

Grounding Health AI: Architecture and Evaluation of a Domain-Expert Metabolic Health Agent

This work describes the HPP Personal Health Agent, a metabolic health agent that grounds generation in four layers: the Human Phenotype Project, a deep-phenotyped cohort of 13,000+ participants supplying population references and trained predictive models; 21 domain-expert tools and trained-model wrappers that compute...

A. Diament, G. Sapir, M. Gorodetski et al. · 0 citations
#machine learning Preprint Aug 2026

MSM-Mem: A Universal Medical Structured Multimodal Memory Framework for Medical AI Agents

Medical Structured Multimodal Memory (MSM-Mem), an agentic memory framework that enables medical AI agents to evolve through accumulated clinical experiences, is proposed, offering a viable pathway toward medical AI agents capable of evolving their reasoning competence in a manner analogous to the way clinicians learn...

M. Jabin, K. Lê, Lin Zhao et al. · 0 citations
Preprint Aug 2026

Social Chain of Thought: A Multi-Agent Architecture Grounded in Medical Differential Diagnosis Methodology

Medical diagnostic reasoning is a high-impact use case for LLMs that carries significant implications for the health and wellbeing of users. When OpenAI (2026) reports that more than 5% of ChatGPT messages globally are healthcare-related, the transparency of these systems becomes a serious design concern. This is espec...

Del Coburn, Scott Sanner, Daniel A. Silver · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.