Skip to content

Evidence-Based Intelligent Diagnostic and Therapeutic Visualization System with Large Language Models: Multi-Turn Interaction and Multimodal Treatment Plan Generation

Jun 2026 · arXiv.org · Vol abs/2606.06869 · 0 citations · 39 references
Computer Science

TL;DR

The proposed knowledge-enhanced visual diagnostic system enhances the transparency of traditional Chinese medicine diagnostic reasoning and the interpretability of treatment plans through knowledge graph-driven visualization and multimodal interaction, offering a practical solution for trustworthy artificial intelligence-assisted traditional Chinese medicine applications.

Abstract

Aim: Existing AI-assisted traditional Chinese medicine diagnostic tools suffer from opaque reasoning processes, passive interaction, and limited treatment plan presentation. This study proposes a knowledge-enhanced visual diagnostic system to improve the transparency and interpretability of syndrome differentiation and treatment. Methods: The system is built upon a Neo4j knowledge graph comprising 241 syndromes, 1,263 symptoms, and 2,485 relations. It incorporates a four-stage symptom matching pipeline (exact, semantic, fuzzy, and large language model verification), an information gain-driven proactive questioning strategy optimized with genetic algorithms, and a multimodal treatment presentation integrating artificial intelligence-generated illustrations, three-dimensional meridian-acupoint models, and evidence-based literature. Results: Knowledge graph constraints reduced non-standard outputs by 32%. Case studies validated the effectiveness of the interactive workflow across patient self-assessment, clinician-assisted diagnosis, and traditional Chinese medicine education. Automated paired-comparison evaluation across 30 cases further demonstrated significant improvements in diagnostic trust (Cohen's d = 1.82, p<0.001), reduced cognitive load (improvements in four of five dimensions), and higher credibility of evidence-based references (4.21 vs. 2.95). Conclusions: The proposed system enhances the transparency of traditional Chinese medicine diagnostic reasoning and the interpretability of treatment plans through knowledge graph-driven visualization and multimodal interaction, offering a practical solution for trustworthy artificial intelligence-assisted traditional Chinese medicine applications.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation

Experiments on BUS-CoT and IU X-ray datasets demonstrate consistent improvements in diagnostic accuracy, concept consistency, and report quality over strong general-purpose and medical MLLMs, indicating that concept-grounded reasoning better aligns generation with clinical decision processes.

Xin-Yue Xu, Hong-Bin Lin, Juan-Gui Xu et al. · 0 citations
Review Open access Sep 2026

Advances in Multimodal Artificial Intelligence in Radiology: Data Integration, Foundation Models, and Clinical Applications—A Narrative Review

Background/Objectives: Multimodal artificial intelligence (AI) is increasingly used in radiology to combine medical images with radiology reports, clinical narratives, structured health records, laboratory measurements, and other patient data. These systems may support more context-aware interpretation, reporting, and...

G. Alfattni · 0 citations
Conference Aug 2026

From OCR to Multimodal Reasoning: A Comprehensive Study of Clinical Document Understanding

Digitization of medical records stands out among the most critical obstacles in contemporary medicine due to the unstructured nature of most of the collected clinical data. The traditional approach to text mining and optical character recognition (OCR) proves inefficient when processing the complex seman tics of textua...

Akash Deepak, Varad Bhutada, Rupam Agrawal et al. · 0 citations
Sep 2026

Prototype-guided Multimodal Retrieval for Knowledge-assisted Interventional Radiology.

Experimental results show that PRIMA consistently improves generation quality, question-answering accuracy and expert-rated clinical interpretability compared with existing RAG baselines, demonstrating the effectiveness of clinically grounded prototype-guided retrieval for multimodal knowledge assistance in interventio...

Jing-Xiong Li, Cheng-Lu Zhu, Yuxuan Sun et al. · 0 citations
#natural language process... Preprint Sep 2026

MedTRACE: Tool-Augmented Multimodal Clinical Reasoning Agents for Evidence-Grounded Decision-Making

Multimodal clinical decision-making requires reliable reasoning over heterogeneous evidence from electronic health records, medical images, and physiological signals. Existing models typically map these inputs directly to diagnoses without explicitly assessing evidence sufficiency, tool-use requirements, or diagnostic...

Ji Lu, Li-Fei Liu, Hao-Ran Yu et al. · 0 citations
Open access Aug 2026

Exploration of the Application Mode of Artificial Intelligence Assisted Evidence Based Medicine Collaborative Teaching

Modern generative artificial intelligence technologies are fundamentally reshaping the pedagogical paradigm of evidence-based medicine (EBM). This article systematically articulates the mechanisms by which AI augments EBM instruction—encompassing large language models, knowledge graphs, and rule engines—with a specific...

Dai Qian, Wei Ke, Zheng Zhi · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.