G-CARL, a grounded, checklist-aligned reinforcement learning framework that combines multi-source retrieval for atomic claim verification with context-aware, instance-specific weighted checklists for response coverage, providing structured supervision for factuality, user-demand satisfaction, and expression quality without constraining response diversity is proposed.
Abstract
Personalized interpretation of medical reports has emerged as an increasingly important need among patients. Addressing this need requires both evidence-grounded medical factuality and context-dependent patient communication, yet existing medical vision-language tasks do not adequately capture these dual requirements. To bridge this gap, we introduce Patient-oriented Medical Report Interpretation (PMRI), a novel open-ended multimodal generation task that requires models to explain medical reports in accurate and accessible language based on a user's query and dialogue history. These two objectives differ fundamentally in their verifiability, yet remain tightly coupled, making them difficult to optimize jointly under conventional supervised fine-tuning and holistic reinforcement learning paradigms. To address this challenge, we propose G-CARL, a grounded, checklist-aligned reinforcement learning framework that combines multi-source retrieval for atomic claim verification with context-aware, instance-specific weighted checklists for response coverage, providing structured supervision for factuality, user-demand satisfaction, and expression quality without constraining response diversity. We further construct MMedReport, a real-world PMRI benchmark, along with a clinician-designed three-dimensional evaluation protocol. Extensive experiments demonstrate that G-CARL consistently outperforms existing post-training baselines in overall quality, claim-level precision, and checklist recall. Pairwise preference evaluation by clinicians further confirms that G-CARL produces interpretations that are more accurate and better aligned with patient needs.
R risk-Calibrated Reinforcement Fine-Tuning addresses this mismatch by making severity an explicit signal in reinforcement learning rather than an after-the-fact evaluation stratum, indicating that the method favors positive association between utility and case severity rather than simple reward amplification.
Experiments on OmniMedVQA subsets show that Med-OPD consistently outperforms SFT and standard OPD across CT, MRI, Disease Diagnosis, and Lesion Grading, and demonstrate that evidence-aware distillation can better strengthen medical VLMs'reliance on key visual evidence and improve reliable multimodal medical reasoning.
Yun-Hang Qian, Jiaquan Yu, Jiawei Liu et al.· arXiv.org· 1 citation
DPO-Clin is proposed, a novel post-training framework that focuses preference optimization on clinical findings and cross-modal alignment and achieves superior performance over existing DPO-based MRG methods, exhibiting robust generalizability across distinct baseline architectures and diverse medical imaging modalitie...
Qiang Hu, Yuxuan Luo, Yingjie Guo et al.· 0 citations
RES-MR is proposed, a novel Risk-aware Reasoning framework for Explainable and Safe Medication Recommendation using LLMs that significantly outperforms state-of-the-art baselines in terms of accuracy, safety, and explainability.
Cong Wang, Jin Li, Shou-Jin Wang et al.· Annual International ACM SIG...· 1 citation
ConRub-Med is introduced to preserve useful distinctions as rubric feedback moves from construction to policy optimization, and ranks first on six of nine benchmarks and achieves the highest medical and generalization averages.
MMHBench is introduced, a comprehensive multimodal benchmark for multi-perspective mental health understanding and a Multi-Agent Question Generation (MAQG) framework that simulates diverse social roles to synthesize questions from multiple perspectives.
Jinpeng Hu, Er-Qiang Wang, Shan A. Wang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.