Skip to content
Open access

Convergent Generative Adversarial Networks for Medical Report Generation With Visual Manifold Graph

2026 · IEEE Access · Vol 14, pp. 125323-125339 · 0 citations · 46 references
Computer Science

TL;DR

ConCapGAN, a GAN-based medical report generation framework with a visual manifold graph (VMG), a zero-centered Wasserstein regularizer, and a language-style constraint is proposed, which achieves competitive natural language generation performance and improved clinical efficacy compared with recent report generation methods.

Abstract

Medical report generation aims to reduce the reporting burden of radiologists by translating medical images into clinically meaningful descriptions. Although generative adversarial networks (GANs) have shown potential for image captioning and report generation, their application to radiology reports remains challenging because radiology text requires standardized negative expressions, adversarial training may be unstable, and lexical metrics alone cannot fully reflect clinical utility. To address these issues, we propose ConCapGAN, a GAN-based medical report generation framework with a visual manifold graph (VMG), a zero-centered Wasserstein regularizer, and a language-style constraint. The VMG explicitly models object–predicate associations between detected image regions and report semantics, thereby helping represent clinically important positive and negative findings. The zero-centered regularizer improves the local stability of adversarial optimization under clearly stated assumptions, and the language-style constraint encourages reports to follow clinician-like phrasing without introducing an additional large language module. Experiments on IU X-Ray, MIMIC-CXR, and LGK show that ConCapGAN achieves competitive natural language generation performance and improved clinical efficacy (as measured by several diagnostic metrics) compared with recent report generation methods.

Read PDF

Similar papers

Sep 2026

Comorbidity-Aware Radiology Report Generation.

Chest X-ray report generation systems are valuable for assisting disease diagnosis and improving healthcare efficiency. However, existing methods still face two key challenges. First, multiple diseases often co-occur, leading to a combinatorial explosion of label combinations and sparse supervision for learning a gener...

Hong-Ze Zhu, Hong Liu, Ya-Wen Huang et al. · 0 citations
#machine learning Open access Oct 2026

PhaseAT: Fourier Phase Adversarial Training for Medical Image Domain Generalization

Reliable clinical deployment of deep medical image models is hindered by distribution shifts across scanners, sites, and acquisition protocols. Existing domain generalization (DG) methods often focus on style or intensity diversification, but they can still leave networks dependent on domain-specific texture correlatio...

Ahmed Sharshar, Asif Hanif, Naveen Kumar Kummari et al. · 0 citations
Aug 2026

SOM-GAN: A structure-preserving one-to-multiple generative adversarial network for unpaired medical image synthesis.

GAN-based image translation has been widely used for cross-domain medical image synthesis. However, most existing methods follow a one-to-one mapping paradigm, requiring a separate model for each target domain and increasing the training cost in multi-target tasks such as multi-sequence MRI synthesis. Although recent o...

Jinhao Li, Kai Hu, Runze Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.