ConCapGAN, a GAN-based medical report generation framework with a visual manifold graph (VMG), a zero-centered Wasserstein regularizer, and a language-style constraint is proposed, which achieves competitive natural language generation performance and improved clinical efficacy compared with recent report generation methods.
Abstract
Medical report generation aims to reduce the reporting burden of radiologists by translating medical images into clinically meaningful descriptions. Although generative adversarial networks (GANs) have shown potential for image captioning and report generation, their application to radiology reports remains challenging because radiology text requires standardized negative expressions, adversarial training may be unstable, and lexical metrics alone cannot fully reflect clinical utility. To address these issues, we propose ConCapGAN, a GAN-based medical report generation framework with a visual manifold graph (VMG), a zero-centered Wasserstein regularizer, and a language-style constraint. The VMG explicitly models object–predicate associations between detected image regions and report semantics, thereby helping represent clinically important positive and negative findings. The zero-centered regularizer improves the local stability of adversarial optimization under clearly stated assumptions, and the language-style constraint encourages reports to follow clinician-like phrasing without introducing an additional large language module. Experiments on IU X-Ray, MIMIC-CXR, and LGK show that ConCapGAN achieves competitive natural language generation performance and improved clinical efficacy (as measured by several diagnostic metrics) compared with recent report generation methods.
The study shows that apparent competence under a single protocol can conceal transfer, alignment, and shortcut-related failure modes, motivating stress-tested evaluation of medical VLMs under distribution shift.
A. Bouaziz, Lokmane Chebouba, Yassine Himeur· 0 citations
Chest X-ray report generation systems are valuable for assisting disease diagnosis and improving healthcare efficiency. However, existing methods still face two key challenges. First, multiple diseases often co-occur, leading to a combinatorial explosion of label combinations and sparse supervision for learning a gener...
Hong-Ze Zhu, Hong Liu, Ya-Wen Huang et al.· IEEE Transactions on Medical...· 0 citations
Reliable clinical deployment of deep medical image models is hindered by distribution shifts across scanners, sites, and acquisition protocols. Existing domain generalization (DG) methods often focus on style or intensity diversification, but they can still leave networks dependent on domain-specific texture correlatio...
Ahmed Sharshar, Asif Hanif, Naveen Kumar Kummari et al.· International Conference on...· 0 citations
GAN-based image translation has been widely used for cross-domain medical image synthesis. However, most existing methods follow a one-to-one mapping paradigm, requiring a separate model for each target domain and increasing the training cost in multi-target tasks such as multi-sequence MRI synthesis. Although recent o...
Jinhao Li, Kai Hu, Runze Wang et al.· Computerized Medical Imaging...· 0 citations
It is demonstrated that mutual information regularization contributes to improved training stability, controllable generation, and more interpretable latent representations in GAN-based image generation.
Findings establish joint-embedding predictive generation as a promising direction for 3D medical image synthesis and encourage further research in this direction.
Meng Zhou, Wen-Hao You, Yu-Xin Chen et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.