Skip to content

Enhancing Image-Text Alignment in Chest X-ray Datasets by Reducing External References via a Fine-Tuned Large Language Model Pipeline.

Aug 2026 · Journal of imaging informatics in medicine · 0 citations · 10 references
Medicine

TL;DR

An automated, data quality-oriented preprocessing pipeline that rewrites radiology reports at the sentence level to reduce external references is developed and can serve as an effective preprocessing step for improving the suitability of chest X-ray report datasets for multimodal model development.

View source

Similar papers

Open access Sep 2026

Automated chest X-ray disease screening using large language models and deep convolutional neural networks on the MIMIC-CXR dataset

It is demonstrated that LLMs can be effectively employed to generate supervision labels for medical imaging tasks and that the proposed approach offers a scalable and low-cost solution for preliminary disease screening, particularly in healthcare environments with limited expert availability.

Qing-Yuan Zhang, Pardeep Vasudev, Kezhi Li et al. · 0 citations
Open access Sep 2026

A framework for extraction of clinical information from radiological mammography reports using large language models and retrieval augmented generation

A structured Retrieval-Augmented Generation (RAG) framework that leverages annotated mammography reports as in-context demonstrations, enabling joint named entity and relation extraction without task-specific fine-tuning is proposed and achieves performance comparable to fine-tuned BETO models in low-resource settings,...

Eduardo Godoy, J. De Ferrari, Sofia Lazo et al. · 1 citation · ⚡1
Sep 2026

Comorbidity-Aware Radiology Report Generation.

Chest X-ray report generation systems are valuable for assisting disease diagnosis and improving healthcare efficiency. However, existing methods still face two key challenges. First, multiple diseases often co-occur, leading to a combinatorial explosion of label combinations and sparse supervision for learning a gener...

Hong-Ze Zhu, Hong Liu, Ya-Wen Huang et al. · 0 citations
Open access Sep 2026

Dual-branch cross-modal architecture with global-to-local feedback for radiographic image–text retrieval in chest X-rays

Through hierarchical gated co-attention, this approach dynamically aligns image and text representations, addressing the limitations of static fusion and providing a foundation for interpretable, real-time retrieval systems that can accelerate and improve clinical decision support.

Rezaul Abedin, Sofiane Laridi, Kam-Ming Mark Tam · 0 citations
Preprint Aug 2026

HarMoE: Multi-Source Chest Radiograph Pretraining with Dataset-Disentangled Experts

Recent vision-language models for chest X-ray understanding are largely built on image-report alignment and therefore rely heavily on MIMIC-CXR as the dominant pretraining source. While effective at scale, this paradigm underexplores an important alternative source of supervision: a range of existing multi-label classi...

Haozhe Luo, Zi-Yu Zhou, Shelley Zixin Shu et al. · 0 citations
Dataset Open access Aug 2026

PatchChestCT: A patch-level spatial annotation dataset for nine abnormalities in chest CT

This work introduces a token-aligned annotation scheme that is efficient, scalable, and naturally integrates with modern deep learning architectures like Transformers, and shows that models trained with this scheme achieved higher localization performance than weakly supervised baselines trained on image-level labels a...

Yingtai Li, Hong-Chun Zhang, Meng-Yao Xu et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.