PatchChestCT: A patch-level spatial annotation dataset for nine abnormalities in chest CT
TL;DR
This work introduces a token-aligned annotation scheme that is efficient, scalable, and naturally integrates with modern deep learning architectures like Transformers, and shows that models trained with this scheme achieved higher localization performance than weakly supervised baselines trained on image-level labels alone, across multiple architectures.
Abstract
The development of generalist artificial intelligence (AI) models for radiology is hindered by a lack of large-scale, three-dimensional (3D) imaging datasets with precise spatial annotations. While numerous datasets provide image-level labels for chest computed tomography (CT), these are insufficient for training models that can accurately localize findings. To address this gap, we present PatchChestCT, a large-scale, publicly available dataset for multi-abnormality localization in non-contrast chest CT. Using CT-RATE as the source cohort, PatchChestCT provides 3D patch-level annotations for nine clinically significant abnormalities across 2,201 physician-reviewed CT studies, with one reconstructed volume labeled per study. We introduce a token-aligned annotation scheme that is efficient, scalable, and naturally integrates with modern deep learning architectures like Transformers. To validate the dataset’s utility, we show that models trained with our patch-level labels achieved higher localization performance than weakly supervised baselines trained on image-level labels alone, across multiple architectures. PatchChestCT provides a public resource for training localization-aware models in chest CT.