Skip to content

A CLIP-Based Multimodal Endorectal Ultrasound Model for Predicting Metachronous Liver Metastases in Rectal Cancer.

Aug 2026 · Academic Radiology · 0 citations · 28 references
Medicine

TL;DR

Chinese-CLIP-based integration of multiplanar 3D-ERUS images and reports showed potential for MLM prediction and may further improve risk stratification, warranting larger external validation.

Abstract

Objective

To develop and externally validate a contrastive language-image pretraining (CLIP)-based multimodal model integrating pretreatment multiplanar three-dimensional endorectal ultrasound (3D-ERUS) images and ERUS reports for predicting metachronous liver metastasis (MLM) after radical surgery in rectal cancer.

Methods

This two-center retrospective study included 394 patients with rectal cancer who underwent pretreatment 3D-ERUS within two weeks before treatment and subsequent radical surgery. Patients from center 1 were divided into training (n = 238) and internal validation (n = 102) cohorts, and center 2 served as an external validation cohort (n = 54). MLM occurred in 43, 19, and 5 patients, respectively. Sagittal, coronal, and transverse ERUS images and corresponding reports were encoded using Chinese-CLIP. After feature selection, balanced logistic regression models were developed, and a clinicopathological fusion model was constructed. Performance was assessed using AUC, Brier score, DeLong test, integrated discrimination improvement (IDI), and category-free continuous net reclassification improvement (NRI).

Results

The multimodal model achieved AUCs of 0.779, 0.824, and 0.743 in the three cohorts. The fusion model achieved higher AUCs of 0.812, 0.850, and 0.808. Compared to the clinical model, the fusion model significantly improved IDI and continuous NRI in the training cohort (IDI = 0.085; NRI = 0.647) and internal validation cohort (IDI = 0.114; NRI = 0.865). Compared to the multimodal model, the fusion model further improved IDI in both cohorts.

Conclusion

Chinese-CLIP-based integration of multiplanar 3D-ERUS images and reports showed potential for MLM prediction. Clinicopathological fusion may further improve risk stratification, warranting larger external validation.

View source

Similar papers

Open access Sep 2026

Preoperative prediction of serosal invasion in gastric cancer using multiphase contrast-enhanced CT radiomics

Objective This study aimed to develop and validate a radiomics-based model using multiphase contrast-enhanced CT for the preoperative prediction of serosal invasion in gastric cancer, and to evaluate whether the integration of clinical and CT morphological features could further improve predictive performance. Methods...

Xiao-Jiao Li, Chen-Cui Huang, Teng-Jun Ma et al. · 0 citations
Open access Sep 2026

A Deep Learning Framework Predicts Rectal Cancer Treatment Response via Pretreatment 3D Transrectal Ultrasound: A Multicenter Study

Accurate prediction of pathological complete response (pCR) following neoadjuvant therapy is crucial for personalized treatment planning in patients with locally advanced rectal cancer (LARC). This study aimed to explore the application of 3D transrectal ultrasound (TRUS) for this purpose. In this study, 538 LARC patie...

Min Liu, Yi-Wen Yu, Xue-Bin Zou et al. · 0 citations
Open access Sep 2026

MR-based radiomics of mesorectal fat for improved prediction of perirectal lymph node metastasis and extramural venous invasion in locally advanced rectal cancer

Objective Accurately assessing residual disease after neoadjuvant chemoradiotherapy (nCRT) in locally advanced rectal cancer (LARC) remains challenging. Residual extramural venous invasion (EMVI) and perirectal lymph node (PLN) metastasis indicate adverse outcomes, but treatment-related changes obscure their detection...

Yaniga Swaengdee, S. Khongwirotphan, Jaravee Lasode et al. · 0 citations
Open access Oct 2026

MRI-Based Intratumoral and Multi-Range Peritumoral Radiomics for Predicting Axillary Lymph Node Metastasis in Breast Cancer

Background To determine the best-performing peritumoral boundary among tested distances and evaluate the predictive value of preoperative multiparametric MRI radiomics for axillary lymph node metastasis (ALNM) in breast cancer. Methods Clinical and imaging data of 273 patients from two centers were retrospectively anal...

Bin Chu, T. Zhan, Xing Liu et al. · 0 citations
Open access Sep 2026

A radiomics–deep learning nomogram integrating intratumoral and peritumoral DCE-MRI features for pCR prediction in breast cancer

Background Pathological complete response (pCR) after neoadjuvant systemic therapy (NST) is an important surrogate endpoint for breast cancer prognosis. Reliable pretreatment prediction of pCR remains difficult, as conventional imaging underutilizes the peritumoral microenvironment, including immune infiltration, matri...

Yi-Ru Wang, Hai-Bo Wang, Jian Cui · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.