Skip to content
Open access

Development and prospective evaluation of a machine learning model to predict serious cardiac outcomes among paediatric cardiac inpatients

Aug 2025 · BMJ digital health & AI · Vol 1, pp. e000114 · 3 citations · 39 references
Medicine

TL;DR

An ML model is created to predict serious cardiac outcomes using a deployment-aware framework leveraging real-world data and the best-performing model in the retrospective phase was LightGBM trained on all inpatients.

Abstract

Objectives Objectives were to develop a machine learning (ML) model based on electronic health record data to predict the risk of a serious cardiac outcome within the next 3 months among patients admitted to the cardiology service using retrospective data, and to evaluate the model prospectively in a silent trial (predictions not provided to clinicians). Methods and analysis Admissions between 2 June 2018 to 21 August 2023 (retrospective) and 10 May 2024 to 26 October 2024 (prospective) to the cardiology service were included. Data were a curated and validated source named SickKids Enterprise-wide Data in Azure Repository. Prediction time was the morning following admission. The label was a composite outcome consisting of ventricular assist device procedure, heart transplant waitlisting or death within 3 months. We trained models using L2-regularised logistic regression, LightGBM and XGBoost. Training cohorts include the target cohort and all inpatient admissions. Results The best-performing model in the retrospective phase was LightGBM trained on all inpatients. There were 51 571 admissions used for model development in the retrospective phase and 515 admissions in the prospective silent trial. The number of features in the final model was 7553. The area under the receiver operating characteristic curve was 0.88 (95% CI 0.88 to 0.89) for retrospective and 0.82 (95% CI 0.79 to 0.83) for prospective silent trial phases. Based on a threshold selected during the retrospective phase, silent trial positive and negative predictive values were 0.19 and 0.97, respectively. Conclusions We created an ML model to predict serious cardiac outcomes using a deployment-aware framework leveraging real-world data. Postdeployment evaluation will be an important future goal.

Read PDF

Similar papers

Open access Oct 2026

Predicting pneumonia death in patients with heart failure using explainable machine learning model in a territory-wide electronic health record cohort

XGBoost achieved strong discrimination for predicting pneumonia death and identified clinically coherent risk drivers through SHAP, which supports the potential utility of explainable machine learning for risk stratification and earlier escalation of care in HF populations.

Y. Qi, Q. Ren, A. Mastumoto et al. · 0 citations
Open access Oct 2026

AI/ML models for heart failure in-hospital mortality prediction using RWE: a retrospective cohort

Abstract Background Heart failure (HF) represents a major public health challenge in Portugal, associated with high mortality and healthcare costs. This study aimed to develop and validate artificial intelligence models to predict in-hospital mortality among HF patients at the Baixo Alentejo Local Health Unit, using in...

J. Diniz, S. Duarte, A. Dionísio et al. · 0 citations
Open access Sep 2026

Development and Validation of an Interpretable Machine Learning-Based Prediction Model of Sepsis: A Retrospective Multicenter Cohort Study.

Although the model shows potential for identifying high-risk individuals at the 24-hour prediction landmark, further prospective validation and clinical impact assessment are required before routine clinical implementation.

Zhang-Cong Lu, Ling-Han Hu, Peng-Fei Shui et al. · 0 citations
Open access Oct 2026

Construction and validation of a machine learning-based prediction model for sudden cardiac death in chinese children with hypertrophic cardiomyopathy: a multicenter retrospective study

A clinically applicable machine learning model demonstrating excellent predictive performance for SCD risk in Chinese children with HCM is developed and independently validated.

B. Han, Y. Meng · 0 citations
Open access Sep 2026

Development and external validation of an interpretable machine learning model for early prediction of in-hospital mortality in neurocritical care

Background Early risk assessment is a routine part of neurocritical care, yet mortality prediction remains difficult because neurological injury often coexists with respiratory, circulatory, renal, and inflammatory dysfunction. This study aimed to develop and externally validate an interpretable machine learning (ML) m...

Xiao Cheng, Jian-Xin Ye, H. Wei · 0 citations
Open access Oct 2026

Explainable machine learning for predicting in-hospital mortality in acute heart failure: a prospective single-center cohort study from Vietnam

Background Accurate risk stratification is essential in acute heart failure (AHF), which carries substantial in-hospital mortality. The Get With The Guidelines–Heart Failure (GWTG-HF) score is widely used, but its performance may vary across populations, and prospective data from Southeast Asia are scarce. We developed...

Sy Van Hoang, K. Nguyen, T. Nguyen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.