Skip to content
Open access

Hybrid Ensemble and Imbalance-Aware Machine Learning for Multi-Class Cardiovascular Disease Severity Prediction

Aug 2026 · Applied Sciences · 0 citations · 32 references

TL;DR

The results demonstrate the potential of imbalance-aware heterogeneous ensembles for robust multi-class heart-disease prediction, while the proposed confidence-aware voting strategy provides an explicit mechanism for resolving classifier disagreement.

Abstract

Cardiovascular disease prediction using structured clinical data is commonly formulated as a binary classification problem, while multi-class prediction is more challenging because of overlapping clinical characteristics and class imbalance. This study presents a hybrid ensemble and imbalance-aware machine-learning framework for binary and five-class heart-disease prediction using the combined UCI Heart Disease dataset comprising 920 records from Cleveland, Hungary, Switzerland, and VA Long Beach. Six classifiers—k-Nearest Neighbors, Decision Tree, Logistic Regression, Support Vector Machine, Random Forest, and XGBoost—are evaluated together with majority-voting and stacking ensembles. To address the highly imbalanced five-class distribution, SMOTE is applied exclusively to the training folds during stratified cross-validation. A confidence-aware hierarchical voting mechanism is also introduced to resolve classifier disagreements by retaining majority decisions when consensus exists and using posterior-confidence information in ambiguous cases. On the original imbalanced five-class data, XGBoost achieves the highest accuracy of 86.74%. After SMOTE-based balancing, stacking achieves the best overall performance, with 94.94% accuracy, 94.92% precision, 94.94% recall, and 94.92% F1-score, closely followed by majority voting. Feature-importance analysis identifies chest-pain type, maximum heart rate, ST depression, and number of major vessels as influential predictive attributes. The results demonstrate the potential of imbalance-aware heterogeneous ensembles for robust multi-class heart-disease prediction, while the proposed confidence-aware voting strategy provides an explicit mechanism for resolving classifier disagreement.

Read PDF

Similar papers

Open access Aug 2026

A HYBRID ANN-XGBOOST FRAMEWORK FOR EARLY DIABETES RISK PREDICTION UNDER CLASS IMBALANCE: EXTERNAL CLINICAL VALIDATION IN AN AFRICAN HEALTHCARE SETTING

This study proposes a Hybrid ANN-XGBoost framework for early diabetes risk prediction under class-imbalanced conditions that combines the nonlinear feature representation capability of Artificial Neural Networks with the gradient boosting classification mechanism of XGBoost.

Djiwa Ntela Oga, P. Houngue, Cheikh Sarr · 0 citations
Open access Sep 2026

Group-Aware and Explainable Machine Learning Framework for Heart Disease Prediction Using Optimized CatBoost

Accurate and reliable heart disease prediction can support early risk assessment and improve clinical decision-making. However, repeated or duplicate observations in widely used heart disease datasets can introduce data leakage and lead to overly optimistic performance estimates. This study proposes a duplicate-aware a...

Romaan Khan, Tufail Khan, Muhammad Tahir et al. · 0 citations
Open access Sep 2026

Predicting the Classification of Heart Failure Patients Using Optimized Machine Learning Algorithms

A machine learning-driven framework developed using the healthcare-dataset-stroke-data, comprising diverse clinical attributes associated with cardiovascular conditions, improves both prediction accuracy and model transparency in heart failure classification.

Anton Musthafa, B. C. Krishna · 0 citations
Open access Aug 2026

Hybrid explainable machine learning for population level cardiovascular disease risk prediction using satellite environmental data

A Hybrid Explainable Artificial Intelligence and Machine Learning (HXAI-ML) framework for area-level CVD risk prediction using health-related and satellite-derived environmental data at the Core-Based Statistical Area (CBSA) level is proposed.

I. Hossain, Kazi Md. Tanvir Anzum, Jarin Tasnim Mumu · 0 citations
Open access Aug 2026

A Hybrid GA-KNN Framework For Cardiovascular Disease Prediction Using Optimized Clinical Feature Selection

An optimized hybrid approach of the genetic algorithm and K-nearest neighbor method for cardiovascular disease prediction is proposed and it is demonstrated that optimized GA-KNN can achieve both feature dimensions for the initial screening of cardiovascular diseases.

Banibrata Paul, Bhaskar Karn · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.