Skip to content
Open access

Building Early-Warning Models for Multiclass Credit Risk Staging: A Comparative Study of Random Forest and XGBoost with SMOTENC and Borderline-SMOTE

Aug 2026 · Jurnal Teknik Informatika (Jutif) · Vol 7, pp. 3146-3164 · 0 citations

TL;DR

The contribution is a controlled out-of-fold benchmark of imbalance strategies for mixed-type tabular credit staging, providing a reproducible evaluation protocol for financial informatics and imbalanced multiclass learning.

Abstract

This paper develops and evaluates an early-warning credit risk classifier using a three-class formulation that distinguishes performing loans (L), delinquent accounts (DP), and non-performing loans (NPL). Early-warning modeling is challenging because deterioration events are relatively infrequent, yielding class imbalance and asymmetric error costs where missed NPL cases are particularly consequential. The study aims to build and compare operationally feasible models that improve NPL identification while maintaining reliable performance across all classes. Experiments use 2,253 loan records with 20 early-warning predictors and compare Random Forest and XGBoost under four imbalance-handling strategies: a no-resampling baseline, class/sample weighting, SMOTENC, and Borderline-SMOTE. Performance is estimated via stratified 5-fold cross-validation, with out-of-fold predictions aggregated for consistent fold-robust evaluation and probability-based diagnostics. Evaluation emphasizes imbalance-aware criteria, including macro F1, balanced accuracy, NPL precision/recall/F1, and ranking metrics for NPL versus non-NPL (PR-AUC and ROC-AUC), complemented by agreement statistics (Cohen’s kappa and Matthews correlation coefficient). Results show that class-sensitive metrics reveal clearer differences among strategies than global measures, with XGBoost combined with SMOTENC achieving the strongest NPL-oriented performance (recall 0.7389; F1 0.8035; PR-AUC 0.8780; ROC-AUC 0.9434). The contribution is a controlled out-of-fold benchmark of imbalance strategies for mixed-type tabular credit staging, providing a reproducible evaluation protocol for financial informatics and imbalanced multiclass learning.

Read PDF

Similar papers

Conference Open access Sep 2026

Credit Default Prediction Using Logistic Regression and XGBoost: A Multi-Scenario Evaluation with SHAP-Based Interpretability Analysis

This study compares Logistic Regression (LR) and Extreme Gradient Boosting (XGB) for credit default prediction using 554,349 fintech loan records with a 7.95 percent default rate. Twelve scenarios covered 70-to-30 and 80-to-20 train-test splits, under both imbalance conditions, plus out-of-time validation from October...

Keiza Julita, J. Hefni, Helena Margaretha et al. · 0 citations
Conference Sep 2026

Borderline-SMOTE for Imbalanced Credit Default Prediction Using Malaysian Banking Data

Credit risk prediction is challenged by severe class imbalance, where standard classifiers achieve misleadingly high accuracy while failing to detect actual defaults. Most existing studies apply imbalance handling techniques without analyzing whether the chosen technique matches the underlying data structure. This stud...

Lin-Yi-Hua Lim, Chee-Nian Lee · 0 citations
Open access Oct 2026

Cost-Sensitive Ensemble Models for Microcredit Risk Prediction: A Comparative Evaluation

Microcredit risk prediction is challenged by class imbalance and asymmetric misclassification costs. This study evaluates cost-sensitive ensemble models and examines model-selection stability across heterogeneous credit sources. Logistic Regression, Random Forest, XGBoost, and CatBoost were evaluated on one operational...

R. Reliya, A. Muzakir · 0 citations
Open access 2026

Model-Dependent Calibration Effects of Imbalance Handling in Credit Card Fraud Detection

Class imbalance correction methods such as class weighting and synthetic oversampling are widely used to improve fraud detection, but they can distort the probability estimates that risk scoring depends on. This study evaluates the calibration cost of two common imbalance handling strategies, inverse frequency class we...

I'tishom Al Khoiry, Ika Menarianti, S. S. Akbar et al. · 0 citations
Review Open access Sep 2026

Cross-Domain Uncertainty Evaluation in Predictive Analytics: Credit Default and Customer Churn

This study develops and evaluates a cross-domain, probability-based framework for evaluating uncertainty in predictive analytics. Although predictive models widely support decision-making, many models are evaluated mainly using accuracy-based indicators that do not show whether predicted probabilities are reliable, cal...

Heitor Gabriel da Silva Valente, Etelka Éva Katits · 0 citations
Open access Oct 2026

Impact of Normalization Methods on Credit Risk Classification with Imbalanced Data

This study investigates the effect of two normalization methods, Z-Score and Min-Max, on the performance of Support Vector Machine and Artificial Neural Network classifiers for imbalanced credit risk prediction, and provides empirical guidance for selecting optimal preprocessing strategies in imbalanced financial class...

Ahmad Abil Rizky Ramadhan, Gusti Wiwik Nur Afifa, M. Barata et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.