Skip to content
Open access

An Explainable Multi-Criteria Decision-Making Framework for Evaluating Malware Detection Models Across Heterogeneous Datasets

Sep 2026 · Mathematical and Computational Applications · Vol 31, pp. 184 · 0 citations · 30 references

TL;DR

An explainability-aware hybrid multi-criteria decision-making (MCDM) framework that systematically evaluates and ranks malware detection models across heterogeneous malware datasets and provides a transparent and multidimensional alternative to conventional performance-centered malware model evaluation is provided.

Abstract

The diversity of today’s malware and the conflicting criteria for predictive performance, computational efficiency, dependability, and interpretability have made the choice of a suitable malware detection model more complicated. Existing research focuses predominantly on predictive performance, while the multidimensional decision process required for practical model selection remains insufficiently addressed. To address this gap, this study provides an explainability-aware hybrid multi-criteria decision-making (MCDM) framework that systematically evaluates and ranks malware detection models across heterogeneous malware datasets. The methodology incorporates predictive performance, computational efficiency, false positive rate, and a composite Explainability Index into a single decision procedure. The Explainability Index integrates explanation stability, sparsity, and expert relevance, enabling interpretability to be explicitly considered in the model-selection process. The hybrid criteria weights are obtained by combining the Analytic Hierarchy Process (AHP) with the entropy weighting method, thereby integrating expert-driven criterion importance with data-driven variability. The final ranking is obtained using the Technique for Order Preference by Similarity to the Ideal Solution (TOPSIS). Four candidate detection models, including Random Forest, XGBoost, Convolutional Neural Network, and Long Short-Term Memory, are independently used to validate the framework on the CIC-MalMem-2022 and CICMalDroid2020 datasets. Under a harmonized evaluation protocol without assuming direct cross-dataset predictive transfer, the experimental results rank XGBoost first with a TOPSIS closeness score of 0.670, followed by Random Forest with 0.624. Sensitivity and ablation analyses further show that the model ranking remains stable while changes in criterion weighting and framework components produce measurable variations in the multi-criteria preference structure. Overall, the framework provides a transparent and multidimensional alternative to conventional performance-centered malware model evaluation.

Read PDF

Similar papers

#explainable ai Open access Oct 2026

Feature-Driven Framework for Interpretable Detection and Analysis of Android Malware Through Network and Application Behaviors

This paper presents a complete framework for feature-driven Android malware detection that combines predictive modeling with explainable artificial intelligence to improve classification accuracy, interpretability, and operational dependability. The system initiates by examining network-flow metrics, including Source P...

Chao Tan, Xin-Lu Li · 0 citations
#explainable ai Open access Oct 2026

SHAP driven explainable machine learning for malware classification: From detection to explanation

Detecting malware is a critical aspect of cybersecurity, focused on identifying and preventing malicious software from compromising computer systems. The increasing complexity and sophistication of modern malware often render conventional detection techniques inadequate, necessitating more advanced approaches. In this...

Unknown authors · 0 citations
#artificial intelligence Preprint Oct 2026

MARS: Malware Analysis with Rule-Based Scoring of LLM Claims

Large language models can triage malware through direct verdicts or behavioral claims scored by an external policy. We present MARS, a malware triage framework, and compare direct classification with single-pass claim scoring using the same evidence collector and identical static evidence bundles for each model. The ev...

H. Choi · 0 citations
Open access Oct 2026

Design of an improved validation model with dynamic attribution and graph-based anomaly analysis for malware forensics

The increasing sophistication and polymorphic nature of malware necessitate intelligent, adaptive forensic frameworks that go beyond static rule-based detection. In particular, the traditional techniques for evidence collection and analysis would not catch the evolving behaviors of advanced malware, lack context-aware...

Rijvan Beg, R. K. Pateriya, D. Tomar et al. · 0 citations
Open access Sep 2026

HFS-SVE: A Hybrid Feature Selection and Soft Voting Ensemble for Android Malware Detection

Android malware continues to evolve in complexity, creating challenges for detection systems that must distinguish malicious applications from increasingly heterogeneous benign applications. Although machine learning provides effective mechanisms for learning malware characteristics, the high dimensionality of Android...

H. F. Atlam, Samyak M. Jeevane · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.