Hybrid Stacking Ensemble Model for Breast Cancer Classification: Performance Optimization with Existing Machine Learning Models

Authors

Prerana Nilesh Khairnar
R. Venkatesh
Asma Anjum
Dinesh P S
Prabakaran Narayanaswamy
Beaulah Jeyavathana Rajendran
DOI: https://doi.org/10.52549/ijeei.v13i4.7200
Download PDF
Published: 22-11-2025 • Issue: Vol. 13 No. 4: December 2025 • Section: Regular paper

Abstract

Prompt and proper recognition of breast cancer Classification (BCC) is imperative in resolution of patient results. In this paper, we suggest a new hybrid Hybrid Stacking Ensemble Model (HSEM), which combines Random Forest, Support Vector Machine and XGBoost classifiers as base learners, and logistic regression as the meta-learner. The HSEM is meant to take advantage of the complement of tree-based and kernel-based algorithms by deriving robust and generalizable binary classification of breast cancer through the use of the Wisconsin Diagnostic Breast Cancer dataset. The accuracy, ROC AUC, and feature importance analysis are considered key metrics that are rigorously tested and compared with traditional standalone models in terms of performance. Findings indicate that the HSEM performs better than traditional classifiers: its accuracy is 99%, and its AUC is 1.00, which makes the method even more viable and reliable when it comes to its prediction values. Learning curves and comparisons further confirm the efficiency of the given approach to be visualized. These results emphasize the possibility of using the Hybrid Stacking Ensemble Model as an efficient instrument of use in medical diagnosis purposes, with the subsequent benefits of providing medical professionals with better diagnostic work support options. The suggested hybrid stacking ensemble not only compares, but also improves performance by combining tree-based and kernel-based learners. The comparative evaluation shows that the optimized hybrid technique always works better than current single-model and ensemble-based methods.
Keywords: Breast Cancer Classification (BCC); Hybrid Stacking Ensemble; Model (HSEM); Machine Learning (ML); Random Forest; Support Vector Machine (SVM); XGBoost Feature Importance; Model Comparison

References

M. Azmoodeh-Kalati, H. Shabani, M. S. Maghareh, Z. Barzegar, and R. Lashgari, “Leveraging an ensemble of EfficientNetV1 and EfficientNetV2 models for classification and interpretation of breast cancer histopathology images,†Scientific Reports, vol. 15, no. 1, p. 21541, 2025.

A. A. Almelibari, M. I. Labib, and Y. Ramadan, “Enhancing liver disease classification based on a stacked machine learning model,†Engineering, Technology & Applied Science Research, vol. 15, no. 5, pp. 26403–26409, 2025.

T. Tran, U. Le, and Y. Shi, “An effective up-sampling approach for breast cancer prediction with imbalanced data: A machine learning model-based comparative analysis,†PLOS One, vol. 17, no. 5, e0269135, 2022.

A. Singh and K. S. Kaswan, “VELM: a voting based ensemble learning model for breast cancer prediction,†Physica Scripta, vol. 100, no. 2, p. 026002, 2025.

A. Y. Bani Ahmad, J. A. Alzubi, M. Vasanthan, S. B. Kondaveeti, J. Shreyas, and T. P. Priyanka, “Efficient hybrid heuristic adopted deep learning framework for diagnosing breast cancer using thermography images,†Scientific Reports, vol. 15, no. 1, p. 13605, 2025.

G. Alfian, M. Syafrudin, I. Fahrurrozi, N. L. Fitriyani, F. T. D. Atmaji, T. Widodo, et al., “Predicting breast cancer from risk factors using SVM and extra-trees-based feature selection method,†Computers, vol. 11, no. 9, p. 136, 2022.

M. Hazra, N. Gautam, J. Dey, and R. Sarkar, “A stacking ensemble method with multiple color models for lung cancer classification using histopathology images,†Multimedia Tools and Applications, pp. 1–25, 2025.

F. Gurcan, “Enhancing breast cancer prediction through stacking ensemble and deep learning integration,†PeerJ Computer Science, vol. 11, e2461, 2025.

T. F. Lee, J. P. Shiau, C. H. Chen, W. P. Yun, C. S. Wuu, Y. J. Huang, et al., “A machine learning model for predicting breast cancer recurrence and supporting personalized treatment decisions through comprehensive feature selection and explainable ensemble learning,†Cancer Management and Research, pp. 917–932, 2025.

[V. Chaurasia and S. Pal, “Applications of machine learning techniques to predict diagnostic breast cancer,†SN Computer Science, vol. 1, no. 5, p. 270, 2020.

A. Ghavidel and P. Pazos, “Machine learning (ML) techniques to predict breast cancer in imbalanced datasets: a systematic review,†Journal of Cancer Survivorship, vol. 19, no. 1, pp. 270–294, 2025.

M. J. Saadh, H. H. Ahmed, R. A. Kareem, A. Yadav, S. Ganesan, A. Shankhyan, et al., “Advanced machine learning framework for enhancing breast cancer diagnostics through transcriptomic profiling,†Discover Oncology, vol. 16, no. 1, p. 334, 2025.

D. Gu, K. Su, and H. Zhao, “A case-based ensemble learning system for explainable breast cancer recurrence prediction,†Artificial Intelligence in Medicine, vol. 107, p. 101858, 2020.

V. Chaurasia and N. Goel, “Women health issue: machine learning ensemble techniques to diagnosis breast cancer,†Health and Technology, vol. 15, no. 1, pp. 81–92, 2025.

X. Y. Liew, N. Hameed, and J. Clos, “An investigation of XGBoost-based algorithm for breast cancer classification,†Machine Learning with Applications, vol. 6, p. 100154, 2021.

E. W. Fridayanthie, “Optimization of support vector machine and XGBoost methods using feature selection to improve classification performance,†Journal of Informatics and Telecommunication Engineering, vol. 6, no. 2, pp. 484–493, 2023.

R. Gupta, R. Bhargava, and M. Jayabalan, “Diagnosis of breast cancer on imbalanced dataset using various sampling techniques and machine learning models,†in Proc. 14th Int. Conf. Developments in eSystems Engineering (DeSE), 2021, pp. 162–167.

H. Gupta, P. Kumar, S. Saurabh, S. K. Mishra, B. Appasani, A. Pati, et al., “Category boosting machine learning algorithm for breast cancer prediction,†Revue Roumaine Des Sciences Techniques—Série Electrotechnique Et Energétique, vol. 66, no. 3, pp. 201–206, 2021.

A. S. H. Alwazy, G. Buyrukoğlu, S. Buyrukoğlu, and M. R. Baker, “Evaluating machine learning and statistical learning techniques for cancer classification and diagnosis,†Iran Journal of Computer Science, vol. 8, no. 2, pp. 471– 490, 2025.

M. M. Ansari, S. Kumar, C. Chola, M. B. B. Heyat, F. Akhtar, M. A. B. Hayat, et al., “A novel machine and deep learning–based ensemble techniques for automatic lung cancer detection,†BioMed Research International, vol. 2025, no. 1, p. 6666688, 2025.

How to Cite

[1]
P. N. Khairnar, R. Venkatesh, A. Anjum, D. P S, P. Narayanaswamy, and B. J. Rajendran, “Hybrid Stacking Ensemble Model for Breast Cancer Classification: Performance Optimization with Existing Machine Learning Models”, IJEEI, vol. 13, no. 4, pp. 923–935, Nov. 2025, doi: 10.52549/ijeei.v13i4.7200.