Ensemble Based Machine Learning Approach for Heart Disease Prediction

DOI: https://doi.org/10.52549/ijeei.v13i3.7015
Published: 28-09-2025 • Issue: Vol. 13 No. 3: September 2025 • Section: Regular paper

Abstract

Ensemble machine learning has developed into a strong approach for enhancing the precision and resilience of predictive models through the integration of various learning algorithms. This research presents an innovative ensemble classification framework employing a soft voting approach that combines three gradient boosting techniques XGBoost, LightGBM, and CatBoost to improve heart disease prediction efficacy. The model undergoes evaluation using four distinct datasets (Heart Attack Risk Prediction Dataset, Heart Attack Dataset, Cleveland Heart Disease dataset and Heart Disease Dataset) obtained from Kaggle and other repositories, each reflecting various populations and diagnostic variables. By implementing thorough preprocessing, careful feature selection, and even training-testing-validating splits, the system attains reliable and exceptional classification performance. Experimental findings reveal that the suggested ensemble approach greatly surpasses classic and standalone models, attaining flawless or nearly flawless accuracy on all datasets, reaching a peak accuracy of 100% on the first dataset, 98% on the second dataset, 100% on the third dataset and 98.4% on the fourth dataset. The framework's achievement underscores its viability for real world use in clinical decision support systems and emphasizes the efficiency of ensemble methods in medical diagnosis.

References

H. F. El-Sofany, “Predicting heart diseases using machine learning and different data classification techniques,†IEEE Access, 2024.

S. Ishwarya and A. S. Pillai, “Explainable artificial intelligence in healthcare-a review,†in 2024 International Conference on Inventive Computation Technologies (ICICT). IEEE, 2024, pp. 1059–1064.

V. Cherian and B. M. S. Bindu, “Heart disease prediction using na¨Ä±ve bayes algorithm and laplace smoothing technique,†International Journal of Computer Science Trends and Technology (IJCST), vol. 5, no. 2, 2017.

V. Santhosh and E. Pandiyan, “Heart disease identification method using machine learning classification in e-healthcare,†International Journal of Advances in Engineering and Management (IJAEM), vol. 4, no. 8, pp. 1480–1488, 2022. [Online]. Available: https://www.ijaem.net/issue dcp/ Heart-Disease-Identification-Method-Using-Machine-Learning-Classification-in-E-Healthcare.pdf

A. Arifuddin, G. S. Buana, R. A. Vinarti, and A. Djunaidy, “Performance comparison of decision tree and support vector machine algorithms for heart failure prediction,†Procedia Computer Science, vol. 234, pp. 628–636, 2024.

H. A. E. Shenbary, E. A. Ebeid, and D. Baleanu, “Covid-19 classification using hybrid dl and standard feature extraction techniques,†Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), vol. 29, no. 3, pp. 1780–1791, 2023.

S. Ali, A. Shahid, and G. Mumtaz, “Early heart attack prediction by using ml,†Spectrum of Engineering Sciences, vol. 3, no. 4, pp. 36–48, 2025. [Online]. Available: https://sesjournal.com/index.php/1/article/ view/239

A. Dhani, D. Lestari, M. P. Ningrum, M. A. Fakhrizal, and G. L. Gandini, “Applying a supervised model for diabetes type 2 risk level classification,†Public Research Journal of Engineering, Data Technology and Computer Science, vol. 2, no. 2, pp. 60–67, 2025.

S. Reddy, K. K. Shetty et al., “Machine learning models for advancing heart disease prediction and diagnosis,†in 2025 3rd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT). IEEE, 2025, pp. 2045–2051.

Z. Assarzadeh and A. R. Naghsh-Nilchi, “Chaotic particle swarm optimization with mutation for classification,†Journal of Medical Signals and Sensors, 2015.

T. Wali, A. Bolatbekov, E. Maimaitijiang, D. Salman, and Y. Mamatjan, “A novel recommender framework with chatbot to stratify heart attack risk,†Discover Medicine, vol. 1, no. 1, p. 161, 2024.

R. Yilmaz and F. H. Yagin, “A comparative study for the prediction of heart attack risk and associated factors using mlp and rbf neural networks,†The Journal of Cognitive Systems, vol. 6, no. 2, pp. 51–54, 2021.

I. Carolina, B. O. Lubis, A. Supriyatna, and R. Komarudin, “Application k-nearest neighbor method with particle swarm optimization for classification of heart disease,†in 3rd International Conference on Advanced Information Scientific Development (ICAISD 2023), 2023, pp. 181–186.

G. Roy, R. R. Cherish, and B. R. Prathap, “An empirical and statistical analysis of classification algorithms used in heart attack forecasting,†in Proc. Int. Conf. on Computational Sciences and Sustainable Technologies, 2023, pp. 351–362.

J. J. Pangaribuan, A. Maulana, and R. Romindo, “Unleashing the power of svm and knn: Enhanced early detection of heart disease,†JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer), vol. 10, no. 2, pp. 342–351, 2024.

A. Sanchez-Lite, J. L. Fuentes-Bargues, I. Iglesias, and C. Gonz ´ alez-Gaya, “Proposal of a workplace clas- ´ sification model for heart attack accidents from the field of occupational safety and health engineering,†Heliyon, vol. 10, no. 18, 2024.

B. Ghimire, M. Rai, N. Uprety, and R. Shrestha, “Analyzing the major contribution factor for heart attack using machine learning algorithms and lime,†Journal Name, vol. 155, no. 1, pp. 8–8, 2024.

A. Purnomo, M. A. Barata, M. A. Soeleman, and F. Alzami, “Adding feature selection on na¨Ä±ve bayes to increase accuracy on classification heart attack disease,†in Journal of Physics: Conference Series, vol. 1511, no. 1, 2020, p. 012001.

S. R. Nayak, S. Selvarasu, B. Sripathy, P. Singh, M. Diwakar, I. Gupta, V. Ravi, and A. A. Mazroa, “A new-fangled classification algorithm for medical heart diseases analysis using wavelet transforms,†The Open Public Health Journal, vol. 17, no. 1, 2024.

E. Sivari and S. Sur¨ uc¨ u, “Prediction of heart attack risk using linear discriminant analysis methods,†¨ J. Comput. Electr. Electron. Eng. Sci, vol. 1, no. 1, pp. 5–9, 2023.

T. Turan, “Explainable artificial intelligence approach to heart attack risk prediction,†Karadeniz Fen Bilimleri Dergisi, vol. 15, no. 1, pp. 1–15, 2025. [Online]. Available: https://doi.org/10.31466/kfbd. 1473382

A. A. Hussein, “Improve the performance of k-means by using ga for classification heart attack,†International Journal of Electrical and Computer Engineering (IJECE), vol. 8, no. 2, pp. 1256–1261, 2018. [Online]. Available: http://iaescore.com/journals/index.php/IJECE/article/view/12302

A. Upadhyay, “Predictive modeling of heart disease using python and machine learning,†Int. J. Multidiscip. Res. (IJFMR), vol. 7, no. 3, pp. 1–7, 2025. [Online]. Available: https: //www.ijfmr.com/research-paper.php?id=49208

S. Kumar, B. Thakur, M. Gupta, S. Agrawal, K. Gupta, J. Agrawal, and K. Cengis, “Review on the challenges and future directions of dl-based techniques for advance prediction of cardiac attack,†in Machine Intelligence and Smart Systems. Springer Nature Switzerland, 2025, pp. 172–189.

P. Cihan, “Effect of parameter selection on heart attack risk prediction in an rnn model,†in Proc. 5th Int. Conf. Appl. Eng. Nat. Sci. (ICAENS), 2023, pp. 56–60. [Online]. Available: https://as-proceeding.com/index.php/icaens/article/view/964

N. Chamidah, B. Lestari, H. Susilo, M. Y. Alsagaff, I. N. Budiantara, and D. Aydin, “Spline estimator in nonparametric ordinal logistic regression model for predicting heart attack risk,†Symmetry, vol. 16, no. 11, pp. 1440–1463, 2024.

N. A. Farooqui, M. Haleem, M. Ahmad, and P. Murugesan, “Classification and prediction of cardiovascular disease using machine learning techniques,†in Proc. Int. Conf. on Signal, Machines, Automation, and Algorithm. Springer Nature, 2024, pp. 435–453.

“Heart attack prediction dataset,†https://www.kaggle.com/datasets/iamsouravbanerjee/ heart-attack-prediction-dataset, accessed: 2025-06-15.

“Heart disease classification dataset,†https://www.kaggle.com/datasets/bharath011/ heart-disease-classification-dataset, accessed: 2025-06-17.

“Heart disease dataset (uci),†https://archive.ics.uci.edu/dataset/45/heart+disease, accessed: 2025-06-20. [31] “Heart disease dataset,†https://www.kaggle.com/datasets/ronanazarias/heart-desease-dataset, accessed: 2025-05-27.

How to Cite

[1]
H. A. El Shenbary, B. Z. Hassan, A. T. A. Elsayed, and K. A. A. Khalaf Allah, “Ensemble Based Machine Learning Approach for Heart Disease Prediction”, IJEEI, vol. 13, no. 3, pp. 731–749, Sep. 2025, doi: 10.52549/ijeei.v13i3.7015.