Exploratory Analysis of the Impact of Data Balancing on the Classifier’s Performance in Predicting Creditworthiness Reliability

DOI: https://doi.org/10.52549/ijeei.v13i3.6667
Published: 27-09-2025 • Issue: Vol. 13 No. 3: September 2025 • Section: Regular paper

Abstract

This study examines the application of machine learning algorithms for creditworthiness prediction within the banking sector and addresses the issue of class imbalance through sampling methodologies. The research indicates that using the Stacking Ensemble algorithm with random oversampling can predict creditworthiness with an impressive 93% accuracy. The method consistently achieves excellent precision, recall, and F1-score values, indicating that it can produce accurate predictions while maintaining a balanced evaluation. Random oversampling helps models improve their predictive accuracy and reduce class imbalance. The research findings underscore the feasibility of this technique for financial institutions, facilitating informed lending decisions and improving credit risk assessment methodologies. This research enhances the field by identifying the most effective machine learning methods for accurate creditworthiness evaluation. Using XAI tools like Shapash provides financial organizations with valuable insights into assessing loan risks and enhancing their lending operations.

References

O. Netzer, A. Lemaire, and M. Herzenstein, “When words sweat: Identifying signals for loan default in the text of loan applications,†Journal of Marketing Research, vol. 56, no. 6, pp. 960–980, 2019.

J. Galindo and P. Tamayo, “Credit risk assessment using statistical and machine learning: basic methodology and risk modeling applications,†Computational economics, vol. 15, pp. 107–143, 2000.

P. Pławiak, M. Abdar, and U. R. Acharya, “Application of new deep genetic cascade ensemble of svm classifiers to predict the australian credit scoring,†Applied Soft Computing, vol. 84, p. 105740, 2019.

A. M. Ozbayoglu, M. U. Gudelek, and O. B. Sezer, “Deep learning for financial applications: A survey,†Applied soft computing, vol. 93, p. 106384, 2020.

J. Shen and M. O. Shafiq, “Short-term stock market price trend prediction using a comprehensive deep learning system,†Journal of big Data, vol. 7, pp. 1–33, 2020.

D. Karlan and J. Morduch, “Access to finance,†in Handbook of development economics. Elsevier, 2010, vol. 5, pp. 4703–4784.

M. A. Sheikh, A. K. Goel, and T. Kumar, “An approach for prediction of loan approval using machine learning algorithm,†in 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC). IEEE, 2020, pp. 490–494.

X. F. Jency, V. Sumathi, and J. S. Sri, “An exploratory data analysis for loan prediction based on nature of the clients,†International Journal of Recent Technology and Engineering (IJRTE), vol. 7, no. 4, pp. 17–23, 2018.

E. Balaji, D. Brindha, and R. Balakrishnan, “Supervised machine learning based gait classification system for early detection and stage classification of parkinson’s disease,†Applied Soft Computing, vol. 94, p. 106494, 2020.

B. He, Y. Shi, Q. Wan, and X. Zhao, “Prediction of customer attrition of commercial banks based on svm model,†Procedia computer science, vol. 31, pp. 423–430, 2014.

L. Simieli, L. T. B. Gobbi, D. Orcioli-Silva, V. S. Beretta, P. C. R. Santos, A. M. Baptista, and F. A. Barbieri, “The variability of the steps preceding obstacle avoidance (approach phase) is dependent on the height of the obstacle in people with parkinson’s disease,†Plos one, vol. 12, no. 9, p. e0184134, 2017.

V. Singh, A. Yadav, R. Awasthi, and G. N. Partheeban, “Prediction of modernized loan approval system based on machine learning approach,†in 2021 International Conference on Intelligent Technologies (CONIT). IEEE, 2021, pp. 1–4.

I. Brown and C. Mues, “An experimental comparison of classification algorithms for imbalanced credit scoring data sets,†Expert systems with applications, vol. 39, no. 3, pp. 3446–3453, 2012.

A. Adadi and M. Berrada, “Peeking inside the black-box: a survey on explainable artificial intelligence (xai),†IEEE access, vol. 6, pp. 52 138–52 160, 2018. [15] R. Odegua, “Predicting bank loan default with extreme gradient boosting,†arXiv preprint arXiv:2002.02011, 2020.

C. Kwofie, C. Owusu-Ansah, and C. Boadi, “Predicting the probability of loan-default: An application of binary logistic regression,†Research Journal of Mathematics and Statistics, vol. 7, no. 4, pp. 46–52, 2015.

A. S. Kadam, S. R. Nikam, A. A. Aher, G. V. Shelke, and A. S. Chandgude, “Prediction for loan approval using machine learning algorithm,†International Research Journal of Engineering and Technology (IRJET), vol. 8, no. 04, 2021.

A. S. Aphale and S. R. Shinde, “Predict loan approval in banking system machine learning approach for cooperative banks loan approval,†International Journal of Engineering Trends and Applications (IJETA), vol. 9, no. 8, 2020.

M. Srinivasa Rao, C. Sekhar, and D. Bhattacharyya, “Comparative analysis of machine learning models on loan risk analysis,†in Machine Intelligence and Soft Computing: Proceedings of ICMISC 2020. Springer, 2021, pp. 81–90.

Q. Xing, C. Yu, S. Huang, Q. Zheng, X. Mu, and M. Sun, “Enhanced credit score prediction using ensemble deep learning model,†arXiv preprint arXiv:2410.00256, 2024.

R. Rofik, R. Aulia, K. Musaadah, S. S. F. Ardyani, and A. A. Hakim, “The optimization of credit scoring model using stacking ensemble learning and oversampling techniques,†Journal of Information System Exploration and Research, vol. 2, no. 1, 2024.

N. Uddin, M. K. U. Ahamed, M. A. Uddin, M. M. Islam, M. A. Talukder, and S. Aryal, “An ensemble machine learning based bank loan approval predictions system with a smart application,†International Journal of Cognitive Computing in Engineering, vol. 4, pp. 327–339, 2023.

Y. Chen, R. Calabrese, and B. Martin-Barragan, “Interpretable machine learning for imbalanced credit scoring datasets,†European Journal of Operational Research, vol. 312, no. 1, pp. 357–372, 2024.

X. Li, H. Zheng, K. Tao, and M. Mao, “Implementation of an asymmetric adjusted activation function for class imbalance credit scoring,†arXiv preprint arXiv:2501.12285, 2025.

Srikanth, “Home loan approval prediction,†https://www.kaggle.com/code/srikanth917/ home-loan-approval-prediction, 2024, accessed: September 12, 2025.

D. Berrar, “Bayes’ theorem and naive bayes classifier,†2019.

Z. A. Ali, Z. H. Abduljabbar, H. A. Taher, A. B. Sallow, and S. M. Almufti, “Exploring the power of extreme gradient boosting algorithm in machine learning: A review,†Academic Journal of Nawroz University, vol. 12, no. 2, pp. 320–334, 2023.

M. Mahedi Hassan, M. Fazle Rabbi, M. Hasan, and B. Roy, “An ensemble machine learning approach to classify parkinson’s disease from voice signal,†in International Conference on Big Data, IoT and Machine Learning. Springer, 2023, pp. 575–590.

S. Zhang, X. Li, M. Zong, X. Zhu, and R. Wang, “Efficient knn classification with different numbers of nearest neighbors,†IEEE transactions on neural networks and learning systems, vol. 29, no. 5, pp. 1774–1785, 2017.

M. Hasan, M. M. Islam, S. W. Sajid, and M. M. Hassan, “The impact of data balancing on the classifier’s performance in predicting cesarean childbirth,†in 2022 4th International Conference on Electrical, Computer & Telecommunication Engineering (ICECTE). IEEE, 2022, pp. 1–4.

S. Amarappa and S. Sathyanarayana, “Data classification using support vector machine (svm), a simplified approach,†Int. J. Electron. Comput. Sci. Eng, vol. 3, pp. 435–445, 2014.

M. Hasan, U. Das, R. K. Datta, and M. Z. Abedin, “Model development for predicting the crude oil price: Comparative evaluation of ensemble and machine learning methods,†in Novel financial applications of machine learning and deep learning: Algorithms, product modeling, and applications. Springer, 2023, pp. 167–179.

P. Mahajan, S. Uddin, F. Hajati, and M. A. Moni, “Ensemble learning for disease prediction: A review,†in Healthcare, vol. 11, no. 12. MDPI, 2023, p. 1808.

T. Chen and C. Guestrin, “Xgboost: A scalable tree boosting system,†in Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, 2016, pp. 785–794.

X. Gao, C. Shan, C. Hu, Z. Niu, and Z. Liu, “An adaptive ensemble machine learning model for intrusion detection,†Ieee Access, vol. 7, pp. 82 512–82 521, 2019.

A. Morshed-Bozorgdel, M. Kadkhodazadeh, M. Valikhan Anaraki, and S. Farzin, “A novel framework based on the stacking ensemble machine learning (seml) method: application in wind speed modeling,†Atmosphere, vol. 13, no. 5, p. 758, 2022.

M. M. Hassan, M. F. Abrar, and M. Hasan, “An explainable ai-driven machine learning framework for cybersecurity anomaly detection,†in Cyber Security and Business Intelligence. Routledge, 2023, pp. 197–219.

Author Biographies

Md. Mahedi Hassan
Md. Mahedi Hassan is currently working as a Lecturer at CSE Department of World University of Bangladesh (WUB). He has completed his MSc in Computer Science and Engineering degree from Hajee Mohammad Danesh Science and Technology University, Dinajpur. Before that, he also completed his BSc (Engineering ) in Computer Science and Engineering degree from the same university. Beside the teaching profession he also has devoted himself in research activities. His focal interest is in Machine Learning (ML), Deep Learning (DL), Artificial Intelligence (AI), Cybersecurity and Data Science.

How to Cite

[1]
M. M. Hassan, A. Hossen, Y. Arafat, M. N. Sarker, M. H. Jamil, and A. Siddika, “Exploratory Analysis of the Impact of Data Balancing on the Classifier’s Performance in Predicting Creditworthiness Reliability”, IJEEI, vol. 13, no. 3, pp. 703–721, Sep. 2025, doi: 10.52549/ijeei.v13i3.6667.