Optimizing U-Net Architecture with Feed-Forward Neural Networks for Precise Cobb Angle Prediction in Scoliosis Diagnosis

Mohamad Iqmal Jamaludin, Teddy Surya Gunawan, Rajendra Kumar Karupiah, Suriza Ahmad Zabidi, Mira Kartiwi, Zamzuri Zakaria

Abstract


In the burgeoning field of Artificial Intelligence (AI) and its notable subsets, such as Deep Learning (DL), there is evidence of its transformative impact in assisting clinicians, particularly in diagnosing scoliosis. AI is unrivaled for its speed and precision in analyzing medical images, including X-rays and computed tomography (CT) scans. However, the path does not lack obstacles. Biases, unanticipated outcomes, and false positive and negative predictions present significant challenges. Our research employed three complex experimental sets, each focusing on adapting the U-Net architecture. Through a nuanced combination of feed-forward neural network (FFNN) configurations and hyperparameters, we endeavored to determine the most effective nonlinear regression model configuration for predicting the Cobb angle. This was done with the dual purpose of reducing AI training time without sacrificing predictive accuracy. Utilizing the capabilities of the PyTorch framework, we meticulously crafted and refined the deep learning models for each of the three experiments, focusing on an FFFN dropout rate of p=0.45. The Root Mean Square Error (RMSE), the number of epochs, and the number of nodes spanning three hidden layers in each FFFN were utilized as crucial performance metrics while a base learning rate of 0.001 was maintained. Notably, during the optimization phase, one of the experiments incorporated a learning rate scheduler to protect against potential pitfalls such as local minima and saddle points. A judiciously incorporated Early Stopping technique, triggered between the patience range of 5-10 epochs, ensured model stability as the Mean Squared Error (MSE) plateau loss approached approximately 1. Consequently, the model converged between 50 and 82 epochs. We hypothesize that our proposed architecture holds promise for future refinements, conditioned on assiduous experimentation with an array of medical deep learning paradigms.

Keywords


artificial intelligence; deep learning; U-Net architecture; scoliosis diagnosis; Cobb angle prediction; PyTorch framework

References


J. A. Janicki and B. Alman, "Scoliosis: Review of diagnosis and treatment," Paediatrics & child health, vol. 12, no. 9, pp. 771-776, 2007.

N. A. Makhdoomi et al., "Development of Scoliotic Spine Severity Detection using Deep Learning Algorithms," in 2022 IEEE 12th Annual Computing and Communication Workshop and Conference (CCWC), 2022: IEEE, pp. 0574-0579.

K. Watanabe, Y. Aoki, and M. Matsumoto, "An application of artificial intelligence to diagnostic imaging of spine disease: estimating spinal alignment from Moiré images," Neurospine, vol. 16, no. 4, p. 697, 2019.

P. Bernstein, J. Metzler, M. Weinzierl, C. Seifert, W. Kisel, and M. Wacker, "Radiographic scoliosis angle estimation: spline-based measurement reveals superior reliability compared to traditional COBB method," European spine journal, vol. 30, pp. 676-685, 2021.

V. Wu, T. Ungi, K. Sunderland, G. Pigeau, A. Schonewille, and G. Fichtinger, "Automatic segmentation of spinal ultrasound landmarks with U-net using multiple consecutive images for input," in Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, 2020, vol. 11315: SPIE, pp. 572-577.

Y. Pan et al., "Evaluation of a computer-aided method for measuring the Cobb angle on chest X-rays," European Spine Journal, vol. 28, pp. 3035-3043, 2019.

M. Horng, C. Kuok, M. Fu, C. Lin, and Y. Sun, "Cobb angle measurement of spine from X-Ray images using convolutional neural network. Comput Math Methods Med. 2019; 2019: 6357171," ed: Epub 2019/04/19. https://doi. org/10. 1155/2019/63571 71. PubMed PMID: 30996731.

Y. Sun, Y. Xing, Z. Zhao, X. Meng, G. Xu, and Y. Hai, "Comparison of manual versus automated measurement of Cobb angle in idiopathic scoliosis based on a deep learning keypoint detection technology," European Spine Journal, pp. 1-10, 2022.

Y. Ishikawa et al., "Prediction of Cobb Angle Using Deep Learning Algorithm with Three-Dimensional Depth Sensor Considering the Influence of Garment in Idiopathic Scoliosis," Journal of clinical medicine, vol. 12, no. 2, p. 499, 2023.

Z. Zhou, J. Zhu, and C. Yao, "Vertebral Center Points Locating and Cobb Angle Measurement Based on Deep Learning," Applied Sciences, vol. 13, no. 6, p. 3817, 2023.

M. Fraiwan, Z. Audat, L. Fraiwan, and T. Manasreh, "Using deep transfer learning to detect scoliosis and spondylolisthesis from X-ray images," Plos one, vol. 17, no. 5, p. e0267851, 2022.

W. Caesarendra, W. Rahmaniar, J. Mathew, and A. Thien, "Automated Cobb angle measurement for adolescent idiopathic scoliosis using convolutional neural network," Diagnostics, vol. 12, no. 2, p. 396, 2022.

T. Zhang, Y. Li, J. P. Y. Cheung, S. Dokos, and K.-Y. K. Wong, "Learning-based coronal spine alignment prediction using smartphone-acquired scoliosis radiograph images," IEEE Access, vol. 9, pp. 38287-38295, 2021.

X. Ying, "An overview of overfitting and its solutions," in Journal of physics: Conference series, 2019, vol. 1168: IOP Publishing, p. 022022.

E. Britannica. "Vertebral Column." https://www.britannica.com/science/vertebral-column [accessed 8 August 2023],

M. N. Choudhry, Z. Ahmad, and R. Verma, "Adolescent idiopathic scoliosis," The open orthopaedics journal, vol. 10, p. 143, 2016.

Z. Wang, K. Liu, J. Li, Y. Zhu, and Y. Zhang, "Various frameworks and libraries of machine learning and deep learning: a survey," Archives of computational methods in engineering, pp. 1-24, 2019.

T. Yu and H. Zhu, "Hyper-parameter optimization: A review of algorithms and applications," arXiv preprint arXiv:2003.05689, 2020.

I. Goodfellow, Y. Bengio, and A. Courville, Deep learning. MIT press, 2016.

J. Brownlee, "How to configure the learning rate when training deep learning neural networks," Machine Learning Mastery, vol. 6, 2019.

L. N. Smith, "Cyclical learning rates for training neural networks," in 2017 IEEE winter conference on applications of computer vision (WACV), 2017: IEEE, pp. 464-472.

N. Tanksale. "Finding Good Learning Rate and The One Cycle Policy." https://towardsdatascience.com/finding-good-learning-rate-and-the-one-cycle-policy-7159fe1db5d6 [accessed 8 August 2023],

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting," The Journal of machine learning research, vol. 15, no. 1, pp. 1929-1958, 2014.

H. Wu, C. Bailey, P. Rasoulinejad, and S. Li, "Automatic landmark estimation for adolescent idiopathic scoliosis assessment using BoostNet," in Medical Image Computing and Computer Assisted Intervention− MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part I 20, 2017: Springer, pp. 127-135.

M. Ekman, Learning deep learning: Theory and practice of neural networks, computer vision, NLP, and transformers using TensorFlow. Addison-Wesley, 2021.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


 

Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
ISSN 2089-3272

Creative Commons Licence

This work is licensed under a Creative Commons Attribution 4.0 International License.

web analytics
View IJEEI Stats

https://gosgm.comhttps://jmc.edu.ph/blogs/http://periodicos.unifap.br/https://siplah.intanonline.com/maxwin/index.htmlhttps://iapi-indonesia.org/gampang-menang/https://iapi-indonesia.org/assets/https://brawijayahospital.com/assets/https://brawijayahospital.com/assets/slot-gacor-maxwin/https://fjot.anfe.fr/https://tokorumput.com/wp-content/slot-depo-10k/https://classyfm.co.id/frontend/sigmaslot/https://mediapencerahanbangsa.co.id/https://pdamindramayu.co.id/images/luar/https://pdamindramayu.co.id/demo/https://learning.modernland.co.id/api/toto/https://learning.modernland.co.id/git/slot-depo-10k/https://aihc.amexihc.org/toto/https://cstvcnmt.gialai.gov.vn/demo/https://bundamediagrup.co.id/wp-includes/idn/https://fjot.anfe.fr/js/https://www.chiesadellarte.org/https://www.rollingcarbon.org/https://www.savebugomaforest.org/https://www.sigmaslot-profil.com/https://www.doxycycline365.com/https://thailottonew.site/https://hipnose.in/https://tennishope.orghttps://serenityprime.net/https://bundamediagrup.co.id/depo10k/https://bundamediagrup.co.id/akun/demo/https://loa.tsipil-uii.ac.id/sg-gacor/http://snabm.unim.ac.id/depo-10k/http://snabm.unim.ac.id/lib/slot-maxwin/http://103.165.243.97/doc/sign/slot-thailand/https://appv2.tanahlautkab.go.id/doc/unsign/http://mysimpeg.gowakab.go.id/mysimpeg/maxwin/https://ijatr.polban.ac.id/toto/https://loa.tsipil-uii.ac.id/scatter-hitam/https://ijatr.polban.ac.id/docs/https://simba.cilacapkab.go.id/idnslot/https://sigmawin88.comhttps://perijinan.blitarkota.go.id/assets/jp-gacor/https://perijinan.blitarkota.go.id/data/depo-10k/https://simba.cilacapkab.go.id/api/demo/https://simba.cilacapkab.go.id/api/http://103.165.243.97/doc/sv388/http://103.165.243.97/doc/thailand/https://www.remap.ugto.mx/pages/slot-luar-negeri-winrate-tertinggi/http://www.inmedsur.cfg.sld.cu/docs/https://waper.serdangbedagaikab.go.id/storage/idn/https://bakesbangpol.katingankab.go.id/uploads/pulsahttps://conference.stikesalifah.ac.id/thailand/