Osteoporosis and osteopenia, prevalent bone diseases affecting millions of people globally, necessitate accurate early diagnosis for effective treatment and fracture prevention. This paper proposes a novel hybrid optimization algorithm tailored for classifying these conditions based on Bone Mineral Density (BMD) measurements. The algorithm, a customized Mini-Batch Gradient Descent (MBGD), blends the advantages of Gradient Descent (GD) and Stochastic Gradient Descent (SGD), addressing specific needs for osteoporosis and osteopenia classification. Utilizing a dataset comprising BMD measurements and clinical risk factors from the Osteoporotic Fractures in Men (MrOS), Study of Osteoporotic Fractures (SOF), and Fracture Risk Assessment (FRAX), the model achieves an impressive accuracy of 99.01%. The proposed model outperforms existing methods, demonstrating superior accuracy compared to the accuracy obtained in Gradient Descent of 97.26%, Stochastic Gradient Descent of 97.23%, and other optimization algorithms such as Adam of 96.45% and the RMSprop of 96.23%. This hybrid model presents a robust framework for early diagnosis of Osteoporosis and osteopenia, and hence there is an enhancement in quality of life.
Keywords
Gradient Descent, Stochastic Descent, Optimization algorithms, Osteoporosis and Osteopenia.
M. Tassoker, M. Ü. Öziç, and F. Yuce, “Comparison of five convolutional neural networks for predicting osteoporosis based on mandibular cortical index on panoramic radiographs,” Dentomaxillofacial Radiology, vol. 51, no. 6, Sep. 2022, doi: 10.1259/dmfr.20220108.
B. Saravi et al., “Artificial Intelligence-Driven Prediction Modeling and Decision Making in Spine Surgery Using Hybrid Machine Learning Models,” Journal of Personalized Medicine, vol. 12, no. 4, p. 509, Mar. 2022, doi: 10.3390/jpm12040509.
J. Ryu et al., “Automated Detection of Periodontal Bone Loss Using Deep Learning and Panoramic Radiographs: A Convolutional Neural Network Approach,” Applied Sciences, vol. 13, no. 9, p. 5261, Apr. 2023, doi: 10.3390/app13095261.
T. Kabir et al., “An End-to-end Entangled Segmentation and Classification Convolutional Neural Network for Periodontitis Stage Grading from Periapical Radiographic Images,” 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Dec. 2021, doi: 10.1109/bibm52615.2021.9669422.
F. Carrillo‐Perez et al., “Applications of artificial intelligence in dentistry: A comprehensive review,” Journal of Esthetic and Restorative Dentistry, vol. 34, no. 1, pp. 259–280, Nov. 2021, doi: 10.1111/jerd.12844.
S. Sukegawa et al., “Identification of osteoporosis using ensemble deep learning model with panoramic radiographs and clinical covariates,” Scientific Reports, vol. 12, no. 1, Apr. 2022, doi: 10.1038/s41598-022-10150-x.
K.-S. Lee, S.-K. Jung, J.-J. Ryu, S.-W. Shin, and J. Choi, “Evaluation of Transfer Learning with Deep Convolutional Neural Networks for Screening Osteoporosis in Dental Panoramic Radiographs,” Journal of Clinical Medicine, vol. 9, no. 2, p. 392, Feb. 2020, doi: 10.3390/jcm9020392.
T. Nakamoto, A. Taguchi, and N. Kakimoto, “Osteoporosis screening support system from panoramic radiographs using deep learning by convolutional neural network,” Dentomaxillofacial Radiology, vol. 51, no. 6, Sep. 2022, doi: 10.1259/dmfr.20220135.
J.-S. Lee, S. Adhikari, L. Liu, H.-G. Jeong, H. Kim, and S.-J. Yoon, “Osteoporosis detection in panoramic radiographs using a deep convolutional neural network-based computer-assisted diagnosis system: a preliminary study,” Dentomaxillofacial Radiology, vol. 48, no. 1, p. 20170344, Jan. 2019, doi: 10.1259/dmfr.20170344.
C. Tong, B. Liang, J. Li, and Z. Zheng, “A Deep Automated Skeletal Bone Age Assessment Model with Heterogeneous Features Learning,” Journal of Medical Systems, vol. 42, no. 12, Nov. 2018, doi: 10.1007/s10916-018-1091-6.
L. Jakaite, V. Schetinin, J. Hladůvka, S. Minaev, A. Ambia, and W. Krzanowski, “Deep learning for early detection of pathological changes in X-ray bone microstructures: case of osteoarthritis,” Scientific Reports, vol. 11, no. 1, Jan. 2021, doi: 10.1038/s41598-021-81786-4.
S. Raschka, “Gradient Descent and Stochastic Gradient Descent,” Çevrimiçi]. Available: http://rasbt. github. io/mlxtend/user_guide/general_concepts/gradient-optimization/.[Erişildi: 03 01 2021], 2020.
L. Heryawan, F. Febriansyah, and A. Bukhori, “Deep Learning and Machine Learning Model Comparison for Diagnosis Detection from Medical Records,” Proceedings of the 2022 International Conference on Computer, Control, Informatics and Its Applications, Nov. 2022, doi: 10.1145/3575882.3575941.
Q. Deng, Y. Cheng and G. Lan, “Optimal Adaptive And Accelerated Stochastic Gradient Descent,” 2018, arXiv preprint arXiv:1810.00553.
S. Horváth, K. Mishchenko and P. Richtárik, “Adaptive Learning Rates for Faster Stochastic Gradient Methods,” 2022, arXiv preprint arXiv:2208.05287.
L. Bottou, “Stochastic Gradient Descent Tricks,” Neural Networks: Tricks of the Trade, pp. 421–436, 2012, doi: 10.1007/978-3-642-35289-8_25.
S. Amari, “Backpropagation and stochastic gradient descent method,” Neurocomputing, vol. 5, no. 4–5, pp. 185–196, Jun. 1993, doi: 10.1016/0925-2312(93)90006-o.
M. Zinkevich, M. Weimer, L. Li, and A. Smola, “Parallelized stochastic gradient descent,” Advances in neural information processing systems, 23, 2010.
V. Nagarajan and J. Z. Kolter, “Gradient descent GAN optimization is locally stable,” Advances in neural information processing systems, 30, 2017.
S. Smith, E. Elsen, and S. De, “On the generalization benefit of noise in stochastic gradient descent,” In International Conference on Machine Learning (pp. 9058-9067). PMLR, Nov 2020.
S. Du, J. Lee, H. Li, L. Wang and X. Zhai, “Gradient descent finds global minima of deep neural networks,” In International conference on machine learning (pp. 1675-1685). PMLR, May 2019.
S. Ruder, “An overview of gradient descent optimization algorithms,” 2016, arXiv preprint arXiv:1609.04747.
E. M. Dogo, O. J. Afolabi, N. I. Nwulu, B. Twala, and C. O. Aigbavboa, “A Comparative Analysis of Gradient Descent-Based Optimization Algorithms on Convolutional Neural Networks,” 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS), Dec. 2018, doi: 10.1109/ctems.2018.8769211.
I. Amelia Dewi and M. A. Negara Ekha Salawangi, “High performance of optimizers in deep learning for cloth patterns detection,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 12, no. 3, p. 1407, Sep. 2023, doi: 10.11591/ijai.v12.i3.pp1407-1418.
L. Elhaloui, S. El Filali, E. H. Benlahmer, M. Tabaa, Y. Tace, and N. Rida, “Machine learning for internet of things classification using network traffic parameters,” International Journal of Electrical and Computer Engineering (IJECE), vol. 13, no. 3, p. 3449, Jun. 2023, doi: 10.11591/ijece.v13i3.pp3449-3463.
H. Benradi, A. Chater, and A. Lasfar, “A hybrid approach for face recognition using a convolutional neural network combined with feature extraction techniques,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 12, no. 2, p. 627, Jun. 2023, doi: 10.11591/ijai.v12.i2.pp627-640.
S. Kusumadewi, L. Rosita, and E. G. Wahyuni, “Stability of classification performance on an adaptive neuro fuzzy inference system for disease complication prediction,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 12, no. 2, p. 532, Jun. 2023, doi: 10.11591/ijai.v12.i2.pp532-542.
C. B., K. K.V., R. D., and S. R., “Monitoring Traffic Signal Violations using ANPR and GSM,” 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), Sep. 2017, doi: 10.1109/ctceec.2017.8455045.
K. Vasu and S. Choudhary, “Music Information Retrieval Using Similarity Based Relevance Ranking Techniques,” Scalable Computing: Practice and Experience, vol. 23, no. 3, pp. 103–114, Oct. 2022, doi: 10.12694/scpe.v23i3.2005.
V. Karthik and S. Choudhary, “TaCbF-‘Trending Architecture for Content based Filtering using Data Mining,’” 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), Sep. 2017, doi: 10.1109/ctceec.2017.8455036.
Acknowledgements
Author(s) thanks to Vellore Institute of Technology for research lab and equipment support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
Santhi V
Santhi V
School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Ramesh T and Santhi V, “Hybrid Optimization Model Integrating Gradient Descent and Stochastic Descent for Enhanced Osteoporosis and Osteopenia Recognition", pp. 340-348, April 2024. doi: 10.53759/7669/jmc202404032.
