Journal of Machine and Computing


Diabetic Retinopathy Image Lesion Segmentation with Feature Fusion Relation Transformer Network



Journal of Machine and Computing

Received On : 28 March 2024

Revised On : 10 June 2024

Accepted On : 30 July 2024

Published On : 05 October 2024

Volume 04, Issue 04

Pages : 1032-1043


Abstract


Diabetes is a common disease that affects different vital organs of the human body, including the eyes. In diabetic patients, a change in blood sugar level leads to eye problems. Around 80% of the patients who have diabetes for more than 10 years have severe eye-related pathological disorders such as retinopathy and maculopathy. Proper detection, diagnosis, and treatment of eye-related pathologies prevent damage to the eye during the earliest stages of diabetic disease—the developed stage findings in patients losing their vision. The retinal damage due to diabetes is termed Diabetic Retinopathy (DR). The treatment of DR involves detecting the presence of the disease in the form of microaneurysms (MA), hemorrhages (HE), and exudates (EX) in the retinal area. The process of segmenting a massive segment of Retinal Images (RI) performs a prominent role in DR classification. The existing research concentrates on Optic Disc (OD) segmentation. This article focuses on the segmentation of MA, HE, and EX using a Feature Fusion Relation Transformer Network (FFRTNet). In this research, the benchmark dataset, the Indian Diabetic Retinopathy Image Dataset (IDRID), is used for the ablation study to evaluate the use of every module. The proposed method, FFRTNet, is compared with state-of-the-art methods. The evaluation of FFRTNet enhances the segmentation by 3.56%, 4.34%, and 3.75% on metrics, namely sensitivity, Intersection-over-Union (IoU), and Dice coefficient (DICE). The qualitative and quantitative results proved the superiority of FFRTNet in segmenting lesions in DR.


Keywords


Diabetes, Segmentation, Diabetic Retinopathy, Neural Network, Convolution, Feature Fusion, Lesion, Vessel.


  1. S. Vujosevic et al., “Screening for diabetic retinopathy: new perspectives and challenges,” The Lancet Diabetes & Endocrinology, vol. 8, no. 4, pp. 337–347, Apr. 2020, doi: 10.1016/s2213-8587(19)30411-5.
  2. Z. L. Teo et al., “Global Prevalence of Diabetic Retinopathy and Projection of Burden through 2045,” Ophthalmology, vol. 128, no. 11, pp. 1580–1591, Nov. 2021, doi: 10.1016/j.ophtha.2021.04.027.
  3. D. A. Antonetti, P. S. Silva, and A. W. Stitt, “Current understanding of the molecular and cellular pathology of diabetic retinopathy,” Nature Reviews Endocrinology, vol. 17, no. 4, pp. 195–206, Jan. 2021, doi: 10.1038/s41574-020-00451-4.
  4. S. Qummar et al., “A Deep Learning Ensemble Approach for Diabetic Retinopathy Detection,” IEEE Access, vol. 7, pp. 150530–150539, 2019, doi: 10.1109/access.2019.2947484.
  5. L. Dai et al., “A deep learning system for detecting diabetic retinopathy across the disease spectrum,” Nature Communications, vol. 12, no. 1, May 2021, doi: 10.1038/s41467-021-23458-5.
  6. L. A. Levin, M. Sengupta, L. J. Balcer, M. J. Kupersmith, and N. R. Miller, “Report From the National Eye Institute Workshop on Neuro-Ophthalmic Disease Clinical Trial Endpoints: Optic Neuropathies,” Investigative Opthalmology & Visual Science, vol. 62, no. 14, p. 30, Nov. 2021, doi: 10.1167/iovs.62.14.30.
  7. T. R. Gadekallu, N. Khare, S. Bhattacharya, S. Singh, P. K. R. Maddikunta, and G. Srivastava, “Deep neural networks to predict diabetic retinopathy,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 5, pp. 5407–5420, Apr. 2020, doi: 10.1007/s12652-020-01963-7.
  8. A. Grzybowski et al., “Artificial intelligence for diabetic retinopathy screening: a review,” Eye, vol. 34, no. 3, pp. 451–460, Sep. 2019, doi: 10.1038/s41433-019-0566-0.
  9. J. V. Forrester, L. Kuffova, and M. Delibegovic, “The Role of Inflammation in Diabetic Retinopathy,” Frontiers in Immunology, vol. 11, Nov. 2020, doi: 10.3389/fimmu.2020.583687.
  10. R. Cheloni, S. A. Gandolfi, C. Signorelli, and A. Odone, “Global prevalence of diabetic retinopathy: protocol for a systematic review and meta-analysis,” BMJ Open, vol. 9, no. 3, p. e022188, Mar. 2019, doi: 10.1136/bmjopen-2018-022188.
  11. O. Simó-Servat, C. Hernández, and R. Simó, “Diabetic Retinopathy in the Context of Patients with Diabetes,” Ophthalmic Research, vol. 62, no. 4, pp. 211–217, 2019, doi: 10.1159/000499541.
  12. Y. Zhou, B. Wang, L. Huang, S. Cui, and L. Shao, “A Benchmark for Studying Diabetic Retinopathy: Segmentation, Grading, and Transferability,” IEEE Transactions on Medical Imaging, vol. 40, no. 3, pp. 818–828, Mar. 2021, doi: 10.1109/tmi.2020.3037771.
  13. N. Sambyal, P. Saini, R. Syal, and V. Gupta, “Modified U-Net architecture for semantic segmentation of diabetic retinopathy images,” Biocybernetics and Biomedical Engineering, vol. 40, no. 3, pp. 1094–1109, Jul. 2020, doi: 10.1016/j.bbe.2020.05.006.
  14. S. Kumar, A. Adarsh, B. Kumar, and A. K. Singh, “An automated early diabetic retinopathy detection through improved blood vessel and optic disc segmentation,” Optics & Laser Technology, vol. 121, p. 105815, Jan. 2020, doi: 10.1016/j.optlastec.2019.105815.
  15. M. U. Akram, S. Akbar, T. Hassan, S. G. Khawaja, U. Yasin, and I. Basit, “Data on fundus images for vessels segmentation, detection of hypertensive retinopathy, diabetic retinopathy and papilledema,” Data in Brief, vol. 29, p. 105282, Apr. 2020, doi: 10.1016/j.dib.2020.105282.
  16. A. Garifullin, L. Lensu, and H. Uusitalo, “Deep Bayesian baseline for segmenting diabetic retinopathy lesions: Advances and challenges,” Computers in Biology and Medicine, vol. 136, p. 104725, Sep. 2021, doi: 10.1016/j.compbiomed.2021.104725.
  17. P. Porwal, S. Pachade, M. Kokare, G. Deshmukh, J. Son, W. Bae, et al., “IDRiD: Diabetic Retinopathy – Segmentation and Grading Challenge,” Medical Image Analysis, vol. 59, 2020, doi: 10.1016/j.media.2019.101561.
  18. G. T. Zago, R. V. Andreão, B. Dorizzi, and E. O. Teatini Salles, “Diabetic retinopathy detection using red lesion localization and convolutional neural networks,” Computers in Biology and Medicine, vol. 116, p. 103537, Jan. 2020, doi: 10.1016/j.compbiomed.2019.103537.

Acknowledgements


Authors thank Reviewers for taking the time and effort necessary to review the manuscript.


Funding


No funding was received to assist with the preparation of this manuscript.


Ethics declarations


Conflict of interest

The authors would like to thank to the reviewers for nice comments on the manuscript.


Availability of data and materials


Data sharing is not applicable to this article as no new data were created or analysed in this study.


Author information


Contributions

All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.


Corresponding author


Rights and permissions


Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/


Cite this article


Shaymaa Hussein Nowfal, Eswaramoorthy V, Vishnu Priya Arivanantham, Bhaskar Marapelli, Swaroopa K and Ezhil Dyana M V, “Diabetic Retinopathy Image Lesion Segmentation with Feature Fusion Relation Transformer Network”, Journal of Machine and Computing, pp. 1032-1043, October 2024. doi:10.53759/7669/jmc202404096.


Copyright


© 2024 Shaymaa Hussein Nowfal, Eswaramoorthy V, Vishnu Priya Arivanantham, Bhaskar Marapelli, Swaroopa K and Ezhil Dyana M V. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.