An In-Depth Statistical Review of Retinal Image Processing Models from a Clinical Perspective

Main Article Content

Jagadale Sachin Mohan, LK. Vishwamitra

Abstract

The burgeoning field of retinal image processing is critical in facilitating early diagnosis and treatment of retinal diseases, which are amongst the leading causes of vision impairment globally. Despite rapid advancements, existing machine learning models for retinal image processing are characterized by significant limitations, including disparities in pre-processing, segmentation, and classification methodologies, as well as inconsistencies in post-processing operations. These limitations hinder the realization of accurate, reliable, and clinically relevant outcomes. This paper provides an in-depth statistical review of extant machine learning models used in retinal image processing, meticulously comparing them based on their internal operating characteristics and performance levels. By adopting a robust analytical approach, our review delineates the strengths and weaknesses of current models, offering comprehensive insights that are instrumental in guiding future research and development in this domain. Furthermore, this review underscores the potential clinical impacts of these models, highlighting their pivotal role in enhancing diagnostic accuracy, prognostic assessments, and therapeutic interventions for retinal disorders. In conclusion, our work not only bridges the existing knowledge gap in the literature but also paves the way for the evolution of more sophisticated and clinically-aligned retinal image processing models, ultimately contributing to improved patient outcomes and advancements in ophthalmic care.

Article Details

How to Cite
Jagadale Sachin Mohan, et al. (2023). An In-Depth Statistical Review of Retinal Image Processing Models from a Clinical Perspective. International Journal on Recent and Innovation Trends in Computing and Communication, 11(10), 590–606. https://doi.org/10.17762/ijritcc.v11i10.8547
Section
Articles
Author Biography

Jagadale Sachin Mohan, LK. Vishwamitra

Jagadale Sachin Mohan 1, LK. Vishwamitra2

1PhD Scholar Oriental University, Indore. M.P., India

2Dept. of CSE Oriental University, Indore M.P., India

1,2sachinjagdale.ppr@gmail.com, lkvishwamitra@gmail.com

References

J. Wei et al., "Genetic U-Net: Automatically Designed Deep Networks for Retinal Vessel Segmentation Using a Genetic Algorithm," in IEEE Transactions on Medical Imaging, vol. 41, no. 2, pp. 292-307, Feb. 2022, doi: 10.1109/TMI.2021.3111679.

M. Rahil, B. N. Anoop, G. N. Girish, A. R. Kothari, S. G. Koolagudi and J. Rajan, "A Deep Ensemble Learning-Based CNN Architecture for Multiclass Retinal Fluid Segmentation in OCT Images," in IEEE Access, vol. 11, pp. 17241-17251, 2023, doi: 10.1109/ACCESS.2023.3244922.

C. An, Y. Wang, J. Zhang and T. Q. Nguyen, "Self-Supervised Rigid Registration for Multimodal Retinal Images," in IEEE Transactions on Image Processing, vol. 31, pp. 5733-5747, 2022, doi: 10.1109/TIP.2022.3201476.

Y. Li et al., "Global Transformer and Dual Local Attention Network via Deep-Shallow Hierarchical Feature Fusion for Retinal Vessel Segmentation," in IEEE Transactions on Cybernetics, vol. 53, no. 9, pp. 5826-5839, Sept. 2023, doi: 10.1109/TCYB.2022.3194099.

J. Zhang et al., "Two-Step Registration on Multi-Modal Retinal Images via Deep Neural Networks," in IEEE Transactions on Image Processing, vol. 31, pp. 823-838, 2022, doi: 10.1109/TIP.2021.3135708.

J. Lyu, Y. Zhang, Y. Huang, L. Lin, P. Cheng and X. Tang, "AADG: Automatic Augmentation for Domain Generalization on Retinal Image Segmentation," in IEEE Transactions on Medical Imaging, vol. 41, no. 12, pp. 3699-3711, Dec. 2022, doi: 10.1109/TMI.2022.3193146.

N. Saeedizadeh et al., "A Device-Independent, Shape Preserving Retinal Optical Coherence Tomography Image Alignment Method Applying TV-Unet for RPE Layer Detection," in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-8, 2022, Art no. 4504408, doi: 10.1109/TIM.2022.3185653.

K. Zhou et al., "Proxy-Bridged Image Reconstruction Network for Anomaly Detection in Medical Images," in IEEE Transactions on Medical Imaging, vol. 41, no. 3, pp. 582-594, March 2022, doi: 10.1109/TMI.2021.3118223.

Y. Li, Y. Zhang, W. Cui, B. Lei, X. Kuang and T. Zhang, "Dual Encoder-Based Dynamic-Channel Graph Convolutional Network With Edge Enhancement for Retinal Vessel Segmentation," in IEEE Transactions on Medical Imaging, vol. 41, no. 8, pp. 1975-1989, Aug. 2022, doi: 10.1109/TMI.2022.3151666.

C. Yao et al., "Joint Segmentation of Multi-Class Hyper-Reflective Foci in Retinal Optical Coherence Tomography Images," in IEEE Transactions on Biomedical Engineering, vol. 69, no. 4, pp. 1349-1358, April 2022, doi: 10.1109/TBME.2021.3115552.

L. Ding, T. D. Kang, A. E. Kuriyan, R. S. Ramchandran, C. C. Wykoff and G. Sharma, "Combining Feature Correspondence With Parametric Chamfer Alignment: Hybrid Two-Stage Registration for Ultra-Widefield Retinal Images," in IEEE Transactions on Biomedical Engineering, vol. 70, no. 2, pp. 523-532, Feb. 2023, doi: 10.1109/TBME.2022.3196458.

J. Hao et al., "Retinal Structure Detection in OCTA Image via Voting-Based Multitask Learning," in IEEE Transactions on Medical Imaging, vol. 41, no. 12, pp. 3969-3980, Dec. 2022, doi: 10.1109/TMI.2022.3202183.

N. Liang, L. Yuan, X. Wen, H. Xu and J. Wang, "End-To-End Retina Image Synthesis Based on CGAN Using Class Feature Loss and Improved Retinal Detail Loss," in IEEE Access, vol. 10, pp. 83125-83137, 2022, doi: 10.1109/ACCESS.2022.3196377.

Y. Tan, K. -F. Yang, S. -X. Zhao and Y. -J. Li, "Retinal Vessel Segmentation With Skeletal Prior and Contrastive Loss," in IEEE Transactions on Medical Imaging, vol. 41, no. 9, pp. 2238-2251, Sept. 2022, doi: 10.1109/TMI.2022.3161681.

J. Hu et al., "Multi-Scale Interactive Network With Artery/Vein Discriminator for Retinal Vessel Classification," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 8, pp. 3896-3905, Aug. 2022, doi: 10.1109/JBHI.2022.3165867.

A. Desiani, Erwin, B. Suprihatin, F. Efriliyanti, M. Arhami and E. Setyaningsih, "VG-DropDNet a Robust Architecture for Blood Vessels Segmentation on Retinal Image," in IEEE Access, vol. 10, pp. 92067-92083, 2022, doi: 10.1109/ACCESS.2022.3202890.

M. Wang et al., "MsTGANet: Automatic Drusen Segmentation From Retinal OCT Images," in IEEE Transactions on Medical Imaging, vol. 41, no. 2, pp. 394-406, Feb. 2022, doi: 10.1109/TMI.2021.3112716.

Q. Meng, L. Liao and S. Satoh, "Weakly-Supervised Learning With Complementary Heatmap for Retinal Disease Detection," in IEEE Transactions on Medical Imaging, vol. 41, no. 8, pp. 2067-2078, Aug. 2022, doi: 10.1109/TMI.2022.3155154.

R. Rasti, A. Biglari, M. Rezapourian, Z. Yang and S. Farsiu, "RetiFluidNet: A Self-Adaptive and Multi-Attention Deep Convolutional Network for Retinal OCT Fluid Segmentation," in IEEE Transactions on Medical Imaging, vol. 42, no. 5, pp. 1413-1423, May 2023, doi: 10.1109/TMI.2022.3228285.

Y. Xie et al., "Fundus Image-Label Pairs Synthesis and Retinopathy Screening via GANs With Class-Imbalanced Semi-Supervised Learning," in IEEE Transactions on Medical Imaging, vol. 42, no. 9, pp. 2714-2725, Sept. 2023, doi: 10.1109/TMI.2023.3263216.

Y. Ye, C. Pan, Y. Wu, S. Wang and Y. Xia, "MFI-Net: Multiscale Feature Interaction Network for Retinal Vessel Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 9, pp. 4551-4562, Sept. 2022, doi: 10.1109/JBHI.2022.3182471.

J. Yang et al., "Self-Supervised Sequence Recovery for Semi-Supervised Retinal Layer Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 8, pp. 3872-3883, Aug. 2022, doi: 10.1109/JBHI.2022.3166778.

Y. Yuan, L. Zhang, L. Wang and H. Huang, "Multi-Level Attention Network for Retinal Vessel Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 1, pp. 312-323, Jan. 2022, doi: 10.1109/JBHI.2021.3089201.

E. Guo, H. Fu, L. Zhou and D. Xu, "Bridging Synthetic and Real Images: A Transferable and Multiple Consistency Aided Fundus Image Enhancement Framework," in IEEE Transactions on Medical Imaging, vol. 42, no. 8, pp. 2189-2199, Aug. 2023, doi: 10.1109/TMI.2023.3247783.

K. Hu, S. Jiang, Y. Zhang, X. Li and X. Gao, "Joint-Seg: Treat Foveal Avascular Zone and Retinal Vessel Segmentation in OCTA Images as a Joint Task," in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-13, 2022, Art no. 4007113, doi: 10.1109/TIM.2022.3193188.

S. H. Abbood, H. N. A. Hamed, M. S. M. Rahim, A. Rehman, T. Saba and S. A. Bahaj, "Hybrid Retinal Image Enhancement Algorithm for Diabetic Retinopathy Diagnostic Using Deep Learning Model," in IEEE Access, vol. 10, pp. 73079-73086, 2022, doi: 10.1109/ACCESS.2022.3189374.

V. M. R. Sankari, U. Umapathy, S. Alasmari and S. M. Aslam, "Automated Detection of Retinopathy of Prematurity Using Quantum Machine Learning and Deep Learning Techniques," in IEEE Access, vol. 11, pp. 94306-94321, 2023, doi: 10.1109/ACCESS.2023.3311346.

L. Pan and X. Chen, "Retinal OCT Image Registration: Methods and Applications," in IEEE Reviews in Biomedical Engineering, vol. 16, pp. 307-318, 2023, doi: 10.1109/RBME.2021.3110958.

Z. Qu, L. Zhuo, J. Cao, X. Li, H. Yin and Z. Wang, "TP-Net: Two-Path Network for Retinal Vessel Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 4, pp. 1979-1990, April 2023, doi: 10.1109/JBHI.2023.3237704.

M. Monemian and H. Rabbani, "A Computationally Efficient Red-Lesion Extraction Method for Retinal Fundus Images," in IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1-13, 2023, Art no. 5001613, doi: 10.1109/TIM.2022.3229712.

N. Paluru, H. Ravishankar, S. Hegde and P. K. Yalavarthy, "Self Distillation for Improving the Generalizability of Retinal Disease Diagnosis Using Optical Coherence Tomography Images," in IEEE Journal of Selected Topics in Quantum Electronics, vol. 29, no. 4: Biophotonics, pp. 1-12, July-Aug. 2023, Art no. 7200812, doi: 10.1109/JSTQE.2023.3240729.

M. A. Rodríguez, H. AlMarzouqi and P. Liatsis, "Multi-Label Retinal Disease Classification Using Transformers," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 6, pp. 2739-2750, June 2023, doi: 10.1109/JBHI.2022.3214086.

S. Mishra, Y. Zhang, D. Z. Chen and X. S. Hu, "Data-Driven Deep Supervision for Medical Image Segmentation," in IEEE Transactions on Medical Imaging, vol. 41, no. 6, pp. 1560-1574, June 2022, doi: 10.1109/TMI.2022.3143371.

M. Tajmirriahi, R. Kafieh, Z. Amini and V. Lakshminarayanan, "A Dual-Discriminator Fourier Acquisitive GAN for Generating Retinal Optical Coherence Tomography Images," in IEEE Transactions on Instrumentation and Measurement, vol. 71, pp. 1-8, 2022, Art no. 5015708, doi: 10.1109/TIM.2022.3189735.

M. Wang et al., "Self-Guided Optimization Semi-Supervised Method for Joint Segmentation of Macular Hole and Cystoid Macular Edema in Retinal OCT Images," in IEEE Transactions on Biomedical Engineering, vol. 70, no. 7, pp. 2013-2024, July 2023, doi: 10.1109/TBME.2023.3234031.

T. Shi et al., "Affinity Feature Strengthening for Accurate, Complete and Robust Vessel Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 27, no. 8, pp. 4006-4017, Aug. 2023, doi: 10.1109/JBHI.2023.3274789.

R. Chaurasia and A. Sengupta, "Retinal Biometric for Securing JPEG-Codec Hardware IP Core for CE Systems," in IEEE Transactions on Consumer Electronics, vol. 69, no. 3, pp. 441-457, Aug. 2023, doi: 10.1109/TCE.2023.3264669.

K. Aurangzeb, R. S. Alharthi, S. I. Haider and M. Alhussein, "An Efficient and Light Weight Deep Learning Model for Accurate Retinal Vessels Segmentation," in IEEE Access, vol. 11, pp. 23107-23118, 2023, doi: 10.1109/ACCESS.2022.3217782.

W. Liu et al., "Full-Resolution Network and Dual-Threshold Iteration for Retinal Vessel and Coronary Angiograph Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 9, pp. 4623-4634, Sept. 2022, doi: 10.1109/JBHI.2022.3188710.

S. Schürer-Waldheim, P. Seeböck, H. Bogunovi?, B. S. Gerendas and U. Schmidt-Erfurth, "Robust Fovea Detection in Retinal OCT Imaging Using Deep Learning," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 8, pp. 3927-3937, Aug. 2022, doi: 10.1109/JBHI.2022.3166068.

X. He, Z. Zhong, L. Fang, M. He and N. Sebe, "Structure-Guided Cross-Attention Network for Cross-Domain OCT Fluid Segmentation," in IEEE Transactions on Image Processing, vol. 32, pp. 309-320, 2023, doi: 10.1109/TIP.2022.3228163.

B. Goutam, M. F. Hashmi, Z. W. Geem and N. D. Bokde, "A Comprehensive Review of Deep Learning Strategies in Retinal Disease Diagnosis Using Fundus Images," in IEEE Access, vol. 10, pp. 57796-57823, 2022, doi: 10.1109/ACCESS.2022.3178372.

S. Deari, I. Oksuz and S. Ulukaya, "Block Attention and Switchable Normalization Based Deep Learning Framework for Segmentation of Retinal Vessels," in IEEE Access, vol. 11, pp. 38263-38274, 2023, doi: 10.1109/ACCESS.2023.3265729.

Y. Zhang, M. Liu, F. Yu, T. Zeng and Y. Wang, "An O-Shape Neural Network With Attention Modules to Detect Junctions in Biomedical Images Without Segmentation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 2, pp. 774-785, Feb. 2022, doi: 10.1109/JBHI.2021.3094187.

J. Li, G. Gao, L. Yang, G. Bian and Y. Liu, "DPF-Net: A Dual-Path Progressive Fusion Network for Retinal Vessel Segmentation," in IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1-17, 2023, Art no. 2517817, doi: 10.1109/TIM.2023.3277946.

H. Hao et al., "Sparse-Based Domain Adaptation Network for OCTA Image Super-Resolution Reconstruction," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 9, pp. 4402-4413, Sept. 2022, doi: 10.1109/JBHI.2022.3194025.

Z. Zhang, Z. Ji, Q. Chen, S. Yuan and W. Fan, "Joint Optimization of CycleGAN and CNN Classifier for Detection and Localization of Retinal Pathologies on Color Fundus Photographs," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 1, pp. 115-126, Jan. 2022, doi: 10.1109/JBHI.2021.3092339.

Y. Niu, L. Gu, Y. Zhao and F. Lu, "Explainable Diabetic Retinopathy Detection and Retinal Image Generation," in IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 1, pp. 44-55, Jan. 2022, doi: 10.1109/JBHI.2021.3110593.

F. Chen et al., "Dual-Path and Multi-Scale Enhanced Attention Network for Retinal Diseases Classification Using Ultra-Wide-Field Images," in IEEE Access, vol. 11, pp. 45405-45415, 2023, doi: 10.1109/ACCESS.2023.3273613.

X. Zhang et al., "T-Net: Hierarchical Pyramid Network for Microaneurysm Detection in Retinal Fundus Image," in IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1-13, 2023, Art no. 5019613, doi: 10.1109/TIM.2023.3286003.