Ömer TÜRK, Erdoğan ALDEMİR, Ömer Faruk ERTUĞRUL, Emrullah ACAR

Employing deep learning architectures for image-based automatic cataract diagnosis

Various eye diseases affect the quality of human life severely and ultimately may result in complete vision loss. Ocular diseases manifest themselves through mostly visual indicators in the early or mature stages of the disease by showing abnormalities in optics disc, fovea, or other descriptive anatomical structures of the eye. Cataract is among the most harmful diseases that affects millions of people and the leading cause of public vision impairment. It shows major visual symptoms that can be employed for early detection before the hypermature stage. Automatic diagnosis systems intend to assist ophthalmological experts by mitigating the burden of manual clinical decisions and on health care utilization. In this study, a diagnosis system based on color fundus images are addressed for cataract disease. Deep learning-based models were performed for the automatic identification of cataract diseases. Two pretrained robust architectures, namely VGGNet and DenseNet, were employed to detect abnormalities in descriptive parts of the human eye. The proposed system is implemented on a wide and unique dataset that includes diverse color retinal fundus images that are acquired comparatively in low-cost and common modality, which is considered a major contribution of the study. The dataset show symptoms of cataracts in different phases and represents the characteristics of the cataract. By the proposed system, dysfunction associated with cataracts could be identified in the early stage. The achievement of the proposed system is compared to various traditional and up-to-date classification systems. The proposed system achieves 97.94% diagnosis rate for cataract disease grading.

PDF

___

[1] Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthcare Journal 2019; 6 (2): 94-98. doi: 10.7861/futurehosp.6-2-94
[2] Bakator M, Radosav D. Deep learning and medical diagnosis: A review of literature. Multimodal Technologies and Interaction 2018; 2 (3). doi: 10.3390/mti2030047
[3] Ertuğrul ÖF, Acar E, Aldemir E, Öztekin A. Automatic diagnosis of cardiovascular disorders by sub images of the ECG signal using multi-feature extraction methods and randomized neural network. Biomedical Signal Processing and Control 2021; 64. doi: 10.1016/j.bspc.2020.102260
[4] Grewal PS, Oloumi F, Rubin U, Tennant MTS. Deep learning in ophthalmology: a review. Canadian Journal of Ophthalmology 2018; 53 (4): 309-313.doi: 10.1016/j.jcjo.2018.04.019
[5] Flaxman SR, Bourne RR, Resnikoff S, Ackland P, Braithwaite T. Global causes of blindness and distance vision impairment 1990-2020: a systematic review and meta-analysis. The Lancet Global Health 2017; 5 (12): e1221-e1234. doi: 10.1016/S2214-109X(17)30393-5
[6] Zhang L, Li J, Zhan I, Han H, Liu B et al. (2017a). Automatic cataract detection and grading using Deep Convolutional Neural Network. In: Proceedings of the 2017 IEEE 14th International Conference on Networking, Sensing and Control, Calabria, Italy; 2017. pp. 60-65. doi: 10.1109/ICNSC.2017.8000068
[7] Islam M T, Imran S A, Arefeen A, Hasan M, Shahnaz C. Source and camera independent ophthalmic disease recognition from fundus image using neural network. In: IEEE International Conference on Signal Processing, Information, Communication and Systems, Dhaka, Bangladesh; 2019. pp. 59-63.
[8] Liefers B, Venhuizen FG, Schreur V, van Ginneken B, Hoyng C et al. Automatic detection of the foveal center in optical coherence tomography. Biomedical Optics Express 2017; 8 (11): 5160. doi: 10.1364/boe.8.005160
[9] Gour N, Khanna P. Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network. Biomedical Signal Processing and Control 2020; doi: 10.1016/j.bspc.2020.102329
[10] Nour M, Cömert Z, Polat K. A novel medical diagnosis model for COVID-19 infection detection based on deep features and Bayesian optimization. Applied Soft Computing 2020; 97: 106580.
[11] Öztürk Ş, Özkaya U, Barstuğan M. Classification of Coronavirus (COVID‐19) from X‐ray and CT images using shrunken features. International Journal of Imaging Systems and Technology 2021; 31 (1): 5-15.
[12] Guo L, Yang JJ, Peng L, Li J, Liang Q. A computer-aided healthcare system for cataract classification and grading based on fundus image analysis. Computers in Industry 2015; 69: 72-80. doi: 10.1016/j.compind.2014.09.005
[13] Niemeijer M, van Ginneken B, Cree MJ, Mizutani A, Quellec G et al. Retinopathy online challenge: automatic detection of microaneurysms in digital color fundus photographs. IEEE Transactions on Medical Imaging 2010; 29 (1): 185-195. doi: 10.1109/TMI.2009.2033909
[14] Bernardes R, Serranho P, Lobo C. Digital ocular fundus imaging: A review. Ophthalmologica 2011; 226 (4): 161-181. doi: 10.1159/000329597
[15] Poplin R, Varadarajan AV, Blumer K, Liu Y, McConnell et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nature Biomedical Engineering 2018; 2 (3): 158-164. doi: 10.1038/s41551- 018-0195-0
[16] Yang JJ, Li J, Shen, R, Zeng Y, He J et al. Exploiting ensemble learning for automatic cataract detection and grading. Computer Methods and Programs in Biomedicine 2016; 124: 45-57. doi: 10.1016/j.cmpb.2015.10.007
[17] Yang M, Yang JJ, Zhang Q, Niu Y, Li J. Classification of retinal image for automatic cataract detection. In: IEEE International Conference on e-Health Networking, Applications Services; Lisbon, Portugal; 2013. pp. 674-679. doi: 10.1109/HealthCom.2013.6720761
[18] Huang W, Chan KL, Li H, Lim JH, Liu J et al. A computer assisted method for nuclear cataract grading from slit-lamp images using ranking. IEEE Transactions on Medical Imaging 2011; 30 (1): 94-107. doi: 10.1109/TMI.2010.2062197
[19] Wang Liming, Zhang K, Liu X, Long E, Jiang J et al. Comparative analysis of image classification methods for automatic diagnosis of ophthalmic images. Scientific Reports 2017; 7: 1-11. doi: 10.1038/srep41545
[20] Gali HE, Sella R, Afshari NA. Cataract grading systems: a review of past and present. Current opinion in ophthalmology 2019; 30 (1): 13-18. doi: 10.1097/ICU.0000000000000542
[21] Zhang K, Liu X, Liu F, He L, Zhang L et al. An interpretable and expandable deep learning diagnostic system for multiple ocular diseases: Qualitative study. Journal of Medical Internet Research 2018; 20 (11): 1-13. doi: 10.2196/11144
[22] He J, Li C, Ye J, Qiao Y, Gu L. Multi-label ocular disease classification with a dense correlation deep neural network. Biomedical Signal Processing and Control 2021; 63. doi: 10.1016/j.bspc.2020.102167
[23] Yoo TK, Ryu IH, Kim JK, Lee IS, Kim JS et al. Deep learning can generate traditional retinal fundus photographs using ultra-widefield images via generative adversarial networks. Computer Methods and Programs in Biomedicine 2020; 197. doi: 10.1016/j.cmpb.2020.105761
[24] Gao X, Lin S, Wong TY. Automatic feature learning to grade nuclear cataracts based on deep learning. IEEE Transactions on Biomedical Engineering 2015; 62(11): 2693-2701. doi: 10.1109/TBME.2015.2444389
[25] Ran J, Niu K, He Z, Zhang H, Song H. Cataract detection and grading based on combination of deep convolutional neural network and random forests. In: Proceedings of 2018 6th IEEE International Conference on Network Infrastructure and Digital Content, Guiyang, China; 2018. pp. 155-159. doi: 10.1109/ICNIDC.2018.8525852
[26] Zhou Y, Li G, Li H. Automatic cataract classification using deep neural network with discrete state transition. IEEE transactions on medical imaging 2019; 39(2): 436-446. doi: 10.1109/TMI.2019.2928229
[27] Zhang H, He Z. Automatic cataract grading methods based on deep learning. Computer Methods and Programs in Biomedicine 2019; 182. doi: 10.1016/j.cmpb.2019.07.006
[28] Xu X, Zhang L, Li J, Guan Y, Zhang L. A Hybrid Global-Local Representation CNN Model for Automatic Cataract Grading. IEEE Journal of Biomedical and Health Informatics 2020; 24(2): 556-567. doi: 10.1109/JBHI.2019.2914690
[29] Imran A, Li J, Pei Y, Akhtar F, Mahmood T et al. Fundus image-based cataract classification using a hybrid convolutional and recurrent neural network. Visual Computer 2020. doi: 10.1007/s00371-020-01994-3
[30] Liu X, Faes L, Kale AU, Wagner SK, Fu DJ et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. The Lancet Digital Health 2019; 1(6): 271-297. doi: 10.1016/S2589-7500(19)30123-2
[31] Takahashi R, Kajikawa Y. Computer-aided diagnosis: A survey with bibliometric analysis. International Journal of Medical Informatics 2017; 101: 58-67. doi: 10.1016/j.ijmedinf.2017.02.004
[32] Wu X, Huang Y, Liu Z, Lai W, Long E. Universal artificial intelligence platform for collaborative management of cataracts. British Journal of Ophthalmology 2019; 103(11): 1553-1560. doi: 10.1136/bjophthalmol-2019-314729
[33] Zhang X, Xiao Z, Higashita R, Chen W, Yuan J. A novel deep learning method for nuclear cataract classification based on anterior segment optical coherence tomography images. IEEE Transactions on Systems, Man, and Cybernetics Systems 2020: 662-668. doi: 10.1109/SMC42975.2020.9283218
[34] Song W, Cao Y, Qiao Z, Wang Q, Yang JJ. An improved semi-supervised learning method on cataract fundus image classification. In: Proceedings - International Computer Software and Applications Conference; Milwaukee, WI, USA; 2019. pp.362-367. doi: 10.1109/COMPSAC.2019.10233
[35] Ting DSJ, Ang M, Mehta JS, Ting DSW. Artificial intelligence-assisted telemedicine platform for cataract screening and management: A potential model of care for global eye health. British Journal of Ophthalmology 2019; 103 (11): 1537-1538. doi: 10.1136/bjophthalmol-2019-315025
[36] Long E, Lin H, Liu Z, Wu X, Wang L et al. An artificial intelligence platform for the multihospital collaborative management of congenital cataracts. Nature Biomedical Engineering 2017; 1 (2): 1-8. doi: 10.1038/s41551-016-0024
[37] Liu YC, Wilkins M, Kim T, Malyugin B, Mehta JS. Cataracts. The Lancet 2017; 390 (10094): 600-612. doi: 10.1016/S0140-6736(17)30544-5
[38] Yanagihara RT, Lee CS, Ting DSW, Lee AY. Methodological challenges of deep learning in optical coherence tomography for retinal diseases: a review. Translational Vision Science & Technology 2020; 9(2): 11-11. doi: 10.1167/tvst.9.2.11
[39] Rangarajan AK, Purushothaman R. Disease classification in eggplant using pre-trained vgg16 and msvm. Scientific Reports 2020; 10 (1): 1-11. doi: 10.1038/s41598-020-59108-x
[40] Shijie J, Peiyi J, Siping H., Haibo L. Automatic detection of tomato diseases and pests based on leaf images. In: Chinese Automation Congress; Jinan, China; 2017. pp. 3507-3510. doi: 10.1109/CAC.2017.8243388
[41] Tong Y, Lu W, Yu Y, Shen Y. Application of machine learning in ophthalmic imaging modalities. Eye and Vision 2020; 7 (1): 1-15. doi: 10.1186/s40662-020-00183-6
[42] Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv 2015; 1409.1556.
[43] Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P et al.2018. The history began from alexnet: A comprehensive survey on deep learning approaches. arXiv preprint Access: [arXiv:1803.01164]. Access date: 21.06.2019.
[44] Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA; 2017. pp. 4700-4708.
[45] Kiliç S. Kappa test. Psychiatry and Behavioral Sciences 2015; 5 (3): 142. doi: 10.5455/jmood.20150920115439.
[46] Cohen J. A coefficient of agreement for nominal scales. Educational and psychological measurement 1960; 20 (1): 37-46. doi: 10.1177/001316446002000104
[47] Pratap T, Kokil P. Computer-aided diagnosis of cataract using deep transfer learning. Biomedical Signal Processing and Control 2019; 53: 1-8. doi: 10.1016/j.bspc.2019.04.010
[48] Sengupta S, Singh A, Leopold HA, Gulati T, Lakshminarayanan, V. Ophthalmic diagnosis using deep learning with fundus images–A critical review. Artificial Intelligence in Medicine 2020; 102. doi: 10.1016/j.artmed.2019.101758
[49] Goh JHL, Lim ZW, Fang X, Anees A, Nusinovici S et al. Artificial intelligence for cataract detection and management. Asia-Pacific Journal of Ophthalmology 2020; 9 (2): 88-95. doi: 10.1097/01.APO.0000656988.16221.04
[50] Li J, Xu X, Guan Y, Imran A, Liu B et al. Automatic Cataract Diagnosis by Image-Based Interpretability. Proceedings - 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018, 3964-3969. doi: 10.1109/SMC.2018.00672
[51] Dong Y, Zhang Q, Qiao Z, Yang JJ. (2017, October). Classification of cataract fundus image based on deep learning. In: IEEE International Conference on Imaging Systems and Techniques (IST), Beijing, China; 2017. pp. 1-5. IEEE. doi: 10.1109/IST.2017.8261463
[52] Xiong L, Li H, Xu L. An approach to evaluate blurriness in retinal images with vitreous opacity for cataract diagnosis. Journal of Healthcare Engineering 2017. doi: 10.1155/2017/5645498.
[53] Pratap T, Kokil P. Automatic cataract detection in fundus retinal images using singular value decomposition. In: International Conference on Wireless Communications Signal Processing and Networking (WiSPNET), Chennai, India; 2019. pp. 373-377. doi: 10.1109/wispnet45539.2019.9032867
[54] Zhang H, Niu K, Xiong Y, Yang W, He Z et al. Automatic cataract grading methods based on deep learning. Computer Methods and Programs in Biomedicine 2019; 182: 104978.
[55] Li T, Bo W, Hu C, Kang H, Liu H et al. Applications of deep learning in fundus images: A review. Medical Image Analysis 2021; 101971.