A smart agricultural application: automated detection of diseases in vine leaves using hybrid deep learning

A smart agricultural application: automated detection of diseases in vine leaves using hybrid deep learning

This paper reports a study which utilizes deep learning for automated detection of the symptoms of diseases on vine leaves. Vine fruits or grapes are very important and have existed in Syria and surrounding areas (e.g., Turkey) for many years. Quality of vine fruits is also very important in grape production as it is consumed in these areas every day. The aim of this study is to improve diseasedetection accuracy in vine leaves and to develop a system to help Syrian and Turkish farmers and agricultural engineers to maintain the quality of grape production. In this study, over 1000 images of vine leaves have been collected from vine yards in Syria and the internet. These images are processed using MATLAB 2018B, Deep Learning Toolbox including convolutional neural networks (CNNs) with AlexNet, GoogleNet and ResNet-18. A standard transfer learning (TL) algorithm is also used with CNNs, whereas a multiclass support vector machine (SVM) is used with AlexNet, whilst GPU and CUDA are used for accelerating the process of the disease detection for vine leaves. A software system has been created that enables the automatic and efficient detection of nine types of leaf diseases and the identification of healthy leaves. Experimental studies showed that the total detection accuracy of this system reaches 92.5%, 87.4% and 85.0%, 85.1% when AlexNet+TL, ResNet-18+TL, GoogleNet+TL and AlexNet+SVM are used respectively. This smart agricultural application can provide early identification of the symptoms of grape diseases on leaves and thus help maintain the quality of vine fruits.

___

  • Atak A, Göksel Z, Çelik H (2017). Relations between downy/ powdery mildew diseases and some phenolic compounds in Vitis spp. Turkish Journal of Agriculture and Forestry 41: 69- 81. doi: 10.3906/tar-1610-61
  • İçli N, Tahmas Kahyaoğlu D (2020). Investigation of pesticide residues in fresh Sultani grapes and antioxidant properties of fresh/sun-dried/oven-dried grapes. Turkish Journal of Agriculture and Forestry 44: 350-360. doi: 10.3906/tar-1904-49
  • Alkan A (2011). Analysis of knee osteoarthritis by using fuzzy c-means clustering and SVM classification. Scientific Research and Essays 6 (20): 4213-4219. doi: 10.5897/SRE11.068.
  • Bengio Y (2012). Deep learning of representations for unsupervised and transfer learning. In: Proceedings of International Conference of Machine learning Workshop on Unsupervised and Transfer Learning; City, Country. pp. 17-36.
  • Chan T, Vese L (2001). Active contours without edges. Institute of Electrical and Electronics Engineers Transactions on Image Processing 10: 266-277. doi: 10.1109/83.902291
  • Contaldo N, Soufi Z, Bertaccini A (2011). Preliminary identification of phytoplasmas associated with grapevine yellows in Syria. Bulletin of Insectology 64.
  • Goncharov P, Uzhinskiy A, Ososkov G, Nechaevskiy A, Zudikhina J (2020). Deep siamese networks for plant disease detection. The European Physical Journal. doi: 10.1051/epjconf/202022603010
  • Guo Z, Chen Q, Wu G, Xu Y, Shibasaki R et al. (2017). Village building identification based on ensemble convolutional neural networks. Sensors Journal 17 (11): 2487-2508. doi: 10.3390/s17112487
  • Idris I, Arabi M (2014). The relationship between grape phylloxera and Fusarium root infection. Advances in Horticultural Science Journal 28: 14-19.
  • Islam M, Dinh A, Wahid K, Bhowmik P (2017). Detection of potato diseases using image segmentation and multiclass support vector machine. In: 2017 Institute of Electrical and Electronics Engineers 30th Canadian Conference on Electrical and Computer Engineering; City, Country. pp. 1-4. doi: 10.1109/ CCECE.2017.7946594
  • Jian HZ, Fan TK, Jian ZWU, Shu QH, Zhi FZ (2018). Automatic image segmentation method for cotton leaves with disease under natural environment. Journal of Integrative Agriculture 17: 1800-1814. doi: 10.1016/S2095-3119(18)61915-X
  • Kamilaris A, Prenafeta B (2018). Deep learning in agriculture: A survey. Computers and Electronics in Agriculture 147: 70-79. doi: 10.1016/j.compag.2018.02.016
  • Kass M, Witkin A, Terzopoulos D (1988). Snakes: active contour models. International Journal of Computer Vision 1 (4): 321- 331. doi: 10.1007/bf00133570
  • Kaya A, Seydi A, Catal C, Yalin H, Temucin H (2019). Analysis of transfer learning for deep neural network based plant classification models. Computers and Electronics in Agriculture 158: 20-29. doi: 10.1016/j.compag.2019.01.041
  • Kerkech M, Hafiane A, Canals R (2018). Deep leaning approach with colorimetric spaces and vegetation indices for vine diseases detection in UAV images. Computers and Electronics in Agriculture 155: 237-243. doi: 10.1016/j.compag.2018.10.006
  • Li C, Kao CY, Gore JC, Ding Z (2007). Implicit active contours driven by local binary fitting energy. In: IEEE Conference on Computer Vision and Pattern Recognition. Minneapolis, MN, USA. pp. 1-7. doi: 10.1109/CVPR.2007.383014
  • Mohanty SP, Hughes DP, Salathé M (2016). Using deep learning for image based plant disease detection. Journal of Frontiers in Plant Science. doi: 10.3389/fpls.2016.01419
  • Muthukannan K, Latha P, Pon SR, Nisha P (2015). Classification of diseased plant leaves using neural network algorithms. Asian Research Publishing Network (ARPN) Journal of Engineering and Applied Sciences 10: 1913-1919.
  • Napoletano P, Piccoli F, Schettini R (2018). Anomaly detection in nanofibrous materials by CNN-based self-similarity. Sensors Journal 18 (2): 209-223. doi: 10.3390/s18010209
  • Pradhan SS, Patil R (2020). Comparison of deep learning approaches for plant disease detection. In: Vasudevan H, Gajic Z, Deshmukh A (editors). Proceedings of International Conference on Wireless Communication. Lecture Notes on Data Engineering and Communications Technologies, Vol. 36. Singapore: Springer, pp. 575-583. doi: 10.1007/978-981-15- 1002-1_58
  • Pukkela P, Borra S (2017). Machine learning based plant leaf disease detection and severity assessment techniques: state-of-theart. In: Dey N, Ashour A, Borra S (editors). Classification in Bio Apps. Lecture Notes in Computational Vision and Biomechanics, Vol. 26. Cham, Switzerland: Springer, pp. 199- 226. doi: 10.1007/978-3-319-65981-7_8
  • Raza SEA, Prince G, Clarkson JP, Rajpoot NM (2015). Automatic detection of Diseased tomato plants using thermal and stereo visible light images. PLoS ONE 10: 1-20. doi: 10.1371/journal. pone.0123262
  • Reis MJCS, Morais R, Peres E, Pereira C, Contente O et al. (2012). Automatic detection of bunches of grapes in natural environment from color images. Journal of Applied Logic 10: 285-290. doi: 10.1016/j.jal.2012.07.004
  • Sanjeev SS, Vijay SR, Vijay N, Pallavi (2013). Diagnosis and classification of grape leaf diseases using neural networks. In: Fourth International Conference on Computing, Communications and Networking Technologies; City, Country. pp. 1-5. doi: 10.1109/ICCCNT.2013.6726616
  • Sharath Kumar YH, Suhas G (2017). Identification and classification of fruit diseases. In: Santosh K, Hangarge M, Bevilacqua V, Negi A (editors). Recent Trends in Image Processing and Pattern Recognition. Communications in Computer and Information Science, Vol. 709. Singapore: Springer, pp. 382- 390. doi: 10.1007/978-981-10- 4859-3_34
  • Tongke FT (2013). Smart agriculture based on cloud computing and IOT. Journal of Convergence Information Technology 8: 210- 216. doi: 10.4156/JCIT.VOL8.ISSUE2.26
  • Xiang R (2018). Image segmentation for whole tomato plant recognition at night Computers and Electronics in Agriculture 154: 434-442. doi: 10.1016/j.compag.2018.09.034
  • Ferentinos KP (2018). Deep learning models for plant disease detection and diagnosis. Computers and Electronics in Agriculture 145: 311-318. doi: 10.1016/j.compag.2018.01.009
  • Howlader MR, Habiba U, Hossain FR, Mostafijur RM (2019). Automatic recognition of guava leaf diseases using deep convolution neural network. In: International Conference on Electrical, Computer and Communication Engineering; Cox’s Bazar, Bangladesh. pp. 1-5. doi: 10.1109/ECACE.2019.8679421