Training of the Artificial Neural Networks using Crow Search Algorithm
Training of the Artificial Neural Networks using Crow Search Algorithm
Abstract: Artificial Neural Networks are methods frequently used in problem-solving today. In the past, it has been used in many areas, such as classification, pattern recognition and image processing. The most important and demanding part of Artificial Neural Networks is the training process of the network. The main challenge in network training is the process of determining the optimum connection weights and bias values for the network. In the literature, many algorithms have been proposed for training Artificial Neural Networks. This article proposed a new hybrid algorithm called CSA-MLP, for training Artificial Neural Networks using the Crow Search Algorithm. Crow Search Algorithm is a population-based meta-heuristic optimization algorithm, inspired by the behavior of crows to store their surplus nutrients and take them back from the storage area when needed. Crow Search Algorithm has been proposed to solve different optimization problems in terms of its simplicity with two different adjustable parameters (flight length and awareness probability), obtaining an effective convergence rate in a short time and having a faster technique compared to algorithms frequently used in engineering problems with different constraints and functions. In the experiments, five classification datasets (xor, balloon, iris, breast cancer, heart) were used. The CSA-MLP algorithm was compared with the SMS-MLP in terms of the mean squared error, classification rate, the statistical metrics (sensitivity, specificity, precision, f1-score) and the convergence graph. Furthermore, the proposed CSA-MLP algorithm was compared with seven algorithms in literature in terms of best classification accuracy. The experimental results show that the Crow Search Algorithm is a reliable approach in training Multi-Layer Perceptron. CSA-MLP achieved better results than SMS-MLP and other algorithms.
___
- [1] Tumer, A.E. and S. Edebali, An artificial neural network model for wastewater treatment plant of Konya. International Journal of Intelligent Systems and Applications in Engineering, 2015. 3(4): p. 131-135.
- [2] Ergezer, H., M. Dikmen, and E. Özdemir, Yapay sinir ağları ve tanıma sistemleri. PiVOLKA, 2003. 2(6): p. 14-17.
- [3] Yegnanarayana, B., Artificial neural networks. 2009: PHI Learning Pvt. Ltd.
- [4] Öztemel, E., Yapay sinir ağları. 2012: Papatya.
- [5] Yurdakul, E.M., Türkiye'de ithalatın gelişimi ve ithalatın yapay sinir ağları yöntemi ile tahmin edilebilirliğine yönelik bir analiz. 2014.
- [6] GÜNLER, M.A., Identification of Facial Expressions Using Artificial Neural Networks (Ann). a Master’s Thesis, Electrical & Electronics Engineering, 2012.
- [7] Yamany, W., et al. Moth-flame optimization for training multi-layer perceptrons. in 2015 11th International computer engineering Conference (ICENCO). 2015. IEEE.
- [8] Jaddi, N.S., S. Abdullah, and A.R. Hamdan, Optimization of neural network model using modified bat-inspired algorithm. Applied Soft Computing, 2015. 37: p. 71-86.
- [9] Mohammadi, F. and H. Abdi, A modified crow search algorithm (MCSA) for solving economic load dispatch problem. Applied Soft Computing, 2018. 71: p. 51-65.
- [10] Gupta, D., et al., Improved diagnosis of Parkinson's disease using optimized crow search algorithm. Computers & Electrical Engineering, 2018. 68: p. 412-424.
- [11] Kocyigit, Y., A. Alkan, and H. Erol, Classification of EEG recordings by using fast independent component analysis and artificial neural network. Journal of Medical Systems, 2008. 32(1): p. 17-20.
- [12] Aljarah, I., H. Faris, and S. Mirjalili, Optimizing connection weights in neural networks using the whale optimization algorithm. Soft Computing, 2018. 22(1): p. 1-15.
- [13] Rincon, P., Science/nature| crows and jays top bird IQ scale. BBC News, 2005.
- [14] Prior, H., A. Schwarz, and O. Güntürkün, Mirror-induced behavior in the magpie (Pica pica): evidence of self-recognition. PLoS biology, 2008. 6(8): p. e202.
- [15] Askarzadeh, A., A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Computers & Structures, 2016. 169: p. 1-12.
- [16] Emery, N.J., Cognitive ornithology: the evolution of avian intelligence. Philosophical Transactions of the Royal Society B: Biological Sciences, 2006. 361(1465): p. 23-43.
- [17] Díaz, P., et al., An improved crow search algorithm applied to energy problems. Energies, 2018. 11(3): p. 571.
- [18] Sola, J. and J. Sevilla, Importance of input data normalization for the application of neural networks to complex industrial problems. IEEE Transactions on nuclear science, 1997. 44(3): p. 1464-1468.
- [19] Gulcu, Ş., Training of the Artificial Neural Networks using States of Matter Search Algorithm. International Journal of Intelligent Systems and Applications in Engineering, 2020. 8(3): p. 131-136.
- ISSN: 2147-6799
- Başlangıç: 2013
- Yayıncı: Ismail SARITAS
Sayıdaki Diğer Makaleler
Training of the Artificial Neural Networks using Crow Search Algorithm
Diagnosis of Mechanical Low Back Pain Using a Fuzzy Logic-Based Approach
Esmaeil FAKHARIAN, Ehsan NABOVATI, Mehrdad FARZANDİPOUR, Hossein AKBARI, Soheila SAEEDİ
A genetic-Fuzzy Procedure for Solving Fuzzy Multiresponses Problem
Abbas AL-REFAİE, Rasha ABDULLAH, Ghaith Bani DOMİ
Mert Sinan TURGUT, Oğuz Emrah TURGUT