Okan ERKAYMAZ, Mahmut ÖZER, Nejat YUMUŞAK

Impact of small-world topology on the performance of a feed-forward artificial neural network based on 2 different real-life problems

Since feed-forward artificial neural networks (FFANNs) are the most widely used models to solve real-life problems, many studies have focused on improving their learning performances by changing the network architecture and learning algorithms. On the other hand, recently, small-world network topology has been shown to meet the characteristics of real-life problems. Therefore, in this study, instead of focusing on the performance of the conventional FFANNs, we investigated how real-life problems can be solved by a FFANN with small-world topology. Therefore, we considered 2 real-life problems: estimating the thermal performance of solar air collectors and predicting the modulus of rupture values of oriented strand boards. We used the FFANN with small-world topology to solve both problems and compared the results with those of a conventional FFANN with zero rewiring. In addition, we investigated whether there was statistically significant difference between the regular FFANN and small-world FFANN model. Our results show that there exists an optimal rewiring number within the small-world topology that warrants the best performance for both problems.

Anahtar Kelimeler:

Small-world network, feed-forward artificial neural network, rewiring, network topology

Impact of small-world topology on the performance of a feed-forward artificial neural network based on 2 different real-life problems

Keywords:

Small-world network, feed-forward artificial neural network, rewiring, network topology,

PDF

___

S. Haykin, Neural Networks—A Comprehensive Foundation, 2nd Edition, New Jersey, Prentice-Hall, 1999.
M. Sun, A. Stam, R.E. Steuer, “Solving multiple objective programming problems using feed-forward artificial neural networks: the interactive FFANN procedure”, Management Science, Vol. 42, pp. 835–849, 1996.
N.A. Magnitskii, “Some new approaches to the construction and learning of artificial neural networks”, Computational Mathematics and Modeling, Vol. 12, pp. 293–304. 2001.
F. Ham, I. Kostanic, Principles of Neurocomputing for Science & Engineering, New York, McGraw-Hill, 2001. D.J. Watts, S.H. Strogatz, “Collective dynamics of ‘small-world’ networks”, Nature, Vol. 393, pp. 409–10, 1998. K. Fortney, J. Pahle, J. Delgado, G. Obernostor, V. Shah, “Effects of simulated brain damage on small-world neural networks”, Proceedings of the Santa Fe Institute Complex Systems Summer School, 2007.
O. Sporns, D.R. Chialvo, M. Kaiser, C.C. Hilgetag, “Organization, development and function of complex brain networks”, Trends in Cognitive Sciences, Vol. 86, pp. 418–425, 2004.
D.S. Bassett, E. Bullmore, “Small-world brain networks”, The Neuroscientist, Vol. 12, pp. 512–523, 2006.
M. Ozer, M. Perc, M. Uzuntarla, “Controlling the spontaneous spiking regularity via channel blocking on NewmanWatts networks of Hodgkin-Huxley neurons”, Europhysics Letters, Vol. 86, 40008, 2009.
M. Ozer, M. Perc, M. Uzuntarla, “Stochastic resonance on Newman-Watts networks of Hodgkin-Huxley neurons with local periodic driving”, Physics Letters A, Vol. 373, pp. 964–968, 2009.
M. Ozer, M. Uzuntarla, T. Kayık¸ cıo˘ glu, L.J. Graham, “Collective temporal coherence for subthreshold signal encoding on a stochastic small-world Hodgkin-Huxley neuronal network”, Physics Letters A, Vol. 372, pp. 6498– 6503, 2008.
M. Ozer, M. Uzuntarla, “Effects of the network structure and coupling strength on the noise-induced response delay of a neuronal network”, Physics Letters A, Vol. 372, pp. 4603–4609, 2008.
L. Bartoli, P. Fariselli, R. Casadio, “The effect of backbone on the small-world properties of protein contact maps”, Physical Biology, Vol. 4, L1–L5, 2007.
A. Scala, L.A. Nunes Amaral, M. Barth´ el´ emy, “Small-world networks and the conformation space of a short lattice polymer chain”, Europhysics Letters, Vol. 55, pp. 594–600, 2001.
T. Walsh, “Search in a small world”, Joint Conference on Artificial Intelligence, pp. 1172–1177, 1999.
L.F. Lago-Fernandez, R. Huerta, F. Corbacho, J.A. Siguenza, “Fast response and temporal coherent oscillations in small-world networks”, Physical Review Letters, Vol. 84, pp. 2758–2761, 2000.
D. Simard, L. Nadeau, H. Kr¨ oger, “Fastest learning in small-world neural networks”, Physics Letters A, Vol. 336, pp. 8–15, 2005.
Y. Shuzhong, L. Siwei, Li. Jianyu, “Building multi-layer small world neural network”, Lecture Notes in Computer Science Series, Vol. 3971, pp. 695–700, 2006.
L.G. Morelli, G. Abramson, M.N. Kuperman, “Associative memory on a small-world neural network” European Physical Journal B, Vol. 38, pp. 495–500, 2004.
C.L. Labiouse, A.A. Salah, I. Starikova, “The impact of connectivity on the memory capacity and the retrieval dynamics of Hopfield-type networks”, Proceedings of the Santa Fe Complex Systems Summer School, 2002.
D.J. Watts, Small Worlds: The Dynamics of Networks between Order and Randomness, New Jersey, Princeton University Press, 2003.
D.J. Watts, Six Degrees: The Science of a Connected Age, London, Heinemann, 2003.
V. Latora, M. Marchiori, “Efficient behavior of small-world networks”, Physical Review Letters, Vol. 87, 2001. V. Latora, M. Marchiori, “Economic small-world behavior in weighted networks”, European Physical Journal B – Condensed Matter, Vol. 32, pp. 249–263, 2003.
O. Erkaymaz, M. Ozer, N. Yumusak,” Effect of small-world network topology on learning in feed forward neural network”, Symposium on Innovations in Intelligent Systems and Applications, Vol. 132, 2010.
M. Stone, “Cross-validation choice and assessment of statistical predictions (with discussion)”, Journal of the Royal Statistical Society, Vol. 36, pp. 111–147, 1974.
M. Caner, E. Gedik, A. Kecebas, “Investigation on thermal performance calculation of two type solar air collectors using artificial neural network”, Expert Systems with Applications, Vol. 38, pp. 1668–1674, 2011.
B.L. Welch, “The generalization of ‘student’s’ problem when several different population variances are involved”, Biometrika, Vol. 34, 1947.
F. Yapıcı, “The effect of some production factors on the properties of OSB made from scotch pine (pinus sylvestris l.) wood”, Zonguldak Karaelmas University, 2008.
TS 642/ISO 554, Standard atmospheres and/or testing; Specifications, 1997.
TS EN 310, Wood-based panels. Determination of modulus of elasticity and of bending strength, TSE, 1999.