Motion clustering on video sequences using a competitive learning network

It is necessary to track human movements in crowded places and environments such as stations, subways, metros, and schoolyards, where security is of great importance. As a result, undesired injuries, accidents, and unusual movements can be determined and various precautionary measures can be taken against them. In this study, real-time or existing video sequences are used within the system. These video sequences are obtained from objects such as humans or vehicles, moving actively in various environments. At first, some preprocesses are made respectively, such as converting gray scale, finding the edges of the objects existing in the images, and thresholding the images. Next, motion vectors are generated by utilizing a full search algorithm. Afterwards, k-means, nearest neighbor, image subdivision, and a competitive learning network are used as clustering methods to determine dense active regions on the video sequence using these motion vectors, and then their performances are compared. It is seen that the competitive learning network significantly determines the classification of dense active regions, including motion. Moreover, the algorithms are analyzed in terms of their time performances.

Anahtar Kelimeler:

Motion estimation, competitive learning network, video processing, clustering

Motion clustering on video sequences using a competitive learning network

Keywords:

Motion estimation, competitive learning network, video processing, clustering,

PDF

___

L. Shao, L. Ji, Y. Liu, J. Zhang, “Human action segmentation and recognition via motion and shape analysis”, Pattern Recognition Letters, Vol. 33, pp. 438–445, 2012.
S.J. McKenna, S. Jabri, Z. Duric, H. Wechsler, A. Rosenfeld, “Tracking groups of people”, Computer Vision and Image Understanding, Vol. 80, pp. 42–56, 2000.
C. Maduro, K. Batista, P. Peixoto, J. Batista, “Estimation of vehicle velocity and traffic intensity using rectified images”, 15th IEEE International Conference on Image Processing, pp. 777–780, 2008.
H.S. Mohana, M. Ashwathakumar, G. Shivakumar, “Vehicle detection and counting by using real time traffic flux through differential technique and performance evaluation”, International Conference on Advanced Computer Control, pp. 791–795, 2009.
C. Ozkurt, F. Camci, “Automatic traffic density estimation and vehicle classification for traffic surveillance systems using neural networks”, Mathematical and Computational Applications, Vol. 14, pp. 187–196, 2009.
H. Xiong, M.N.S. Swamy, M.O. Ahmad, I. King, “Branching competitive learning network: a novel self-creating model”, IEEE Transactions on Neural Network, Vol. 15, pp. 417–429, 2004.
J.Z. Lei, A. Ghorbani, “Network intrusion detection using an improved competitive learning neural network”, Communication Networks and Services Research, pp. 190–197, 2004.
H. Gu, “Adaptive synchronization for competitive neural networks with different time scales and stochastic perturbation”, Neurocomputing, Vol. 73, pp. 350–356, 2009.
J. Steffen, M. Pardowitz, J.J. Steil, H. Ritter, “Integrating feature maps and competitive layer architectures for motion segmentation”, Neurocomputing, Vol. 74, pp. 1372–1381, 2011.
J.M. J¨ ager, W.I. Sch¨ ollhorn, “Identifying individuality and variability in team tactics by means of statistical shape analysis and multilayer perceptrons”, Human Movement Science, Vol. 31, pp. 303–317, 2012.
J. Chey, S. Grossberg, E. Mingolla, “Neural dynamics of motion processing and speed discrimination”, Vision Research, Vol. 38, pp. 2769–2786, 1998.
J.C. Bazin, C. Demonceaux, P. Vasseur, I.S. Kweon, “Motion estimation by decoupling rotation and translation in catadioptric vision”, Computer Vision and Image Understanding, Vol. 114, pp. 254–273, 2010.
J.H. Kim, M.J. Chung, B.T. Choi, “Recursive estimation of motion and a scene model with a two camera system of divergent view”, Pattern Recognition, Vol. 43, pp. 2265–2280, 2010.
J. Kim, M. Hwangbo, T. Kanade, “Spherical approximation for multiple cameras in motion estimation: its applicability and advantages”, Computer Vision and Image Understanding, Vol. 114, pp. 1068–1083, 2010.
S. Khalid, “Activity classification and anomaly detection using m-mediods based modelling of motion patterns”, Pattern Recognition, Vol. 43, pp. 3636–3647, 2010.
S. G¨ org¨ uno˘ glu, S ¸. Altay, B. S ¸en, “Estimation of dominant motion direction on video sequences”, 2nd International Symposium on Computing in Science & Engineering, pp. 9–15, 2011.
A. C ¸ avu¸so˘ glu, S. G¨ org¨ uno˘ glu, “A fast fingerprint image enhancement algorithm using a parabolic mask”, Computers & Electrical Engineering, Vol. 34, pp. 250–256, 2008.
Z. Telatar, “Video dizilerinde ayrıt sezmeye dayalı hareket kestirimi”, Gazi ¨ Universitesi M¨ uhendislik Mimarlık Dergisi, Vol. 24, pp. 245–255, 2009 (article in Turkish).
R.T.N. Rajaram, V. Vasudevan, “Optimisation of the one-dimensional full search algorithm and implementation using an EPLD”, 13th International Conference on VLSI Design, pp. 336–341, 2000.
Z. Jing, J. Liangbao, C. Xuehong, “Implementation of parallel full search algorithm for motion estimation on multi-core processors”, 2nd International Conference on Next Generation Information Technology, pp. 31–35, 2011. A.V. Paramkusam, V.S.K. Reddy, “An optimal fast full search motion estimation algorithm in video coding”, International Conference on Signal Processing, Communication, Computing and Networking Technologies, pp. 598– 603, 2011.
E. Arcaklio˘ glu, A. C ¸ avu¸so˘ glu, A. Eri¸sen, “Thermodynamic analysis of refrigerant mixtures for possible replacements for CFCs by an algorithm compiling property data”, Applied Thermal Engineering, Vol. 26, pp. 430–439, 2006.
E. Arcaklio˘ glu, A. C ¸ avu¸so˘ glu, A. Eri¸sen, “An algorithmic approach towards finding better refrigerant substitutes of CFCs in terms of the second law of thermodynamics”, Energy Conversion and Management, Vol. 46, pp. 1595–1611, 200
M. Laszlo, S. Mukherjee, “A genetic algorithm that exchanges neighboring centers for k-means clustering”, Pattern Recognition Letters, Vol. 28, pp. 2359–23661, 2007.
K.L. Chung, J.S. Lin, “Faster and more robust point symmetry-based k-means algorithm”, Pattern Recognition, Vol. 40, pp. 410–422, 2007.
M.C. Chiang, C.W. Tsai, C.S. Yang, “A time-efficient pattern reduction algorithm for k-means clustering”, Information Sciences, Vol. 181, pp. 716–731, 2011.
Y. Zeng, Y. Yang, L. Zhao, “Pseudo nearest neighbor rule for pattern classification”, Expert Systems with Applications, Vol. 36, pp. 3587–3595, 2009.
S.H. Cha, S.N. Srihari, “A fast nearest neighbor search algorithm by filtration”, Pattern Recognition, Vol. 35, pp. 515–525, 2002.
G. Beliakov, G. Li, “Improving the speed and stability of the k-nearest neighbors method”, Pattern Recognition Letters, Vol. 33, pp. 1296–1301, 2012.
N. Garc´ıa-Pedrajas, D. Ortiz-Boyer, “Boosting k-nearest neighbor classifier by means of input space projection”, Expert Systems with Applications, Vol. 36, pp. 10570–10582, 2009.
K. Sasazaki, S. Saga, J. Maeda, Y. Suzuki, “Vector quantization of images with variable block size”, Applied Soft Computing, Vol. 8, pp. 634–645, 2008.
K.L. Chung, P.C. Chen, “An efficient algorithm for computing moments on a block representation of a grey-scale image”, Pattern Recognition, Vol. 38, pp. 2578–2586, 2005.
E. Bernardis, S.X. Yu, “Pop out many small structures from a very large microscopic image”, Medical Image Analysis, Vo1. 15, pp. 690–707, 2011.
L. Nanni, A. Lumini, “Descriptors for image-based fingerprint matchers”, Expert Systems with Applications, Vol. 36, pp. 12414–12422, 2009.
S. Yi˘ git, R. Eryi˘ git, F.V. C ¸ elebi, “Optical gain model proposed with the use of artificial neural networks optimised by artificial bee colony algorithm”, Optoelectronics and Advanced Materials – Rapid Communications, Vol. 5, pp. 1026–1029, 2011.
S. Tankiz, F.V. Celebi, R. Yildirim, “Computer aided design model for a quantum-cascade laser”, IET Circuits, Devices & Systems, Vol. 5, pp. 143–147, 2011. N. S¨ ut, Y. C ¸ elik, “Prediction of mortality in stroke patients using multilayer perceptron neural networks”, Turkish Journal of Medical Sciences, Vol. 42, pp. 886–893, 2012.
B. Ta¸sdelen, S. Helvacı, H. Kalea˘ gası, A. ¨ Ozge, “Artificial neural network analysis for prediction of headache prognosis in elderly patients”, Turkish Journal of Medical Sciences, Vol. 39, pp. 5–12, 2009.
O. Er, N. Yumusak, F. Temurtas, “Chest diseases diagnosis using artificial neural networks”, Expert Systems with Applications, Vol. 37, pp. 7648–7655, 2010.
S. Yigit, B. Tugrul, F.V. Celebi, “A complete CAD model for type-I quantum cascade lasers with the use of artificial bee colony algorithm”, Journal of Artificial Intelligence, Vol. 5, pp. 76–84, 2012.
F.V. Celebi, T. Altindag, “An accurate optical gain model using adaptive neuro-fuzzy inference system”, Optoelectronics and Advanced Materials Rapid Communications”, Vol. 3, pp. 975–977, 2009.
F.V. Celebi, “A different approach to gain computation in laser diodes with respect to different number of quantumwells”, Optik, Vol. 116, pp. 375–378, 2005.
F.V. Celebi, K. Danisman, “Neural estimator to determine alpha parameter in terms of quantum-well number”, Optics & Laser Technology, Vol. 37, pp. 281–285, 2005.
F.V. Celebi, K. Danisman, “A different approach for the computation of refractive index change in quantumwell diode lasers for different injection levels”, Proceedings of the SPIE – The International Society for Optical Engineering, Vol. 61, pp. 384–388, 2004.
S. Partal, ˙I. S ¸enol, A.F. Bakan, K.N. Bekiro˘ glu, “Online speed control of a brushless AC servomotor based on artificial neural networks”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 19, pp. 373–383, 20 O. ¨ Ozg¨ onenel, T. Yal¸ cın, “A complete motor protection algorithm based on PCA and ANN: a real time study”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 19, pp. 317–334, 2011.
M. Akta¸s, H.˙I. Okumu¸s, “Stator resistance estimation using ANN in DTC IM drives”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 18, pp. 197–210, 2010.
˙I. Dalkıran, K. Danı¸sman, “Artificial neural network based chaotic generator for cryptology”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 18, pp. 225–240, 2010.
G. Vachkov, Y. Kiyota, K. Komatsu, S. Fujii, “Real-time classification algorithm for recognition of machine operating modes by use of self-organizing maps”, Turkish Journal of Electrical Engineering & Computer Sciences, Vol. 12, pp. 27–42, 2004.
K. Radhakrishnan, H. Larijani, “Evaluating perceived voice quality on packet networks using different random neural network architectures”, Performance Evaluation, Vol. 68, pp. 347–360, 2011.
J.D. Wu, S.H. Ye, “Driver identification based on voice signal using continuous wavelet transform and artificial neural network techniques”, Expert Systems with Applications, Vol. 36, pp. 1061–1069, 2009.
F.V. C ¸ elebi, “A proposed CAD model based on amplified spontaneous emission spectroscopy”, Journal of Optoelectronics and Advanced Materials, Vol. 7, pp. 1573–1579, 2005.
R. Kumar, B.R. Deva Vikram, “Fingerprint matching using multi-dimensional ANN”, Engineering Applications of Artificial Intelligence, Vol. 23, pp. 222–228, 2010.
J.D. Wu, C.T. Liu, “Finger-vein pattern identification using SVM and neural network technique”, Expert Systems with Applications, Vol. 38, pp. 14284–14289, 2011.
M.M.M. Fahmy, “Online handwritten signature verification system based on DWT features extraction and neural network classification”, Ain Shams Engineering Journal, Vol. 1, pp. 59–70, 2010.
A. Fallah, M. Jamaati, A. Soleamani, “A new online signature verification system based on combining Mellin transform, MFCC and neural network”, Digital Signal Processing, Vol. 21, pp. 404–416, 2011.
L. Chen, W. Xue, N. Tokuda, “Classification of 2-dimensional array patterns: assembling many small neural networks is better than using a large one”, Neural Networks, Vol. 23, pp. 770–781, 2010. Anbazhagan, N. Kumarappan, “A neural network approach to day-ahead deregulated electricity market prices classification”, Electric Power Systems Research, Vol. 86, pp. 140–150, 2012.
S. Kulluk, L. Ozbakir, A. Baykasoglu, “Training neural networks with harmony search algorithms for classification problems”, Engineering Applications of Artificial Intelligence, Vol. 25, pp. 11–19, 2012.
M. Ghiassi, C. Burnley, “Measuring effectiveness of a dynamic artificial neural network algorithm for classification problems”, Expert Systems with Applications, Vol. 37, pp. 3118–3128, 2010.
Y. Yang, K. Chen, “An ensemble of competitive learning networks with different representations for temporal data clustering”, International Joint Conference on Neural Networks, pp. 3120–3127, 2006.
J. Liu, M. Gao, “Unsupervised classification algorithm for intrusion detection based on competitive learning network”, International Symposium on Information Science and Engineering, Vol. 1, pp. 519–523, 2008.