Optimal feature selection for 3D facial expression recognition using coarse-to-fine classification

Automatic facial expression recognition for novel individuals from 3D face data is a challenging task in pattern analysis. This paper describes a feature selection process for pose-invariant 3D facial expression recognition. The process provides a lower dimensional subspace representation, which is optimized to improve the classification accuracy, retrieved from geometrical localization of facial feature points to classify facial expressions. Fisher criterion-based approach is adopted to provide a basis for the optimal selection of features. Two-stage probabilistic neural network architecture is employed as a classifier to recognize the facial expressions. In the first stage, which can be regarded as the coarse classification, the facial expressions are classified into one of the three expression groups formed using seven basic facial expressions. In the fine classification stage, final expression is determined by using within group classification. Facial expressions such as Neutral, Anger, Disgust, Fear, Happiness, Sadness, and Surprise are successfully recognized with an average recognition rate of 93.72%.

Anahtar Kelimeler:

Turk. J. Elec. Eng. & Comp. Sci., 18, (2010), 1031-1040. Full text: pdf Other articles published in the same issue: Turk. J. Elec. Eng. & Comp. Sci., vol.18, iss.6.

Optimal feature selection for 3D facial expression recognition using coarse-to-fine classification

Keywords:

Turk. J. Elec. Eng. & Comp. Sci., 18, (2010), 1031-1040. Full text: pdf Other articles published in the same issue: Turk. J. Elec. Eng. & Comp. Sci., vol.18, iss.6.,

PDF

___

P. Ekman, W. Friesen, The facial action coding system: a technique for the measurement of facial movement, San Francisco, Consulting Psychologists, 1978.
P. Ekman, T. Huang, T. Sejnowski, J. Hager, Final report to NSF of the planning workshop on facial expression understanding, San Francisco, Human Interaction Lab, 1993.
J. Wang, L. Yin, Facial expression representation and recognition from static images using topographic context, In Technical Report, Department of Computer Science, SUNY at Binghamton, 2005.
L. Yin, X. Z. Wei, M. Rosato, “A 3D facial expression database for facial behavior research”, 7th International Conference on Automatic Face and Gesture Recognition, pp. 211-216, 2006.
J. Wang, L. Yin, X. Wei, Y. Sun, “3D facial expression recognition based on primitive surface feature distribution”, Computer Vision and Pattern Recognition, Vol. 2, pp. 1399 -1406, 2006.
H. Tang, T. S. Huang, “3D Facial expression recognition based on properties of line segments connecting facial feature points”, IEEE International Conference on Automatic Face and Gesture Recognition, pp.1-6, 2008.
H. Tang, T. S. Huang, “3D facial expression recognition based on automatically selected features”, Computer Vision and Pattern Recognition, pp.1-8, 2008.
Mpiperis, S. Malassiotis, M. G. Strintzis, “Bilinear Models for 3D Face and Facial Expression Recognition”, IEEE Transactions on Information Forensics and Security, Vol. 3, pp. 498-511, 2008.
V. A. Labay, J. Bornemann, “Matrix Singular Value Decomposition for Pole-Free Solutions of Homogeneous Matrix Equations as Applied to Numerical Modeling Methods”, IEEE Microwave and Guided Wave Letters, Vol.2, pp.49-51, 1992.
H. Soyel, H. Demirel, “Facial Expression Recognition using 3D Facial Feature Distances”, Lecture Notes in Computer
Science, Vol. 4633, pp. 831-838, 2007.
H. Soyel, H. Demirel, “3D Facial Expression Recognition with Geometrically Localized Facial Features”, Computer
and Information Sciences, pp. 1-4, 2008.