Haibo LIU, Guanming LU, Jingjie YAN, Ning SUN, Zhengyan ZHAO, Xia LI

Compact local Gabor directional number pattern for facial expression recognition

This paper explores a novel method to represent face images for facial expression recognition; it is namedcompact local Gabor directional number pattern (CLGDNP). By convolving the face images with Gabor filters, we encodethe magnitude and phase response images in each scale, and calculate the histograms in several nonoverlapping regions ofeach encoded image. Finally, we obtain two spatial histogram sequences by the aid of the mean pooling technology andconcatenate them to form the facial descriptor. Moreover, for evaluating the performance of the proposed method, weemploy a support vector machine to conduct some extensive classification experiments on the Radboud faces database,the extended Cohn-Kanade database, and the Japanese Female Facial Expression database. The experimental resultsdemonstrate that the proposed CLGDNP method achieves better performance in classification.

PDF

___

Lee SH, Yong MR. Intra-class variation reduction using training expression images for sparse representation based facial expression recognition. IEEE T Affect Comput 2017; 5: 340-351.
Liu MY, Shan SG, Wang RP, Chen XL. Learning Expressionlets on Spatio-temporal Manifold for Dynamic Facial Expression Recognition. In: IEEE Conference on Computer Vision and Pattern Recognition; 23–28 June 2014; Columbus, OH, USA. New York, NY, USA: IEEE. pp. 1749-1756.
Abdi H, Williams LJ. Principal component analysis. Wiley Interdisciplinary Reviews: Computational Statistics 2010; 2: 433-459.
Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 8–14 December 2001; Kauai, HI, USA. New York, NY, USA: IEEE. pp. I-511-518.
Xue ML, Liu WQ, Li L. Person-independent facial expression recognition via hierarchical classification. In: IEEE 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing; 2–5 April 2013; Melbourne, VIC, Australia. New York, NY, USA: IEEE. pp. 449-454.
Lyons M, Akamatsu S, Kamachi M, Gyoba J. Coding facial expressions with Gabor wavelets. In: IEEE International Conference on Automatic Face and Gesture Recognition; 14–16 April 1998; Nara, Japan. New York, NY, USA: IEEE. pp. 200-205.
Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I. The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops; 13–18 June 2010; San Francisco, CA, USA. New York, NY, USA: IEEE. pp. 94-101.
Langner O, Dotsch R, Bijlstra G, Wigboldus DH, Wigboldus DHJ. Presentation and validation of the Radboud faces database. Cogn Emot 2010; 24: 1377-1388
Chang CC, Lin CJ. LIBSVM: a library for support vector machines. ACM T Intel Syst Tec 2011; 2: 1-27.
Zhang WC, Shan SG, Gao W, Chen XL, Zhang HM. Local Gabor binary pattern histogram sequence (LGBPHS): a novel nonstatistical model for face representation and recognition. In: IEEE International Conference on Computer Vision; 17–21 October 2005; Beijing, China. New York, NY, USA: IEEE. pp. 786-791.
Rivera AR, Castillo JR, Chae O. Local directional number pattern for face analysis: face and expression recognition. IEEE T Image Process 2013; 22: 1740-1752.
Kabir H, Jabid T, Chae O. Local directional pattern variance (LDPv): a robust feature descriptor for facial expression recognition. Int Arab J Inf Techn 2012; 9: 382-391.
Jabid T, Kabir MH, Chae O. Robust facial expression recognition based on local directional pattern. ETRI J 2010;32: 784-794.
Ahonen T, Hadid A, Pietikainen M. Face description with local binary patterns: Application to face recognition.IEEE T Pattern Anal 2006; 28: 2037-2041.
Qing LY, Shan SG, Chen XL, Gao W. Face recognition under varying lighting based on the probabilistic model of Gabor phase. In: 18th International Conference on Pattern Recognition (ICPR); 20–24 August 2006; Hong Kong, China. New York, NY, USA: IEEE. pp. 1139-1142.
Bereta M, Pedrycz W, Reformat M. Local descriptors and similarity measures for frontal face recognition: a comparative analysis. J Vis Commun Image R 2013; 24: 1213-1231.
Shen LL, Bai L. MutualBoost learning for selecting Gabor features for face recognition. Pattern Recogn Lett 2006; 27: 1758-1767.
Shan CF, Gong SG, McOwan PW. Facial expression recognition based on local binary patterns: a comprehensive study. Image Vision Comput 2009; 27: 803-816.
Hasani B, Mahoor BH. Facial expression recognition using enhanced deep 3D convolutional neural networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops; 21–26 July 2017; Honolulu, HI, USA. New York, NY, USA: IEEE. pp. 2278-2288.
Mollahosseini A, Chan D, Mahoor MH. Going deeper in facial expression recognition using deep neural networks. In: 2016 IEEE Winter Conference on Applications of Computer Vision; 7–10 March 2016; Lake Placid, NY, USA. New York, NY, USA: IEEE. pp. 1-10.
Liu MY, Li SX, Shan SG, Wang RP, Chen XL. Deeply learning deformable facial action parts model for dynamic expression analysis. In: Asian Conference on Computer Vision; 1–5 November 2014; Singapore. Springer. pp. 143-157
Wang M, Hu ZP, Sun Z, Zhu M, Sun M. Sample group and misplaced atom dictionary learning for face recognition. Turk J Elec Eng & Comp Sci 2017; 25: 4421-4430.
Tian Y, Kanade T, Cohn JF. Facial expression recognition. In: Li SZ, Jain AK, editors. Handbook of Face Recognition. London, UK: Springer, 2011. pp. 487-519.
Zavaschi THH, Britto AS Jr , Oliveira LES, Koerich AL. Fusion of feature sets and classifiers for facial expression recognition. Expert Syst Appl 2013; 40: 646-655.
Calvo MG, Nummenmaa L. Perceptual and affective mechanisms in facial expression recognition: an integrative review. Cogn Emot 2016; 30: 1081-1106.
Zhang S, Wu ZY, Meng HM, Cai LH. Facial expression synthesis based on emotion dimensions for affective talking avatar. In: Nishida T, Jain LC, Faucher C, editors. Modeling Machine Emotions for Realizing Intelligence. Berlin,Germany: Springer, 2010. pp. 109-132.