A fast and accurate algorithm for eye opening or closing detection based on local maximum vertical derivative pattern

In this paper, a fast and accurate algorithm is proposed to recognize open and closed eye states. In the proposed algorithm, first a hierarchical preprocessing stage is used to detect eye areas. This stage employs Haar features to detect face area, color, and intensity mappings to extract eye candidate areas, and some simple geometrical relations for a final decision of the eye regions. In the second stage of the algorithm for detecting eye state, a new proposed descriptor based on a histogram of local maximum vertical derivative patterns in eye areas is extracted and applied to a support vector machine classifier. The proposed descriptor, while having low computational complexity, is defined well enough to describe eye features and hence can distinguish well between open and closed eyes. Experimental results from test images show that the proposed algorithm can correctly detect the eye state by the rate of 98.2%, which is higher than other similar algorithms.

PDF

___

[1] Dong W, Wu X. Fatigue detection based on the distance of eyelid. In: IEEE International Workshop on VLSI Design and Video Technology; 2005. New York, NY, USA: IEEE. pp. 365-368.
[2] Yunqi L, Meiling Y, Xiaobing S, Xiuxia L, Jiangfan O. Recognition of eye states in real time video. In: International Conference on Computer Engineering and Technology; 2009. pp. 554-559.
[3] Guo J, Guo X. Eye state recognition based on shape analysis and fuzzy logic. In: Intelligent Vehicles Symposium; 2009. pp. 78-82.
[4] Alioua N, Amine A, Rziza M, Aboutajdine D. Eye state analysis using iris detection based on circular Hough transform. In: International Conference on Multimedia Computing and Systems; 2011. pp. 1-5.
[5] Zoroofi RA, Tabrizi PR. Open/closed eye analysis for drowsiness detection. In: First Workshops on Image Processing Theory, Tools & Applications; 2008. pp. 1-7.
[6] Du Y, Ma P, Su X, Zhang Y. Driver fatigue detection based on eye state analysis. In: 11th Joint Conference on Information Sciences; 2008.
[7] Liu X, Tan X, Chen S. Eyes closeness detection using appearance based methods. In: 7th International Conference on IFIP Advances in Information and Communication Technology; 2012. pp. 398-408.
[8] Yutian F, Dexuan H, Pingqiang, N. A combined eye states identification method for detection of driver fatigue. In: International Communication Conference on Wireless Mobile and Computing; 2009. pp. 217-220.
[9] Fa-Deng G, Min-Xian H. Study on the detection of locomotive driver fatigue based on image. In: 2nd International Conference on Computer Engineering and Technology; 2010. pp. 612-615.
[10] Zhou L, Wang H. Open/closed eye recognition by local binary increasing intensity patterns. In: 5th International Conference on Robotics, Automation and Mechatronics; 2011. pp. 7-11.
[11] Qin H, Liu J, Hong T. An eye state identification method based on the embedded hidden Markov model. In: IEEE International Conference on Vehicular Electronics and Safety; 2012. New York, NY, USA: IEEE. pp. 255-260.
[12] Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2001. New York, NY, USA: IEEE. pp. 511-518.
[13] Hsu RL, Abdel-Mottaleb M, Jain AK. Face detection in color images. IEEE T Pattern Anal Mach Intell 2002; 24: 696-706.
[14] Beigzadeh M, Vafadoost M. Detection of face and facial features in digital images and video frames. In: Cairo International Biomedical Engineering Conference; 2008. pp. 1-4.
[15] Zhang B, Gao Y, Zhao S, Liu J. Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE T Image Process 2010; 19: 533-544.
[16] Ramirez Rivera A, Rojas Castillo JA, Chae O. Recognition of face expressions using local principal texture pattern. In: 19th IEEE International Conference on Image Processing; 2012. New York, NY, USA: IEEE. pp. 2609-2612.
[17] Castillo JAR, Rivera AR, Chae O. Facial expression recognition based on local sign directional pattern. In: 19th IEEE International Conference on Image Processing; 2012. New York, NY, USA: IEEE. pp. 2613-2616.
[18] Huang D, Shan C, Ardabilian M, Wang Y, Chen L. Local binary patterns and its application to facial image analysis: a survey. IEEE T Syst Man Cy C 2011; 41: 765-781.
[19] Bai G, Zhu Y, Ding Z. A hierarchical face recognition method based on local binary pattern. In: Congress on Image Signal Process; 2008. pp. 610-614.