Fatih KAHRAMAN, Muhittin GÖKMEN -, Sune DARKNER, Rasmus LARSEN

Active illumination and appearance model for face alignment

Illumination conditions have an explicit effect on the performance of face recognition systems. In particular, varying the illumination upon the face imposes such complex effects that the identification often fails to provide a stable performance level. In this paper, we propose an approach integrating face identity and illumination models in order to reach acceptable and stable face recognition rates. For this purpose, Active Appearance Model (AAM) and illumination model of faces are combined in order to obtain an illumination invariant face localization. The proposed method is an integrated Active Illumination and Appearance Model (AIA) which combines identity, illumination and shape components in a single model and allows us to control them, separately. One of the major advantage of the proposed AIA model is that efficient model fitting is achieved, whilst maintaining performance against illumination changes. In addition to model fitting, images illuminated from different directions can easily be synthesized by changing the parameters related to illumination modes. The method provides a practical approach, since only one image with frontal illumination of each person for training, is sufficient. There is no need to build complex models for illumination. As a result, this paper has presented a simple and efficient method for face modeling and face alignment in order to increase the performance of face localization by means of the proposed illumination invariant AIA method for face alignment, such as the Active Appearance Models, invariant to changes in illumination. From the experimental results, we showed that the proposed AIA model provides higher accuracy than classical Active Appearance Model for face alignment in a point-to-point error sense.

Anahtar Kelimeler:

AIA, alignment, illumination, face modeling, sub-spaces, active appearance

Active illumination and appearance model for face alignment

Keywords:

AIA, alignment, illumination, face modeling, sub-spaces, active appearance,

PDF

___

Belhumeur P. N., Hespanha J. P. and Kriegman D. J., ”Eigenfaces vs. Fisherfaces: Recognition using class speciŞc linear projection”, IEEE Trans. on PAMI, Vol. 19, No.7, pp. 711-720, 1997.
Zhao W. and Chellappa R., ”SFS Based View Synthesis for Robust Face Recognition,” In Proc. of 4th Conf. on AFGR, pp. 285-292, 2000.
Georghiades A. S. and Belhumeur P. N., ”From Few to many: Illumination cone models for face recognition under variable lighting and pose”, IEEE Trans. on PAMI, Vol. 23, No. 6, pp. 643-660, 2001.
Ramamoorthi R., ”Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object”, IEEE Trans. PAMI, Vol. 24, No. 10, 2002.
Basri R. and Jacobs D., ”Photometric Stereo with General, Unknown Lighting”, IEEE Conf. on CVPR, Kauai, Vol. 2, pp. 374-381, 2001.
Zhou S., Aggarwal G., Chellappa R. and Jacobs D., ”Appearance characterization of linear lambertian objects, generalized photometric stereo, and illumination invariant face recognition”, IEEE Trans. on PAMI, Vol. 29, 230- 245, 2007.
Lee J., Moghaddam B., PŞster H. and Machiraju R.,”A bilinear illumination model for robust face recognition” IEEE Conf. on ICCV, pp. 1177-1184, 2005.
Shashua A. and Riklin T., ”The Quotient Image: Class-Based Re-Rendering and Recognition With Varying Illuminations”, IEEE Trans. on PAMI, pp. 129-139, 2001.
Wang H., Li S. Z. and Wang Y., “Generalized quotient image”, IEEE Proceeding Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 498-505, 2004.
Zhang Y., Tian J., He X. and Yang X., “MQI Based Face Recognition Under Uneven Illumination”, Advances in Biometrics, Vol. 4642, pp. 290-298, 2007.
An G., Wu J. and Ruan Q., “Kernel TV-Based Quotient Image Employing Gabor Analysis and Its Application to Face Recognition”, IEICE Transactions on Information and Systems, Vol. E91-D, No. 5, pp. 1573-1576, 2008.
Zou X., Kittler J. and Messer K., “Illumination Invariant Face Recognition: A Survey”, First IEEE International Conference on Biometrics: Theory, Applications, and Systems, pp. 1-8, 2007.
Sim T. and Kanade T., “Combining models and exemplars for face recognition: An illuminating example”, In Proc. CVPR 2001 Workshop on Models versus Exemplars in Computer Vision, 2001.
Zhang L. and Samaras D., “Face recognition under variable lighting using harmonics image examplars”, In Proc. IEEE Conf. on CVPR, pp. 19-25, 2003.
Basri R. and Jacops D., “Lambertian reﬂectance and linear sub-spaces”, IEEE Trans. on PAMI, 25, pp.383-30, 2003.
Chen H., Belhumeur P. and Jacops D., “In search of illumination invariants”, In Proc. IEEE Conf. on CVPR, pp. 1-8, 2000.
Lee K., Ho J. and Kriegman D., “Nine points of lights:acquiring sub-spaces for face recognition under variable lighting”, In Proc. IEEE Conf. on CVPR, pp. 519-526, 2001.
Zhao W. and Chellappa R., “Face Processing:Advanced Modeling and Methods”, Academic Press, Elsevier, 2006. [19] Gross R., Baker S., Matthews I., Kanade T., “Face recognition across pose and illumination”, Handbook of Face Recognition, Springer-Verlag, 2004.
Kass M., Witkin A., Terzopoulos D., “Snakes, Active contour models,” 1st Int. Conf. on Computer Vision, pp. 259-268, 1987. [21] Kirby M., Sirovich L., “Application of the Karhunen-Loeve procedure for the characterization of human faces,” IEEE Trans. on PAMI, Vol. 12, No. 1, pp. 103-108, 1990.
Cootes T. F., Taylor C. J. , Cooper D. H. , Graham J., “Active Shape Models - their training and application,” Computer Vision and Image Understanding, Vol. 61, No. 1, pp. 38-59, 1995.
Cootes T. F., Edwards G. J., Taylor C. J., “Active appearance models,” IEEE Trans. on PAMI, Vol. 23, No.6, pp. 681-685, 2001. [24] Stegmann M. B., Ersboll B. K., Larsen R., FAME - A Flexible Appearance Modelling Environment, IEEE Trans- actions on Medical Imaging, vol. 22(10), pp. 1319-1331, 2003.
Blanz V. and Vetter T., “Face recognition based on Ştting a 3D morphable model”, IEEE Trans. on PAMI, Vol. 25, No.9, pp. 1063-1074, 2003.
Ming Z., Stan Z. L., Chun C., “Subspace analysis and optimization for active appearance model based face alignment,” In Proc. of 6th Conf. on AFGR, pp.290-295, 2004.
Goodall C., “Procrustes methods in the statistical analysis of shape”, Journal of Royal Statistical Society, Vol. 53, pp. 285-339, 1991.
Glasbey C. A. and Mardia K. V., “A review of image warping methods”, Journal of Applied Statistics, Vol. 25, pp. 155-171, 1998. [29] Georghiades A. S., Belhumeur P. N., and Kriegman D. J., “From Few to Many: Generative Models for Recognition Under Variable Pose and Illumination”, In Proc. of 4th Conf. on AFGR, 2000.