×

Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform. (English) Zbl 1207.68328

Summary: Face recognition under varying lighting conditions is challenging, especially for single image based recognition systems. Exacting illumination invariant features is an effective approach to solve this problem. However, existing methods can hardly extract both multi-scale and multi-directivity geometrical structures at the same time, which is important for capturing the intrinsic features of a face image. In this paper, we propose to utilize the logarithmic nonsubsampled contourlet transform (LNSCT) to estimate the reflectance component from a single face image, and refer it as the illumination invariant feature for face recognition, where NSCT is a fully shift-invariant, multi-scale, and multi-direction transform. LNSCT can extract strong edges, weak edges and noise from a face image using NSCT in the logarithm domain. We analyze that in the logarithm domain the low-pass subband of a face image and the low frequency part of strong edges can be regarded as the illumination effects, while the weak edges and the high frequency part of strong edges can be considered as the reflectance component. Moreover, even though a face image is polluted by noise (in particular the multiplicative noise), the reflectance component can still be well estimated and meanwhile the noise is removed. The LNSCT can be applied flexibly, as neither assumption on lighting condition nor information about 3D shape is required. Experimental results show the promising performance of LNSCT for face recognition on Extended Yale B and CMU-PIE databases.

MSC:

68T10 Pattern recognition, speech recognition
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] P. Phillips, P. Grother, R. Micheals, D. Blackburn, E. Tabassi, J. Bone, FRVT 2002: Evaluation report, March 2003.; P. Phillips, P. Grother, R. Micheals, D. Blackburn, E. Tabassi, J. Bone, FRVT 2002: Evaluation report, March 2003.
[2] Phillips, P.; Scruggs, W.; O’Toole, A.; Flynn, P.; Bowyer, K.; Schott, C.; Sharpe, M., FRVT 2006 and ICE 2006 Large-Scale Results (2007), National Institute of Standards and Technology, NISTIR
[3] Choi, W.; Tse, S.; Wong, K.; Lam, K., Simplified Gabor wavelets for human face recognition, Pattern Recognition, 41, 1186-1199 (2008) · Zbl 1132.68632
[4] Ahonen, T.; Hadid, A.; Pietikäinen, M., Face description with local binary patterns: application to face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 2037-2041 (2006)
[5] W. Zhang, S. Shan, W. Gao, X. Chen, H. Zhang, Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2005.; W. Zhang, S. Shan, W. Gao, X. Chen, H. Zhang, Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2005.
[6] Horn, B. K.P., Robot Vision (1990), Academic: Academic MA
[7] Y. Weiss, Deriving intrinsic images from image sequences, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2001.; Y. Weiss, Deriving intrinsic images from image sequences, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2001.
[8] R. Rammamorthi, P. Hanrahan, A signal-processing framework for inverse rendering, in: Proceedings of ACM SIGGRAPH, 2001.; R. Rammamorthi, P. Hanrahan, A signal-processing framework for inverse rendering, in: Proceedings of ACM SIGGRAPH, 2001.
[9] Stockham, T. G., Image processing in the context of a visual model, Proceedings of IEEE, 60, 828-842 (1972)
[10] Horn, B. K.P., Determining lightness from an image, Computer Graphics and Image Processing, 3, 277-299 (1974)
[11] Land, E. H.; McCann, J. J., Lightness and Retinex theory, Optical Society of America, 61, 1-11 (1997)
[12] Jobson, D. J.; Rahman, Z.; Woodell, G. A., A multi-scale Retinex for bridging the gap between color images and the human observation of scenes, IEEE Transactions on Image Processing, 6, 965-976 (1997)
[13] Perona, P.; Malik, J., Scale-space and edge detection using anisotropic diffusion, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 629-639 (1990)
[14] J. Tumblin, G. Turk, LCIS: a boundary hierarchy for detail-preserving contrast reduction, in: Proceedings of ACM SIGGRAPH, 1999.; J. Tumblin, G. Turk, LCIS: a boundary hierarchy for detail-preserving contrast reduction, in: Proceedings of ACM SIGGRAPH, 1999.
[15] R. Gross, V. Brajovie, An image preprocessing algorithm for illumination invariant face recognition, in: Proceeding of Fourth International Conference on Audio and Video Based Biometric Person Authentication, 2003.; R. Gross, V. Brajovie, An image preprocessing algorithm for illumination invariant face recognition, in: Proceeding of Fourth International Conference on Audio and Video Based Biometric Person Authentication, 2003. · Zbl 1050.68739
[16] C. Tomasi, R. Manduchi, Bilateral filtering for gray and color images, in: Proceedings of IEEE International Conference on Computer Vision, 1998.; C. Tomasi, R. Manduchi, Bilateral filtering for gray and color images, in: Proceedings of IEEE International Conference on Computer Vision, 1998.
[17] Durand, F.; Dorsey, J., Fast bilateral filtering for the display of high-dynamic-range images, ACM Transactions on Graphics, 21, 257-266 (2002)
[18] Comaniciu, D.; Meer, P., Mean shift: a robust approach toward feature space analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 603-619 (2002)
[19] C. Chen, C. Chen, Lighting normalization with generic intrinsic illumination subspace for face recognition, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2005.; C. Chen, C. Chen, Lighting normalization with generic intrinsic illumination subspace for face recognition, in: Proceeding of IEEE International Conference on Computer Vision (ICCV), 2005.
[20] Chen, T.; Yin, W.; Zhou, X.; Comaniciu, D.; Huang, T. S., Total variation models for variable lighting face recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 1519-1524 (2006)
[21] Zhang, T.; Fang, B.; Yuan, Y.; Tang, Y.; Shang, Z.; Li, D.; Lang, F., Multiscale facial structure representation for face recognition under varying illumination, Pattern Recognition, 42, 251-258 (2009) · Zbl 1162.68644
[22] Kingsbury, N. G., Complex wavelets for shift invariant analysis and filtering of signals, Journal of Applied and Computational Harmonic Analysis, 10, 234-253 (2001) · Zbl 0990.94005
[23] Kovesi, P. D., Image features from phase congruency, Videre: Journal of Computer Vision Research, 1, 1-26 (1999)
[24] Do, M. N.; Vetterli, M., The contourlet transform: an efficient directional multiresolution image representation, IEEE Transactions on Image Processing, 14, 2091-2106 (2005)
[25] Coifman, R. R.; Donoho, D. L., Translation invariant de-noising, (Antoniadis, A.; Oppenheim, G., Wavelets and Statistics (1995), Springer-Verlag: Springer-Verlag New York), 125-150 · Zbl 0866.94008
[26] Do, M. N.; Vetterli, M., (Stoeckler, J.; Welland, G. V., Contourlets, BeyondWavelets (2002), Academic Press: Academic Press New York) · Zbl 1086.65125
[27] Cunha, L.; Zhou, J.; Do, M. N., The nonsubsampled contourlet transform: theory, design, and applications, IEEE Transactions on Image Processing, 15, 3089-3101 (2006)
[28] W.R. Boukabou, A. Bouridane, Contourlet-based feature extraction with PCA for face recognition, in: Proceedings of the 2008 NASA/ESA Conference on Adaptive Hardware and Systems Table of Contents, Washington, DC, USA, 2008, 482-486.; W.R. Boukabou, A. Bouridane, Contourlet-based feature extraction with PCA for face recognition, in: Proceedings of the 2008 NASA/ESA Conference on Adaptive Hardware and Systems Table of Contents, Washington, DC, USA, 2008, 482-486.
[29] Mandal, T.; Majumdar, A.; Wu, Q. M.J., Face recognition by Curvelet based feature extraction, Lecture Notes in Computer Science, 4633, 806-817 (2007)
[30] K. Delac, M. Grgic, M.S. Bartlett, Recent advances in face recognition, 978-953-7619-34-3, I-Tech, Vienna, Austria, 2008, 236.; K. Delac, M. Grgic, M.S. Bartlett, Recent advances in face recognition, 978-953-7619-34-3, I-Tech, Vienna, Austria, 2008, 236.
[31] Chang, S. G.; Yu, B.; Vetterli, M., Adaptive wavelet thresholding for image denoising and compression, IEEE Transactions on Image Process, 9, 1532-1546 (2000) · Zbl 0962.94028
[32] Chen, W.; Er, M. J.; Wu, S., Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain, IEEE Transactions on Systems, Man and Cybernetics, Part B, 36, 458-466 (2006)
[33] Georghiades, A.; Belhumeur, P.; Kriegman, D., From few to many: illumination cone models for face recognition under variable lighting and pose, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 643-660 (2001)
[34] T. Sim, S. Baker, M. Bsat, The CMU pose, illumination, and expression (PIE) database, in: Proceedings of IEEE Conference on Face and Gestures (FGR), May, 2002.; T. Sim, S. Baker, M. Bsat, The CMU pose, illumination, and expression (PIE) database, in: Proceedings of IEEE Conference on Face and Gestures (FGR), May, 2002.
[35] S. Shan, W. Gao, B. Cao, D. Zhao, Illumination normalization for robust face recognition against varying lighting conditions, in: Proceedings of International Workshop Analysis and Modeling of Faces and Gestures, 2003.; S. Shan, W. Gao, B. Cao, D. Zhao, Illumination normalization for robust face recognition against varying lighting conditions, in: Proceedings of International Workshop Analysis and Modeling of Faces and Gestures, 2003.
[36] Xie, X.; Lam, K., Face recognition under varying illumination based on a 2D face shape model, Pattern Recognition, 38, 221-230 (2005)
[37] Choi, S.; Kim, C.; Choi, C., Shadow compensation in 2D images for face recognition, Pattern Recognition, 40, 2118-2125 (2007) · Zbl 1111.68635
[38] Blanz, V.; Vetter, T., Face recognition based on fitting a 3D morphable model, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 063-1074 (2003)
[39] Shim, H.; Luo, J.; Chen, T., A subspace model-based approach to face relighting under unknown lighting and poses, IEEE Transactions on Image Processing, 17, 1331-1341 (2008)
[40] Shashua, A.; Riklin-Raviv, T., The quotient image: class-based re-rendering and recognition with varying illuminations, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 129-139 (2001)
[41] H. Wang, S.Z. Li, Y. Wang, Generalized quotient image, in: Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2004.; H. Wang, S.Z. Li, Y. Wang, Generalized quotient image, in: Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2004.
[42] Phillips, P.; Moon, H.; Rizvi, S.; Rauss, P., The FERET evaluation methodology for face-recognition algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 1090-1104 (2000)
[43] A. Eleyan, H. Ozkaramanli, H. Demirel, Complex wavelet transform-based face recognition, EURASIP Journal on Advances in Signal Processing, 2008, Article ID 185281.; A. Eleyan, H. Ozkaramanli, H. Demirel, Complex wavelet transform-based face recognition, EURASIP Journal on Advances in Signal Processing, 2008, Article ID 185281. · Zbl 1159.94306
[44] Candes, E.; Demanet, L.; Donoho, D., Fast discrete curvelet transforms, Multiscale modeling and simulation, 5, 861-899 (2007) · Zbl 1122.65134
[45] E. Bezalel, U. Efron, Efficient face recognition method using a combined phase congruency/Gabor wavelet technique, in: Proceedings of SPIE, Optical Information Systems III, August, 2005; E. Bezalel, U. Efron, Efficient face recognition method using a combined phase congruency/Gabor wavelet technique, in: Proceedings of SPIE, Optical Information Systems III, August, 2005
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.