×

Learned local Gabor patterns for face representation and recognition. (English) Zbl 1197.94148

Summary: We propose Learned Local Gabor Patterns (LLGP) for face representation and recognition. The proposed method is based on Gabor feature and the concept of texton, and defines the feature cliques which appear frequently in Gabor features as the basic patterns. Different from Local Binary Patterns (LBP) whose patterns are predefined, the local patterns in our approach are learned from the patch set, which is constructed by sampling patches from Gabor filtered face images. Thus, the patterns in our approach are face-specific and desirable for face perception tasks. Based on these learned patterns, each facial image is converted into multiple pattern maps and the block-based histograms of these patterns are concatenated together to form the representation of the face image. In addition, we propose an effective weighting strategy to enhance the performances, which makes use of the discriminative powers of different facial parts as well as different patterns. The proposed approach is evaluated on two face databases: FERET and CAS-PEAL-R1. Extensive experimental results and comparisons with existing methods show the effectiveness of the LLGP representation method and the weighting strategy. Especially, heterogeneous testing results show that the LLGP codebook has very impressive generalizability for unseen data.

MSC:

94A12 Signal theory (characterization, reconstruction, filtering, etc.)

Software:

FERET; CAS-PEAL
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Ahonen, T.; Hadid, A.; Pietikäinen, M.: Face description with local binary patterns: application to face recognition, IEEE transactions on pattern analysis and machine intelligence 28, No. 12, 2037-2041 (2006) · Zbl 1098.68717
[2] Belhumeur, P. N.; Hespanha, J. P.; Kriegman, D. J.: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection, IEEE transactions on pattern analysis and machine intelligence 19, No. 7, 711-720 (1997)
[3] Gao, W.; Cao, B.; Shan, S.; Chen, X.; Zhou, D.; Zhang, X.; Zhao, D.: The CAS-PEAL large-scale chinese face database and baseline evaluations, IEEE transactions on system, machine and cybernetics part A 38, No. 1, 149-161 (2008)
[4] Hafed, Z.; Levine, M.: Face recognition using the discrete cosine transform, International journal of computer vision 43, No. 3, 167-188 (2001) · Zbl 1002.68572 · doi:10.1023/A:1011183429707
[5] Jones, J.; Palmer, L.: An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex, Journal of neurophysiology 58, No. 6, 1233-1258 (1987)
[6] Lades, M.; Vorbrüggen, J. C.; Buhmann, J.; Lange, J.; Malsburg, C. V. D.; Würtz, R. P.; Konen, W.: Distortion invariant object recognition in the dynamic link architecture, IEEE transactions on computers 42, No. 3, 300-311 (1993)
[7] Lai, J.; Yuen, P.; Feng, G.: Face recognition using holistic Fourier invariant features, Pattern recognition 34, No. 1, 95-109 (2001) · Zbl 0970.68749 · doi:10.1016/S0031-3203(99)00200-9
[8] Lei, Z.; Li, S.; Chu, R.; Zhu, X.: Face recognition with local Gabor textons, International conference on biometrics, 49-57 (2007)
[9] Leung, T.; Malik, J.: Representing and recognizing the visual appearance of materials using three-dimensional textons, International journal of computer vision 43, No. 1, 29-44 (2001) · Zbl 0972.68606 · doi:10.1023/A:1011126920638
[10] Li, M.; Yuan, B. Z.: 2D-LDA: a statistical linear discriminant analysis for image matrix, Pattern recognition letter 1, 527-532 (2004)
[11] Li, X.; Lin, S.; Yan, S.; Xu, D.: Discriminant locally linear embedding with high-order tensor data, IEEE transactions on systems, man, and cybernetics, part B: cybernetics 38, No. 2, 342-352 (2008)
[12] Liu, C.; Wechsler, H.: Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition, IEEE transactions on image processing 11, No. 4, 467-476 (2002)
[13] J. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1967, pp. 281 – 297. · Zbl 0214.46201
[14] Meyers, E.; Wolf, L.: Using biologically inspired features for face processing, International journal of computer vision, 93-104 (2008)
[15] Meng, X.; Shan, S.; Chen, X.; Gao, W.: Local visual primitives (LVP) for face modeling and recognition, International conference on pattern recognition, 536-539 (2006)
[16] Ojala, T.; Pietikäinen, M.; Gray-Scale, T. Mäenpää. Multiresolution: Rotation invariant texture classification with local binary patterns, IEEE transactions on pattern analysis and machine intelligence 24, No. 7, 971-987 (2002)
[17] Pang, Y.; Yuan, Y.; Li, X.: Gabor-based region covariance matrices for face recognition, IEEE transactions on circuits and systems for video technology 18, No. 7, 989-993 (2008)
[18] Pang, Y.; Tao, D.; Yuan, Y.; Li, X.: Binary two-dimensional PCA, IEEE transactions on system, man, and cybernetics, part B: cybernetics 38, No. 4, 1176-1180 (2008)
[19] Penev, P.; Atick, J.: Local feature analysis: a general statistical theory for object representation, Network: computation in neural systems 7, No. 3, 477-500 (1996) · Zbl 0898.92039 · doi:10.1088/0954-898X/7/3/002
[20] Phillips, P.; Moon, H.; Rizvi, S.; Rauss, P.: The FERET evaluation methodology for face-recognition algorithms, IEEE transactions on pattern analysis and machine intelligence 22, No. 10, 1090-1104 (2000)
[21] J. Pierrard, T. Vetter, Skin detail analysis for face recognition, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2007.
[22] Quelhas, P.; Monay, F.; Odobez, J. M.; Gatica-Perez, D.; Tuytelaars, T.: A thousand words in a scene, IEEE transactions on pattern analysis and machine intelligence 29, No. 9, 1575-1589 (2007)
[23] Riesenhuber, M.; Poggio, T.: Hierarchical models of object recognition in cortex, Nature neuroscience 2, No. 11, 1019-1025 (1999)
[24] Tao, D.; Li, X.; Wu, X.; Maybank, S. J.: Geometric mean for subspace selection, IEEE transactions on pattern analysis and machine intelligence 31, No. 2, 260-274 (2009)
[25] Turk, M.; Pentland, A.: Eigenfaces for recognition, Journal of cognitive neuroscience 3, No. 1, 71-86 (1991)
[26] O. Tuzel, F. Porikli, P. Meer, Region covariance: a fast descriptor for detection and classification, in: Lecture Notes in Computer Science, vol. 3952, ECCV 2006, Part II, pp. 589 – 600.
[27] Wiskott, L.; Fellous, J.; Krüger, N.; Vonder, C.: Face recognition by elastic bunch graph matching, IEEE transactions on pattern analysis and machine intelligence 19, No. 7, 775-779 (1997)
[28] Varma, M.; Zisserman, A.: A statistical approach to texture classification from single images, International journal of computer vision 62, No. 1 – 2, 61-81 (2005)
[29] Yang, J.; Zhang, D.; Frangi, A.; Yang, J.: Two-dimensional PCA: a new approach to appearance-based face representation and recognition, IEEE transactions on pattern analysis and machine intelligence 26, No. 1, 131-137 (2004)
[30] P. Yang, S. Shan, W. Gao, S. Li, D. Zhang, Face recognition using Ada-boosted Gabor features, in: Proceeding of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004, Korea, May, pp. 356 – 361.
[31] J. Ye, J. Ravi, Q. Li, Two-dimensional linear discriminant analysis, Advances in Neural Information Processing System 2004.
[32] Zhang, B.; Shan, S.; Chen, X.; Gao, W.: Histogram of Gabor phase patterns (HGPP): a novel object representation approach for face recognition, IEEE transactions on image processing 16, No. 1, 57-68 (2007)
[33] Zhang, W.; Shan, S.; Gao, W.; Chen, X.; Zhang, H.: Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition, International conference on computer vision, 786-791 (2005)
[34] Zhao, W.; Chellappa, R.; Phillips, P.; Rosenfeld, A.: Face recognition: a literature survey, ACM computing surveys 35, 399-458 (2003)
[35] C. Zhong, Z. Sun, T. Tan, Robust 3D face recognition using learned visual codebook, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2007.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.