Disjoint factor analysis with cross-loadings. (English) Zbl 1414.62222

Summary: Disjoint factor analysis (DFA) is a new latent factor model that we propose here to identify factors that relate to disjoint subsets of variables, thus simplifying the loading matrix structure. Similarly to exploratory factor analysis (EFA), the DFA does not hypothesize prior information on the number of factors and on the relevant relations between variables and factors. In DFA the population variance-covariance structure is hypothesized block diagonal after the proper permutation of variables and estimated by Maximum Likelihood, using an Coordinate Descent type algorithm. Inference on parameters on the number of factors and to confirm the hypothesized simple structure are provided. Properties such as scale equivariance, uniqueness, optimal simplification of loadings are satisfied by DFA. Relevant cross-loadings are also estimated in case they are detected from the best DFA solution. DFA has also the option to constrain a variable to load on a pre-specified factor so that the researcher can assume, a priori, some relations between variables and loadings. A simulation study shows performances of DFA and an application to optimally identify the dimensions of well-being is used to illustrate characteristics of the new methodology. A final discussion concludes the paper.


62H25 Factor analysis and principal components; correspondence analysis


Full Text: DOI


[1] Abdi H (2003) Factor Rotations in Factor Analyses. In: Lewis-Beck M, Bryman A, Futing T (eds) Encyclopedia of Social Sciences Research Methods, pp 792-795. Sage, Thousand Oaks (CA)
[2] Amstrong, JS; Soelberg, P., On the interpretation of factor analysis, Psychol Bull, 70, 361-364, (1968)
[3] Akaike H (1973) Information theory and an extension of the maximum likelihood principle. In: Petrov BN, Csáki F (eds) 2nd International Symposium on Information Theory, Tsahkadsor, Armenia, USSR. Akadémiai Kiadó, Budapest, pp 267-281 · Zbl 0283.62006
[4] Anderson TW, Rubin H (1956) Statistical inferences in factor analysis. In: Proceedings of the Third Symposium on Mathematical Statistics and Probability, vol V, pp 111-150
[5] Aoyagi, H.; Ogunseitan, OA, Toxic releases and risk disparity: a spatiotemporal model of industrial ecology and social empowerment, Int J Environ Res Public Health, 12, 6300-6318, (2015)
[6] Bartlett, MS, The statistical conception of mental factors, Br J Psychol, 28, 97-104, (1937)
[7] Bartlett, MS, A note on the multiplying factors for various \(χ \)2 approximations, J R Stat Soc Ser B (Methodol), 16, 296-298, (1954) · Zbl 0057.35404
[8] Boer, D.; Abubakar, A., Music listening in families and peer groups: benefits for young people’s social cohesion and emotional well-being across four cultures, Frontiers Psychol, 5, 1-15, (2014)
[9] Costello AB, Osborne JW (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. http://pareonline.net/getvn.asp?v=10&n=7
[10] d’Aspremont, A.; Ghaoui, L.; Jordan, MI; Lanckriet, GRG, A direct formulation for sparse PCA using semidefinite programming, SIAM Rev, 49, 434-448, (2007) · Zbl 1128.90050
[11] Elliot, AJ; McGregor, HA, A 2 \(× \) 2 achievement goal Framework, J Pers Soc Psychol, 80, 501-519, (2001)
[12] Grbovic M, Dance CR, Vucetic S (2012) Sparse principal component analysis with constraints. In: Proceedings of the twenty-sixth AAAI conference on artificial intelligence. https://www.aaai.org/ocs/index.php/AAAI/AAAI12/paper/viewFile/5109/5503
[13] Horst P (1965) Factor analysis of data matrices. Holt, Rinehart and Winston, New York · Zbl 0136.39204
[14] Hubert, L.; Arabie, P., Comparing partitions, J Classif, 2, 193-218, (1985) · Zbl 0587.62128
[15] Joereskog, KG, A general approach to confirmatory maximum-likelihood factor analysis, Psychometrika, 34, 183-202, (1969)
[16] Joereskog, KG, Structural analysis of covariance and correlation matrices, Psychometrika, 43, 443-477, (1978) · Zbl 0392.62043
[17] Joereskog KG (1979) A general approach to confirmatory maximum likelihood factor analysis, with addendum. In: Joereskog KG, Sorbom D, Magidson J (eds) Advances in factor analysis and structural equation models, pp 40-43
[18] Joereskog KG, Sorbom D (1979) Advances in factor analysis and equation models. Abt Books, Cambridge
[19] Joereskog KG, Sorbom D (1981) LISREL V: Analysis of linear structural relationships by the method of maximum likelihood [Computer program]. Scientific Software, Mooresville
[20] Jolliffe, IT; Trendafilov, NT; Uddin, M., A modified principal component technique based on the LASSO, J Comput Graph Stat, 12, 531-547, (2003)
[21] Kaiser, HF, The varimax criterion for analytic rotation in factor analysis, Psychometrika, 23, 187-200, (1958) · Zbl 0095.33603
[22] Kim EJ (2013) Accessing factor structure and construct validity of the successful aging inventory. J Korean Acad Nurs 43(4):568-578
[23] Kline P (2000) The handbook of psychological testing (2nd edn.). Routledge, London, p 13
[24] Leiva-Bianchi, MC; Araneda, AC, Validation of the Davidson Trauma Scale in its original and a new shorter version in people exposed to the F-27 earthquake in Chile, Eur J Psychotraumatology, 4, 21239, (2013)
[25] Masaya, I.; Satomi, N.; Daisuke, F.; Mitsunori, M.; Kim, Y.; Shear, MK; Angela, G.; Wall, MM, Brief measure for screening complicated grief: reliability and discriminant validity, PLoS One, 7, e31209, (2012)
[26] Morikawa M, Okada T, Ando M, Aleksic B, Kunimoto S, Nakamura Y, Kubota C,, Uno Y, Tamaji A, Hayakawa N, Furumura K, Shiino T, Morita T, Ishikawa N, Ohoka H, Usui H, Banno N, Murase S, Goto S, Kanai A, Masuda T, Ozaki1 N (2015) Relationship between social support during pregnancy and postpartum depressive state: a prospective cohort study. Nature 5:10520
[27] Mulaik SA (1972) The foundations of factor analysis. McGraw Hill, New York · Zbl 1182.62133
[28] Park Y-M, Kwon HS, Lim SY, Lee JH, Kim SR, Yoon KH, Cha BY, Son HY, Park YG, Kim DS, Meng K, Le WC (2006) Clustering characteristics of risk variables of metabolic syndrome in Korean rural populations. J Korean Diabetes Assoc 30:177-189
[29] Raftery, AE; Bollen, KA (ed.); Long, JS (ed.), Bayesian model selection in structural equation models, 163-180, (1993), Newbury Park
[30] Rosman, A.; Maggie, G.; Lee, S.; Butler, S.; Schwartzy, A., DOSPERT\(+\)M: A survey of medical risk attitudes in the United States, Judgm Decis Mak, 8, 470-481, (2013)
[31] Sherin, RJ, A matrix formulation of Kaiser’s varimax criterion, Psychometrika, 31, 535-538, (1966) · Zbl 0152.18705
[32] Shen, H.; Huang, JZ, Sparse principal component analysis via regularized low rank matrix approximation, J Multivar Anal, 99, 1015-1034, (2008) · Zbl 1141.62049
[33] Spearman C (1904) General intelligence, objectively determined and measured. Am J Psychol 15:201-293
[34] Steiger JH, Lind J (1980) Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City
[35] Steiger JH (1989) EzPATH: A supplementary module for SYSTAT and SYSGRAPH [Computer program]. SYSTAT Inc, Evanston
[36] Stiglitz JE, Sen A, Fitoussi JP (2009) Report by the Commission on the Measurement of Economic Performance and Social Progress. Insee. http://www.insee.fr/fr/publications-et-services/dossiers_web/stiglitz/doc-commission/RAPPORT_anglais.pdf
[37] Schwarz, G., Estimating the dimension of a model, Ann Stat, 6, 461-464, (1978) · Zbl 0379.62005
[38] Berge, JMF, A joint treatment of varimax rotation and the problem of diagonalizing symmetric matrices simultaneously in the least-squares sense, Psychometrika, 49, 347-358, (1984) · Zbl 0564.62048
[39] Berge, JMF; Knol, DL; Kiers, HAL, A treatment of the orthomax rotation family in terms of diagonalization, and a re-examination of a singular value approach to varimax rotation, Comput Stat Q, 3, 207-217, (1988) · Zbl 0726.62090
[40] Thomson, GH, The definition and measurement of g (general intelligence), J Educ Psychol, 26, 241-262, (1935)
[41] Ullman JB (2006) Structural equation modeling: reviewing the basics and moving forward. J Personal Assess 87(1):35-50
[42] Vichi M, Saporta G (2009) Clustering and disjoint principal component analysis. Comput Stat Data Anal 53(8):3194-3208 · Zbl 1453.62230
[43] Yang B, Fu X, Sidiropoulos ND (2015) Joint factor analysis and latent clustering. In: Proceedings of IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP2015), pp 173-176
[44] Zangwill WI (1969) Nonlinear programming: a unified approach. Prentice-Hall, Englewood Cliffs · Zbl 0195.20804
[45] Zou, H.; Hastie, T.; Tibshirani, R., Sparse principal component analysis, J Comput Graph Stat, 15, 262-286, (2006)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.