×

Card sorting data collection methodology: how many participants is most efficient? (English) Zbl 1436.62270

Summary: Pairwise similarity judgments and card sorting methodologies are different ways of generating data for similarity matrices used in various analyses such as multidimensional scaling and cluster analysis. Pairwise similarity judgments are considered the gold standard methodology, but can be cumbersome for large numbers of stimuli given the geometric increase in number of judgments necessary to fill the matrix. Card sorting methods provide a more expedient means of gathering this information, although they typically generate only binary data. Nonetheless, aggregated matrices generated from card sorts approximate pairwise similarity matrices. The current study used pairwise similarity and card sorting results from two existing studies that used the same stimuli to determine the optimal number of participants needed in a card sorting task to approximate the similarity matrix of pairwise data collection. In these studies, approximately 10–15 participants provided optimal estimation of the similarity matrix, with minimal increases for higher numbers of participants.

MSC:

62H30 Classification and discrimination; cluster analysis (statistical aspects)
62H12 Estimation in multivariate analysis
62R01 Algebraic statistics
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Clatworthy, J.; Buick, D.; Hankins, M.; Weinman, J.; Horne, R., The use of reporting and cluster analysis in health psychology: a review, British Journal of Health Psychology, 10, 3, 329-358 (2005) · doi:10.1348/135910705X25697
[2] Danilova, D.; Diekhoff, Gm; Vandehey, Ma, A multidimensional scaling analysis of male body perception in men with muscle dysmorphia: “The Adonis Complex”, International Journal of Men’s Health, 12, 2, 83-105 (2013) · doi:10.3149/jmh.1202.83
[3] Hout, Mc; Papesh, Mh; Goldinger, Sd, Multidimensional scaling, Wiley Interdisciplinary Reviews (WIREs): Cognitive Science, 4, 93-103 (2012)
[4] Lantz, E.; Diekhoff, G.; Carlston, D., How many participants are needed for card sort data collection? Poster presented at the southwestern psychological association (2014), TX: San Antonio, TX
[5] Reed, G.; Roberts, M.; Keeley, J.; Hooppell, C.; Matsumoto, C.; Sharan, P.; Robles, R.; Carvalho, H.; Wu, C.; Leal-Leturia, I.; Flanagan, E.; Correia, J.; Ayuso-Mateos, J.; Mari, J.; Xiao, Z.; Evans, S.; Saxena, S.; Medina-Mora, M., Mental health professionals’ natural taxonomies of mental disorders: implications for clinical utility of ICD-11 and DSM-5, Journal of Clinical Psychology, 69, 1191-1212 (2013) · doi:10.1002/jclp.22031
[6] Roberts, M.; Reed, G.; Medina-Mora, M.; Keeley, J.; Sharan, P.; Johnson, D.; Mari, J.; Ayuso-Mateos, J.; Gureje, O.; Xiao, Z.; Maruta, T.; Khoury, B.; Robles, R.; Saxena, S., A global clinicians’ map of mental disorders to improve ICD-11: analysing meta-structure to enhance clinical utility, International Review of Psychiatry, 24, 6, 578-590 (2012) · doi:10.3109/09540261.2012.736368
[7] Tullis, T.; Wood, L., How many users are enough for a card-sorting study? Paper presented at the usability professional association (2004), MN: Minneapolis, MN
[8] Tullis, T.; Wood, L., How can you do a card-sorting study with LOTS of cards? Paper presented at the usability professional association (2005), MN: Minneapolis, MN
[9] Whaley, A.; Longoria, R., Preparing card Sort data for multidimensional scaling analysis in social psychological research: a methodological approach, The Journal of Social Psychology, 149, 1, 105-115 (2009) · doi:10.3200/SOCP.149.1.105-115
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.