Abstract
Factor analysis is widely used to evaluate whether questionnaire items can be grouped into clusters representing different dimensions of the construct under study. This review focuses on the appropriate use of factor analysis. The Medical Outcomes Study Short Form-36 (SF-36) is used as an example. Articles were systematically searched and assessed according to a number of criteria for appropriate use and reporting. Twenty-eight studies were identified: exploratory factor analysis was performed in 22 studies, confirmatory factor analysis was performed in five studies and in one study both were performed. Substantial shortcomings were found in the reporting and justification of the methods applied. In 15 of the 23 studies in which exploratory factor analysis was performed, confirmatory factor analysis would have been more appropriate. Cross-validation was rarely performed. Presentation of the results and conclusions was often incomplete. Some of our results are specific for the SF-36, but the finding that both the application and the reporting of factor analysis leaves much room for improvement probably applies to other health status questionnaires as well. Optimal reporting and justification of methods is crucial for correct interpretation of the results and verification of the conclusions. Our list of criteria may be useful for journal editors, reviewers and researchers who have to assess publications in which factor analysis is applied.
Similar content being viewed by others
References
FJ Floyd KF Widaman (1995) ArticleTitleFactor analysis in the development and refinement of clinical assessment instruments Psychol Assess 7 286–299 Occurrence Handle10.1037/1040-3590.7.3.286
Johnson DE. Applied Multivariate Methods for Data Analysts. 1998.
DL Streiner (1994) ArticleTitleFiguring out factors: The use and misuse of factor analysis Can J Psychiatry 39 135–140 Occurrence Handle1:STN:280:DyaK2czgs1aqtg%3D%3D Occurrence Handle8033017
RL Gorsuch (1983) Factor Analysis Lawrence Erlbaum Associates, Inc, Hillsdale NJ
JE Ware SuffixJr CD Sherbourne (1992) ArticleTitleThe MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection Med Care 30 473–483 Occurrence Handle10.1097/00005650-199206000-00002 Occurrence Handle1593914
JE Ware SuffixJr (2000) ArticleTitleSF-36 health survey update Spine 25 3130–3139 Occurrence Handle10.1097/00007632-200012150-00008 Occurrence Handle11124729
CA McHorney JE Ware SuffixJr AE Raczek (1993) ArticleTitleThe MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs Med Care 31 247–263 Occurrence Handle1:STN:280:DyaK3s7ps1antA%3D%3D Occurrence Handle10.1097/00005650-199303000-00006 Occurrence Handle8450681
Ware JE, Kosinski M, Keller SK, Psychological and mental health summary scales: A user’s manual. 1994. Boston MA, The Health Institute (report).
JE Ware SuffixJr M Kosinski B Gandek et al. (1998) ArticleTitleThe factor structure of the SF-36 Health Survey in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1159–1165 Occurrence Handle10.1016/S0895-4356(98)00107-3 Occurrence Handle9817133
JE Ware SuffixJr B Gandek (1998) ArticleTitleOverview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project J Clin Epidemiol 51 903–912 Occurrence Handle10.1016/S0895-4356(98)00081-X Occurrence Handle9817107
J Ware SuffixJr M Kosinski SD Keller (1996) ArticleTitleA 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity Med Care 34 220–233 Occurrence Handle10.1097/00005650-199603000-00003 Occurrence Handle8628042
WR Zwick WF Velicer (1986) ArticleTitleA comparison of five rules for determining the number of components to retain Psychol Bull 99 432–442 Occurrence Handle10.1037/0033-2909.99.3.432
DB Allison BS Gorman LH Primavera (1993) ArticleTitleSome of the most common questions asked of statistical consultants: Our favorite responses and recommended readings Gene Soc Gen Psychol Monogr 119 153–185
KA Bollen (1989) Structural Equations with Latent Variables Wiley New York Occurrence Handle10.1002/9781118619179
F Pouwer FJ Snoek HM Vander Ploeg HJ Ader RJ Heine (2000) ArticleTitleThe well-being questionnaire: Evidence for a three-factor structure with 12 items (W-BQ12) Psychol Med 30 455–462 Occurrence Handle1:STN:280:DC%2BD3cvhsFeruw%3D%3D Occurrence Handle10.1017/S0033291700001719 Occurrence Handle10824665
P Kline (1993) The Handbook of Psychological Testing Routledge London
E Guadagnoli WF Velicer (1988) ArticleTitleRelation of sample size to the stability of component patterns Psychol Bull 103 265–275 Occurrence Handle1:STN:280:DyaL1c3gsVSgsQ%3D%3D Occurrence Handle10.1037/0033-2909.103.2.265 Occurrence Handle3363047
B Gandek JE Ware SuffixJr (1998) ArticleTitleMethods for validating and norming translations of health status questionnaires: The IQOLA Project approach.International Quality of Life Assessment J Clin Epidemiol 51 953–959 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SjsA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00086-9 Occurrence Handle9817112
RD Hays CD Sherbourne RM Mazel (1993) ArticleTitleThe RAND 36-Item Health Survey 1.0 Health Econ 2 217–227 Occurrence Handle1:STN:280:DyaK2c7gtFSltQ%3D%3D Occurrence Handle10.1002/hec.4730020305 Occurrence Handle8275167
M Kosinski SD Keller HT Hatoum SX Kong JE Ware SuffixJr (1999) ArticleTitleThe SF-36 Health Survey as a generic outcome measure in clinical trials of patients with osteoarthritis and rheumatoid arthritis: Tests of data quality, scaling assumptions and score reliability Med Care 37 MS10–MS22 Occurrence Handle1:STN:280:DyaK1M3ms1Oksw%3D%3D Occurrence Handle10335740
PJ Reed (1998) ArticleTitleMethods of evaluation in outcomes research Am J Manag Care 4 1616–1625 Occurrence Handle1:STN:280:DyaK1M7hvVGqsw%3D%3D Occurrence Handle10338907
JE Ware M Kosinski (2001) ArticleTitleInterpreting SF-36 summary health measures: A response Qual Life Res 10 405–413 Occurrence Handle1:STN:280:DC%2BD38%2FjsVelsA%3D%3D Occurrence Handle10.1023/A:1012588218728 Occurrence Handle11763203
LE Pfennings HM Vander Ploeg L Cohen et al. (1999) ArticleTitleA health-related quality of life questionnaire for multiple sclerosis patients Acta Neurol Scand 100 148–155 Occurrence Handle1:STN:280:DyaK1MvgsFKrsA%3D%3D Occurrence Handle10.1111/j.1600-0404.1999.tb00730.x Occurrence Handle10478577
J Thumboo PH Feng CH Soh ML Boey S Thio KY Fong (2000) ArticleTitleValidation of a Chinese version of the Medical Outcomes Study Family and Marital Functioning Measures in patients with SLE Lupus 9 702–707 Occurrence Handle1:STN:280:DC%2BD3M7kslemtg%3D%3D Occurrence Handle10.1191/096120300666529212 Occurrence Handle11199926
PR Dexter TE Stump WM Tierney FD Wolinsky (1996) ArticleTitleThe psychometric properties of the SF-36 Health Survey among older adults in a clinical setting J Clin Geropsychol 2 225–237
KM Scott SJ Haslett (1999) ArticleTitleSF-36 health survey reliability, validity and norms for New Zealand Aust New Zeal J Public Health 23 401–406 Occurrence Handle1:STN:280:DyaK1Mzpt1WhsQ%3D%3D Occurrence Handle10.1111/j.1467-842X.1999.tb01282.x
I Failde I Ramos (2000) ArticleTitleValidity and reliability of the SF-36 Health Survey Questionnaire in patients with coronary artery disease J Clin Epidemiol 53 359–365 Occurrence Handle1:STN:280:DC%2BD3c3kvFajsA%3D%3D Occurrence Handle10.1016/S0895-4356(99)00175-4 Occurrence Handle10785566
SD Keller JE Ware SuffixJr PM Bentler et al. (1998) ArticleTitleUse of structural equation modeling to test the construct validity of the SF-36 Health Survey in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1179–1188 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShtA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00110-3 Occurrence Handle9817136
N Lewin-Epstein T Sagiv-Schifter EL Shabtai A Shmueli (1998) ArticleTitleValidation of the 36-item short-form Health Survey (Hebrew version) in the adult population of Israel Med Care 36 1361–1370 Occurrence Handle1:STN:280:DyaK1cvitVSrug%3D%3D Occurrence Handle10.1097/00005650-199809000-00008 Occurrence Handle9749659
PJ Reed (1998) ArticleTitleMedical outcomes study short form 36: Testing and cross-validating a second-order factorial structure for health system employees Health Serv Res 33 1361–1380 Occurrence Handle1:STN:280:DyaK1M%2Fot1OnsQ%3D%3D Occurrence Handle9865224 Occurrence Handle1070320
J Thumboo KY Fong D Machin et al. (2001) ArticleTitleA community-based study of scaling assumptions and construct validity of the English (UK) and Chinese (HK) SF-36 in Singapore Qual Life Res 10 175–188 Occurrence Handle1:STN:280:DC%2BD3MrmtF2luw%3D%3D Occurrence Handle10.1023/A:1016701514299 Occurrence Handle11642688
FD Wolinsky TE Stump (1996) ArticleTitleA measurement model of the Medical Outcomes Study 36-Item Short-Form Health Survey in a clinical sample of disadvantaged, older, black, and white men and women Med Care 34 537–548 Occurrence Handle1:STN:280:DyaK283lvVemtg%3D%3D Occurrence Handle10.1097/00005650-199606000-00004 Occurrence Handle8656720
D Wilson J Parsons G Tucker (2000) ArticleTitleThe SF-36 summary scales: Problems and solutions Soz Praventiv Med 45 239–246 Occurrence Handle1:STN:280:DC%2BD3M3isVektQ%3D%3D Occurrence Handle10.1007/BF01591686
J Hardt D Buchwald D Wilks M Sharpe WA Nix UT Egle (2001) ArticleTitleHealth-related quality of life in patients with chronic fatigue syndrome: An international study J Psychosom Res 51 431–434 Occurrence Handle1:STN:280:DC%2BD3Mvnt1Wqsw%3D%3D Occurrence Handle10.1016/S0022-3999(01)00220-3 Occurrence Handle11516765
G Mishra MJ Schofield (1998) ArticleTitleNorms for the physical and mental health component summary scores of the SF-36 for young, middle-aged and older Australian women Qual Life Res 7 215–220 Occurrence Handle1:STN:280:DyaK1c3ksFGgsg%3D%3D Occurrence Handle10.1023/A:1008821913429 Occurrence Handle9584551
JE Ware SuffixJr B Gandek M Kosinski et al. (1998) ArticleTitleThe equivalence of SF-36 summary health scores estimated using standard and country-specific algorithms in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1167–1170 Occurrence Handle10.1016/S0895-4356(98)00108-5 Occurrence Handle9817134
C Jenkinson R Layte (1997) ArticleTitleDevelopment and testing of the UK SF-12 (short form health survey) J Health Serv Res Policy 2 14–18 Occurrence Handle1:STN:280:DyaK1czitFCjtw%3D%3D Occurrence Handle10180648
C Jenkinson S Stewart-Brown S Petersen C Paice (1999) ArticleTitleAssessment of the SF-36 version 2 in the United Kingdom J Epidemiol Commun Health 53 46–50 Occurrence Handle1:STN:280:DyaK1M3lsl2jsQ%3D%3D Occurrence Handle10.1136/jech.53.1.46
G Apolone P Mosconi (1998) ArticleTitleThe Italian SF-36 Health Survey: Translation, validation and norming J Clin Epidemiol 51 1025–1036 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sisg%3D%3D Occurrence Handle10.1016/S0895-4356(98)00094-8 Occurrence Handle9817120
S Fukuhara JE Ware SuffixJr M Kosinski S Wada B Gandek (1998b) ArticleTitlePsychometric and clinical tests of validity of the Japanese SF-36 Health Survey J Clin Epidemiol 51 1045–1053 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SisA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00096-1
S Fukuhara S Bito J Green A Hsiao K Kurokawa (1998a) ArticleTitleTranslation, adaptation, and validation of the SF-36 Health Survey for use in Japan J Clin Epidemiol 51 1037–1044 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sisw%3D%3D Occurrence Handle10.1016/S0895-4356(98)00095-X
J Hobart J Freeman D Lamping R Fitzpatrick A Thompson (2001) ArticleTitleThe SF-36 in multiple sclerosis: Why basic assumptions must be tested J Neurol Neurosurg Psychiatry 71 363–370 Occurrence Handle1:STN:280:DC%2BD3Mvms12gsQ%3D%3D Occurrence Handle10.1136/jnnp.71.3.363 Occurrence Handle11511712 Occurrence Handle1737568
TV Perneger A Leplege JF Etter A Rougemont (1995) ArticleTitleValidation of a French-language version of the MOS 36-Item Short Form Health Survey (SF-36) in young healthy adults J Clin Epidemiol 48 1051–1060 Occurrence Handle1:STN:280:DyaK2M3psVGqug%3D%3D Occurrence Handle10.1016/0895-4356(94)00227-H Occurrence Handle7775992
RW Sanson-Fisher JJ Perkins (1998) ArticleTitleAdaptation and validation of the SF-36 Health Survey for use in Australia J Clin Epidemiol 51 961–967 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SjsQ%3D%3D Occurrence Handle10.1016/S0895-4356(98)00087-0 Occurrence Handle9817113
KM Scott D Sarfati MI Tobias SJ Haslett (2000) ArticleTitleA challenge to the cross-cultural validity of the SF-36 health survey: Factor structure in Maori, Pacific and New Zealand European ethnic groups Soc Sci Med 51 1655–1664 Occurrence Handle1:STN:280:DC%2BD3crhtl2gsQ%3D%3D Occurrence Handle10.1016/S0277-9536(00)00083-6 Occurrence Handle11072885
K Stadnyk J Calder K Rockwood (1998) ArticleTitleTesting the measurement properties of the Short Form-36 Health Survey in a frail elderly population J Clin Epidemiol 51 827–835 Occurrence Handle1:STN:280:DyaK1cvjtlyguw%3D%3D Occurrence Handle10.1016/S0895-4356(98)00061-4 Occurrence Handle9762875
ML Essink-Bot PF Krabbe GJ Bonsel NK Aaronson (1997) ArticleTitleAn empirical comparison of four generic health status measures. The Nottingham Health Profile, the Medical Outcomes Study 36-item Short-Form Health Survey, the COOP/WONCA charts, and the EuroQol instrument Med Care 35 522–537 Occurrence Handle1:STN:280:DyaK2s3osFSltA%3D%3D Occurrence Handle10.1097/00005650-199705000-00008 Occurrence Handle9140339
L Gold beck TG Sch mitz (2001) ArticleTitleCom par i son of three generic ques tion naires mea sur ing qual ity of life in ado les cents and adults with cys tic fibro sis: The 36-item short form health sur vey, the qual ity of life pro file for chronic dis eases, and the ques tions on life sat is fac tion Qual Life Res 10 23–36 Occurrence Handle1:STN:280:DC%2BD3MvmtlOhug%3D%3D Occurrence Handle10.1023/A:1016711704283
JY Chern TT Wan M Pyles (2000) ArticleTitleThe stability of health status measurement (SF-36) in a working population J Outcome Meas 4 461–481 Occurrence Handle1:STN:280:DC%2BD3M7nt1ersw%3D%3D Occurrence Handle11272596
J Thumboo KY Fong SP Chan et al. (2002) ArticleTitleThe equivalence of English and Chinese SF-36 versions in bilingual Singapore Chinese Qual Life Res 11 495–503 Occurrence Handle10.1023/A:1015680029998 Occurrence Handle12113396
RL Gorsuch (1995) ArticleTitleExploratory factor analysis: Its role in item analysis J Pers Assess 68 532–560 Occurrence Handle10.1207/s15327752jpa6803_5
NK Aaronson M Muller PD Cohen et al. (1998) ArticleTitleTranslation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations J Clin Epidemiol 51 1202 Occurrence Handle10.1016/S0895-4356(98)00097-3
JB Bjorner MT Damsgaard T Watt M Groenvold (1998) ArticleTitleTests of data quality, scaling assumptions, and reliability of the Danish SF-36 J Clin Epidemiol 51 1001–1011 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sjug%3D%3D Occurrence Handle10.1016/S0895-4356(98)00092-4 Occurrence Handle9817118
AE Raczek JE Ware JB Bjorner et al. (1998) ArticleTitleComparison of Rasch and summated rating scales constructed from SF-36 physical functioning items in seven countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1203–1214 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Shug%3D%3D Occurrence Handle10.1016/S0895-4356(98)00112-7 Occurrence Handle9817138
JB Bjorner S Kreiner JE Ware MT Damsgaard P Bech (1998) ArticleTitleDifferential item functioning in the Danish translation of the SF-36 J Clin Epidemiol 51 1189–1202 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShtQ%3D%3D Occurrence Handle10.1016/S0895-4356(98)00111-5 Occurrence Handle9817137
D Moher KF Schulz DG Altman (2001) ArticleTitleThe CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials Lancet 357 1191–1194 Occurrence Handle1:STN:280:DC%2BD3MzisFehtQ%3D%3D Occurrence Handle10.1016/S0140-6736(00)04337-3 Occurrence Handle11323066
PM Bossuyt JB Reitsma DE Bruns et al. (2003) ArticleTitleThe STARD statement for reporting studies of diagnostic accuracy: Explanation and elaboration Ann Intern Med 138 W1–12 Occurrence Handle10.7326/0003-4819-138-1-200301070-00012-w1 Occurrence Handle12513067
PM Bossuyt JB Reitsma DE Bruns et al. (2003) ArticleTitleTowards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative Ann Intern Med 138 40–44 Occurrence Handle10.7326/0003-4819-138-1-200301070-00010 Occurrence Handle12513043
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Vet, H.C.W.d., Adèr, H.J., Terwee, C.B. et al. Are factor analytical techniques used appropriately in the validation of health status questionnaires? A systematic review on the quality of factor analysis of the SF-36. Qual Life Res 14, 1203–1218 (2005). https://doi.org/10.1007/s11136-004-5742-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-004-5742-3