Skip to main content

Advertisement

Log in

Are factor analytical techniques used appropriately in the validation of health status questionnaires? A systematic review on the quality of factor analysis of the SF-36

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Factor analysis is widely used to evaluate whether questionnaire items can be grouped into clusters representing different dimensions of the construct under study. This review focuses on the appropriate use of factor analysis. The Medical Outcomes Study Short Form-36 (SF-36) is used as an example. Articles were systematically searched and assessed according to a number of criteria for appropriate use and reporting. Twenty-eight studies were identified: exploratory factor analysis was performed in 22 studies, confirmatory factor analysis was performed in five studies and in one study both were performed. Substantial shortcomings were found in the reporting and justification of the methods applied. In 15 of the 23 studies in which exploratory factor analysis was performed, confirmatory factor analysis would have been more appropriate. Cross-validation was rarely performed. Presentation of the results and conclusions was often incomplete. Some of our results are specific for the SF-36, but the finding that both the application and the reporting of factor analysis leaves much room for improvement probably applies to other health status questionnaires as well. Optimal reporting and justification of methods is crucial for correct interpretation of the results and verification of the conclusions. Our list of criteria may be useful for journal editors, reviewers and researchers who have to assess publications in which factor analysis is applied.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. FJ Floyd KF Widaman (1995) ArticleTitleFactor analysis in the development and refinement of clinical assessment instruments Psychol Assess 7 286–299 Occurrence Handle10.1037/1040-3590.7.3.286

    Article  Google Scholar 

  2. Johnson DE. Applied Multivariate Methods for Data Analysts. 1998.

  3. DL Streiner (1994) ArticleTitleFiguring out factors: The use and misuse of factor analysis Can J Psychiatry 39 135–140 Occurrence Handle1:STN:280:DyaK2czgs1aqtg%3D%3D Occurrence Handle8033017

    CAS  PubMed  Google Scholar 

  4. RL Gorsuch (1983) Factor Analysis Lawrence Erlbaum Associates, Inc, Hillsdale NJ

    Google Scholar 

  5. JE Ware SuffixJr CD Sherbourne (1992) ArticleTitleThe MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection Med Care 30 473–483 Occurrence Handle10.1097/00005650-199206000-00002 Occurrence Handle1593914

    Article  PubMed  Google Scholar 

  6. JE Ware SuffixJr (2000) ArticleTitleSF-36 health survey update Spine 25 3130–3139 Occurrence Handle10.1097/00007632-200012150-00008 Occurrence Handle11124729

    Article  PubMed  Google Scholar 

  7. CA McHorney JE Ware SuffixJr AE Raczek (1993) ArticleTitleThe MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs Med Care 31 247–263 Occurrence Handle1:STN:280:DyaK3s7ps1antA%3D%3D Occurrence Handle10.1097/00005650-199303000-00006 Occurrence Handle8450681

    Article  CAS  PubMed  Google Scholar 

  8. Ware JE, Kosinski M, Keller SK, Psychological and mental health summary scales: A user’s manual. 1994. Boston MA, The Health Institute (report).

  9. JE Ware SuffixJr M Kosinski B Gandek et al. (1998) ArticleTitleThe factor structure of the SF-36 Health Survey in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1159–1165 Occurrence Handle10.1016/S0895-4356(98)00107-3 Occurrence Handle9817133

    Article  PubMed  Google Scholar 

  10. JE Ware SuffixJr B Gandek (1998) ArticleTitleOverview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project J Clin Epidemiol 51 903–912 Occurrence Handle10.1016/S0895-4356(98)00081-X Occurrence Handle9817107

    Article  PubMed  Google Scholar 

  11. J Ware SuffixJr M Kosinski SD Keller (1996) ArticleTitleA 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity Med Care 34 220–233 Occurrence Handle10.1097/00005650-199603000-00003 Occurrence Handle8628042

    Article  PubMed  Google Scholar 

  12. WR Zwick WF Velicer (1986) ArticleTitleA comparison of five rules for determining the number of components to retain Psychol Bull 99 432–442 Occurrence Handle10.1037/0033-2909.99.3.432

    Article  Google Scholar 

  13. DB Allison BS Gorman LH Primavera (1993) ArticleTitleSome of the most common questions asked of statistical consultants: Our favorite responses and recommended readings Gene Soc Gen Psychol Monogr 119 153–185

    Google Scholar 

  14. KA Bollen (1989) Structural Equations with Latent Variables Wiley New York Occurrence Handle10.1002/9781118619179

    Book  Google Scholar 

  15. F Pouwer FJ Snoek HM Vander Ploeg HJ Ader RJ Heine (2000) ArticleTitleThe well-being questionnaire: Evidence for a three-factor structure with 12 items (W-BQ12) Psychol Med 30 455–462 Occurrence Handle1:STN:280:DC%2BD3cvhsFeruw%3D%3D Occurrence Handle10.1017/S0033291700001719 Occurrence Handle10824665

    Article  CAS  PubMed  Google Scholar 

  16. P Kline (1993) The Handbook of Psychological Testing Routledge London

    Google Scholar 

  17. E Guadagnoli WF Velicer (1988) ArticleTitleRelation of sample size to the stability of component patterns Psychol Bull 103 265–275 Occurrence Handle1:STN:280:DyaL1c3gsVSgsQ%3D%3D Occurrence Handle10.1037/0033-2909.103.2.265 Occurrence Handle3363047

    Article  CAS  PubMed  Google Scholar 

  18. B Gandek JE Ware SuffixJr (1998) ArticleTitleMethods for validating and norming translations of health status questionnaires: The IQOLA Project approach.International Quality of Life Assessment J Clin Epidemiol 51 953–959 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SjsA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00086-9 Occurrence Handle9817112

    Article  CAS  PubMed  Google Scholar 

  19. RD Hays CD Sherbourne RM Mazel (1993) ArticleTitleThe RAND 36-Item Health Survey 1.0 Health Econ 2 217–227 Occurrence Handle1:STN:280:DyaK2c7gtFSltQ%3D%3D Occurrence Handle10.1002/hec.4730020305 Occurrence Handle8275167

    Article  CAS  PubMed  Google Scholar 

  20. M Kosinski SD Keller HT Hatoum SX Kong JE Ware SuffixJr (1999) ArticleTitleThe SF-36 Health Survey as a generic outcome measure in clinical trials of patients with osteoarthritis and rheumatoid arthritis: Tests of data quality, scaling assumptions and score reliability Med Care 37 MS10–MS22 Occurrence Handle1:STN:280:DyaK1M3ms1Oksw%3D%3D Occurrence Handle10335740

    CAS  PubMed  Google Scholar 

  21. PJ Reed (1998) ArticleTitleMethods of evaluation in outcomes research Am J Manag Care 4 1616–1625 Occurrence Handle1:STN:280:DyaK1M7hvVGqsw%3D%3D Occurrence Handle10338907

    CAS  PubMed  Google Scholar 

  22. JE Ware M Kosinski (2001) ArticleTitleInterpreting SF-36 summary health measures: A response Qual Life Res 10 405–413 Occurrence Handle1:STN:280:DC%2BD38%2FjsVelsA%3D%3D Occurrence Handle10.1023/A:1012588218728 Occurrence Handle11763203

    Article  CAS  PubMed  Google Scholar 

  23. LE Pfennings HM Vander Ploeg L Cohen et al. (1999) ArticleTitleA health-related quality of life questionnaire for multiple sclerosis patients Acta Neurol Scand 100 148–155 Occurrence Handle1:STN:280:DyaK1MvgsFKrsA%3D%3D Occurrence Handle10.1111/j.1600-0404.1999.tb00730.x Occurrence Handle10478577

    Article  CAS  PubMed  Google Scholar 

  24. J Thumboo PH Feng CH Soh ML Boey S Thio KY Fong (2000) ArticleTitleValidation of a Chinese version of the Medical Outcomes Study Family and Marital Functioning Measures in patients with SLE Lupus 9 702–707 Occurrence Handle1:STN:280:DC%2BD3M7kslemtg%3D%3D Occurrence Handle10.1191/096120300666529212 Occurrence Handle11199926

    Article  CAS  PubMed  Google Scholar 

  25. PR Dexter TE Stump WM Tierney FD Wolinsky (1996) ArticleTitleThe psychometric properties of the SF-36 Health Survey among older adults in a clinical setting J Clin Geropsychol 2 225–237

    Google Scholar 

  26. KM Scott SJ Haslett (1999) ArticleTitleSF-36 health survey reliability, validity and norms for New Zealand Aust New Zeal J Public Health 23 401–406 Occurrence Handle1:STN:280:DyaK1Mzpt1WhsQ%3D%3D Occurrence Handle10.1111/j.1467-842X.1999.tb01282.x

    Article  CAS  Google Scholar 

  27. I Failde I Ramos (2000) ArticleTitleValidity and reliability of the SF-36 Health Survey Questionnaire in patients with coronary artery disease J Clin Epidemiol 53 359–365 Occurrence Handle1:STN:280:DC%2BD3c3kvFajsA%3D%3D Occurrence Handle10.1016/S0895-4356(99)00175-4 Occurrence Handle10785566

    Article  CAS  PubMed  Google Scholar 

  28. SD Keller JE Ware SuffixJr PM Bentler et al. (1998) ArticleTitleUse of structural equation modeling to test the construct validity of the SF-36 Health Survey in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1179–1188 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShtA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00110-3 Occurrence Handle9817136

    Article  CAS  PubMed  Google Scholar 

  29. N Lewin-Epstein T Sagiv-Schifter EL Shabtai A Shmueli (1998) ArticleTitleValidation of the 36-item short-form Health Survey (Hebrew version) in the adult population of Israel Med Care 36 1361–1370 Occurrence Handle1:STN:280:DyaK1cvitVSrug%3D%3D Occurrence Handle10.1097/00005650-199809000-00008 Occurrence Handle9749659

    Article  CAS  PubMed  Google Scholar 

  30. PJ Reed (1998) ArticleTitleMedical outcomes study short form 36: Testing and cross-validating a second-order factorial structure for health system employees Health Serv Res 33 1361–1380 Occurrence Handle1:STN:280:DyaK1M%2Fot1OnsQ%3D%3D Occurrence Handle9865224 Occurrence Handle1070320

    CAS  PubMed  PubMed Central  Google Scholar 

  31. J Thumboo KY Fong D Machin et al. (2001) ArticleTitleA community-based study of scaling assumptions and construct validity of the English (UK) and Chinese (HK) SF-36 in Singapore Qual Life Res 10 175–188 Occurrence Handle1:STN:280:DC%2BD3MrmtF2luw%3D%3D Occurrence Handle10.1023/A:1016701514299 Occurrence Handle11642688

    Article  CAS  PubMed  Google Scholar 

  32. FD Wolinsky TE Stump (1996) ArticleTitleA measurement model of the Medical Outcomes Study 36-Item Short-Form Health Survey in a clinical sample of disadvantaged, older, black, and white men and women Med Care 34 537–548 Occurrence Handle1:STN:280:DyaK283lvVemtg%3D%3D Occurrence Handle10.1097/00005650-199606000-00004 Occurrence Handle8656720

    Article  CAS  PubMed  Google Scholar 

  33. D Wilson J Parsons G Tucker (2000) ArticleTitleThe SF-36 summary scales: Problems and solutions Soz Praventiv Med 45 239–246 Occurrence Handle1:STN:280:DC%2BD3M3isVektQ%3D%3D Occurrence Handle10.1007/BF01591686

    Article  CAS  Google Scholar 

  34. J Hardt D Buchwald D Wilks M Sharpe WA Nix UT Egle (2001) ArticleTitleHealth-related quality of life in patients with chronic fatigue syndrome: An international study J Psychosom Res 51 431–434 Occurrence Handle1:STN:280:DC%2BD3Mvnt1Wqsw%3D%3D Occurrence Handle10.1016/S0022-3999(01)00220-3 Occurrence Handle11516765

    Article  CAS  PubMed  Google Scholar 

  35. G Mishra MJ Schofield (1998) ArticleTitleNorms for the physical and mental health component summary scores of the SF-36 for young, middle-aged and older Australian women Qual Life Res 7 215–220 Occurrence Handle1:STN:280:DyaK1c3ksFGgsg%3D%3D Occurrence Handle10.1023/A:1008821913429 Occurrence Handle9584551

    Article  CAS  PubMed  Google Scholar 

  36. JE Ware SuffixJr B Gandek M Kosinski et al. (1998) ArticleTitleThe equivalence of SF-36 summary health scores estimated using standard and country-specific algorithms in 10 countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1167–1170 Occurrence Handle10.1016/S0895-4356(98)00108-5 Occurrence Handle9817134

    Article  PubMed  Google Scholar 

  37. C Jenkinson R Layte (1997) ArticleTitleDevelopment and testing of the UK SF-12 (short form health survey) J Health Serv Res Policy 2 14–18 Occurrence Handle1:STN:280:DyaK1czitFCjtw%3D%3D Occurrence Handle10180648

    CAS  PubMed  Google Scholar 

  38. C Jenkinson S Stewart-Brown S Petersen C Paice (1999) ArticleTitleAssessment of the SF-36 version 2 in the United Kingdom J Epidemiol Commun Health 53 46–50 Occurrence Handle1:STN:280:DyaK1M3lsl2jsQ%3D%3D Occurrence Handle10.1136/jech.53.1.46

    Article  CAS  Google Scholar 

  39. G Apolone P Mosconi (1998) ArticleTitleThe Italian SF-36 Health Survey: Translation, validation and norming J Clin Epidemiol 51 1025–1036 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sisg%3D%3D Occurrence Handle10.1016/S0895-4356(98)00094-8 Occurrence Handle9817120

    Article  CAS  PubMed  Google Scholar 

  40. S Fukuhara JE Ware SuffixJr M Kosinski S Wada B Gandek (1998b) ArticleTitlePsychometric and clinical tests of validity of the Japanese SF-36 Health Survey J Clin Epidemiol 51 1045–1053 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SisA%3D%3D Occurrence Handle10.1016/S0895-4356(98)00096-1

    Article  CAS  Google Scholar 

  41. S Fukuhara S Bito J Green A Hsiao K Kurokawa (1998a) ArticleTitleTranslation, adaptation, and validation of the SF-36 Health Survey for use in Japan J Clin Epidemiol 51 1037–1044 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sisw%3D%3D Occurrence Handle10.1016/S0895-4356(98)00095-X

    Article  CAS  Google Scholar 

  42. J Hobart J Freeman D Lamping R Fitzpatrick A Thompson (2001) ArticleTitleThe SF-36 in multiple sclerosis: Why basic assumptions must be tested J Neurol Neurosurg Psychiatry 71 363–370 Occurrence Handle1:STN:280:DC%2BD3Mvms12gsQ%3D%3D Occurrence Handle10.1136/jnnp.71.3.363 Occurrence Handle11511712 Occurrence Handle1737568

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. TV Perneger A Leplege JF Etter A Rougemont (1995) ArticleTitleValidation of a French-language version of the MOS 36-Item Short Form Health Survey (SF-36) in young healthy adults J Clin Epidemiol 48 1051–1060 Occurrence Handle1:STN:280:DyaK2M3psVGqug%3D%3D Occurrence Handle10.1016/0895-4356(94)00227-H Occurrence Handle7775992

    Article  CAS  PubMed  Google Scholar 

  44. RW Sanson-Fisher JJ Perkins (1998) ArticleTitleAdaptation and validation of the SF-36 Health Survey for use in Australia J Clin Epidemiol 51 961–967 Occurrence Handle1:STN:280:DyaK1M%2Fjt1SjsQ%3D%3D Occurrence Handle10.1016/S0895-4356(98)00087-0 Occurrence Handle9817113

    Article  CAS  PubMed  Google Scholar 

  45. KM Scott D Sarfati MI Tobias SJ Haslett (2000) ArticleTitleA challenge to the cross-cultural validity of the SF-36 health survey: Factor structure in Maori, Pacific and New Zealand European ethnic groups Soc Sci Med 51 1655–1664 Occurrence Handle1:STN:280:DC%2BD3crhtl2gsQ%3D%3D Occurrence Handle10.1016/S0277-9536(00)00083-6 Occurrence Handle11072885

    Article  CAS  PubMed  Google Scholar 

  46. K Stadnyk J Calder K Rockwood (1998) ArticleTitleTesting the measurement properties of the Short Form-36 Health Survey in a frail elderly population J Clin Epidemiol 51 827–835 Occurrence Handle1:STN:280:DyaK1cvjtlyguw%3D%3D Occurrence Handle10.1016/S0895-4356(98)00061-4 Occurrence Handle9762875

    Article  CAS  PubMed  Google Scholar 

  47. ML Essink-Bot PF Krabbe GJ Bonsel NK Aaronson (1997) ArticleTitleAn empirical comparison of four generic health status measures. The Nottingham Health Profile, the Medical Outcomes Study 36-item Short-Form Health Survey, the COOP/WONCA charts, and the EuroQol instrument Med Care 35 522–537 Occurrence Handle1:STN:280:DyaK2s3osFSltA%3D%3D Occurrence Handle10.1097/00005650-199705000-00008 Occurrence Handle9140339

    Article  CAS  PubMed  Google Scholar 

  48. L Gold beck TG Sch mitz (2001) ArticleTitleCom par i son of three generic ques tion naires mea sur ing qual ity of life in ado les cents and adults with cys tic fibro sis: The 36-item short form health sur vey, the qual ity of life pro file for chronic dis eases, and the ques tions on life sat is fac tion Qual Life Res 10 23–36 Occurrence Handle1:STN:280:DC%2BD3MvmtlOhug%3D%3D Occurrence Handle10.1023/A:1016711704283

    Article  CAS  Google Scholar 

  49. JY Chern TT Wan M Pyles (2000) ArticleTitleThe stability of health status measurement (SF-36) in a working population J Outcome Meas 4 461–481 Occurrence Handle1:STN:280:DC%2BD3M7nt1ersw%3D%3D Occurrence Handle11272596

    CAS  PubMed  Google Scholar 

  50. J Thumboo KY Fong SP Chan et al. (2002) ArticleTitleThe equivalence of English and Chinese SF-36 versions in bilingual Singapore Chinese Qual Life Res 11 495–503 Occurrence Handle10.1023/A:1015680029998 Occurrence Handle12113396

    Article  PubMed  Google Scholar 

  51. RL Gorsuch (1995) ArticleTitleExploratory factor analysis: Its role in item analysis J Pers Assess 68 532–560 Occurrence Handle10.1207/s15327752jpa6803_5

    Article  Google Scholar 

  52. NK Aaronson M Muller PD Cohen et al. (1998) ArticleTitleTranslation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations J Clin Epidemiol 51 1202 Occurrence Handle10.1016/S0895-4356(98)00097-3

    Article  Google Scholar 

  53. JB Bjorner MT Damsgaard T Watt M Groenvold (1998) ArticleTitleTests of data quality, scaling assumptions, and reliability of the Danish SF-36 J Clin Epidemiol 51 1001–1011 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Sjug%3D%3D Occurrence Handle10.1016/S0895-4356(98)00092-4 Occurrence Handle9817118

    Article  CAS  PubMed  Google Scholar 

  54. AE Raczek JE Ware JB Bjorner et al. (1998) ArticleTitleComparison of Rasch and summated rating scales constructed from SF-36 physical functioning items in seven countries: Results from the IQOLA Project.International Quality of Life Assessment J Clin Epidemiol 51 1203–1214 Occurrence Handle1:STN:280:DyaK1M%2Fjt1Shug%3D%3D Occurrence Handle10.1016/S0895-4356(98)00112-7 Occurrence Handle9817138

    Article  CAS  PubMed  Google Scholar 

  55. JB Bjorner S Kreiner JE Ware MT Damsgaard P Bech (1998) ArticleTitleDifferential item functioning in the Danish translation of the SF-36 J Clin Epidemiol 51 1189–1202 Occurrence Handle1:STN:280:DyaK1M%2Fjt1ShtQ%3D%3D Occurrence Handle10.1016/S0895-4356(98)00111-5 Occurrence Handle9817137

    Article  CAS  PubMed  Google Scholar 

  56. D Moher KF Schulz DG Altman (2001) ArticleTitleThe CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials Lancet 357 1191–1194 Occurrence Handle1:STN:280:DC%2BD3MzisFehtQ%3D%3D Occurrence Handle10.1016/S0140-6736(00)04337-3 Occurrence Handle11323066

    Article  CAS  PubMed  Google Scholar 

  57. PM Bossuyt JB Reitsma DE Bruns et al. (2003) ArticleTitleThe STARD statement for reporting studies of diagnostic accuracy: Explanation and elaboration Ann Intern Med 138 W1–12 Occurrence Handle10.7326/0003-4819-138-1-200301070-00012-w1 Occurrence Handle12513067

    Article  PubMed  Google Scholar 

  58. PM Bossuyt JB Reitsma DE Bruns et al. (2003) ArticleTitleTowards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative Ann Intern Med 138 40–44 Occurrence Handle10.7326/0003-4819-138-1-200301070-00010 Occurrence Handle12513043

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Henrica C. W. de Vet.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vet, H.C.W.d., Adèr, H.J., Terwee, C.B. et al. Are factor analytical techniques used appropriately in the validation of health status questionnaires? A systematic review on the quality of factor analysis of the SF-36. Qual Life Res 14, 1203–1218 (2005). https://doi.org/10.1007/s11136-004-5742-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-004-5742-3

Keywords

Navigation