Abstract
Background: Few comprehensive systems are available for assessing and reporting the overall health of pre-school children.Objectives: (i) To develop a multi-dimension health status classification system (HSCS) to describe pre-school (PS) children 2.5–5 years of age; (ii) to report reliability and validity of the newly developed measure. Design: Existing systems (Health Utilities Index, Mark 2 and 3) were adapted for application to a pre-school population. The new system was tested for acceptability, validity and reliability. Participants: Three cohorts of children and their parents from Canada and Australia were utilized: Cohort 1 (MAC)-101 3-years old very low birthweight (VLBW, < 1500 g) and 50 same age term children from Canada; Cohort 2 (AUS)-150 VLBW 3-years old from Australia; Cohort 3 (OMG)-222 3-years old with cerebral palsy (CP) from Ontario. Methods: Parental intra-rater reliability was evaluated by completion of the HSCS-PS Parent questionnaire (MAC) at the clinic visit and again 14 days later. Health professionals (MAC) completed the HSCS-PS Clinician questionnaire. Percent agreement and Kappa values were used to assess parent-clinician agreement. Concurrent validity was tested in two populations of VLBW children (MAC and AUS) and a reference group of term children (MAC) by exploring the relationships between dimensions of the HSCS-PS and well-recognized norm-referenced measures: the Bayley Scales of Infant Development (BSID-II), the Vineland Adaptive Behavior Scales (VABS) and the Stanford-Binet (SB). Construct validity was tested by comparing ratings on both the HSCS-PS and the Gross Motor Function classification system (GMFCS) using a population of pre-school children with CP. Analyses were done using χ2, ANOVA and correlations with tau-b statistic. Results: The HSCS-PS has 12 dimensions and 3–5 levels per dimension. Response rate for parental intra-rater reliabilitywas 95%, with percent agreement ranging between 86 and 100%. Kappa values for various dimensions ranged from 0.38 to 1.00. Inter-rater reliability between parents and clinicians showed agreement ranging from 72 to 100%. Kappa values ranged from 0.30 to 1.00. Concurrent Validity: There was a statistically significant gradient between HSCS-PS Mobility levels and motor scale scores of the BSID-II and VABS. A significant gradient also occurred when comparing HSCS-PS cognition levels to psychometric scores on the BSID-II and SB, as well as HSCS-PS self-care levels compared to VABS Daily Living scores. Discriminative and Construct validity: Birthweight category was shown to be a significant determinant of proportion of children with multiple HSCS-PS dimensions affected. In addition, HSCS-PS dimension levels were congruent with GMFCS levels where expected: mobility had excellent correlation; self-care, dexterity, speech and cognitive dimensions had moderate correlations. Conclusions: The HSCS-PS is readily accepted, quick to complete, widely applicable and provides a multi-dimensional description of health status. Preliminary assessments of reliability and validity are promising. The HSCS-PS can discriminate across populations by birthweight and shows strong relationships with standardized psychometric measures in comparable domains. It can provide a summary profile of functional limitations in various populations of pre-school children in a consistent manner across programs and in different settings.
Similar content being viewed by others
Abbreviations
- BSID-II:
-
Bayley Scales of Infant Development II (revised)
- CP:
-
cerebral palsy
- GMFCS:
-
Gross Motor Function Classification System
- HRQL:
-
health-related quality of life
- HSCS-PS:
-
health status classification system–pre-school
- HUI:
-
Health Utilities Index
- HUI 2/3:
-
Health Utilities Index Mark 2 and Mark 3
- MDI:
-
Bayley Mental Development Index
- PDI:
-
Bayley Psychomotor Development Index
- QALYs:
-
quality adjusted life years
- SB:
-
Stanford-Binet
- VABS:
-
Vineland Adaptive Behaviour Scales
- VLBW:
-
very low birth weight
References
BR Vohr LL Wright AM Dusick et al. (2000) ArticleTitleNeurodevelopmental and functional outcomes of extremely low birth weight infants in the National Institute of Child Health and Human Development Neonatal Research Network, 1993–1994. Pediatrics 105 1216–1226 Occurrence Handle10.1542/peds.105.6.1216 Occurrence Handle10835060
NS Wood N Marlow K Costeloe AT Gibson AR Wilkinson (2000) ArticleTitleFor the EPICure Study Group. Neurologic and developmental disability after extremely preterm birth. N Engl J Med 343 378–384
S Saigal P Rosenbaum B Stoskopf et al. (1994) ArticleTitleComprehensive assessment of the health status of extremely low birth weight children at eight years of age: Comparison with a reference group. J Pediatr 125 411–417 Occurrence Handle8071751
S Saigal D Feeny W Furlong P Rosenbaum E Burrows G Torrance (1994) ArticleTitleComparison of the health-related quality of life of extremely low birth weight children and a reference group of children at age eight years. J Pediatr 125 418–425 Occurrence Handle8071752
D Feeny GW Torrance (1989) ArticleTitleIncorporating utility-based quality-of-life assessment measures in clinical trials: two examples. Med Care 27 S190–S204 Occurrence Handle2522159
D Feeny R Labelle GW Torrance (1990) Integrating economic evaluations and quality of life assessments B Spiker (Eds) Quality of life Assessments in Clinical Trials Raven Press Ltd New York
ME Jenney S Campbell (1997) ArticleTitleMeasuring quality of life. Arch Dis Child 77 347–350 Occurrence Handle9389243
C Eiser R Morse (2001) ArticleTitleThe measurement of quality of life in children: Past and future perspectives. J Dev Behav Pediatr 22 248–256 Occurrence Handle11530898
RD Barr D Feeny W Furlong S Weitzman GW Torrance (1995) ArticleTitleA preference-based approach to health-related quality of life for children with cancer. Int J Pediatr Hematol Oncol 2 305–315
D Feeny A Leiper RD Barr et al. (1993) ArticleTitleThe comprehensive assessment of health status in survivors of childhood cancer: Application to high-risk acute lymphoblastic leukaemia. Br J Cancer 67 1047–1052 Occurrence Handle8494697
S Saigal D Feeny P Rosenbaum W Furlong E Burrows B Stoskopf (1996) ArticleTitleSelf-perceived health status and health-related quality of life of extremely low-birth-weight infants at adolescence. JAMA 276 453–459 Occurrence Handle10.1001/jama.276.6.453 Occurrence Handle8691552
S Saigal PL Rosenbaum D Feeny et al. (2000) ArticleTitleParental perspectives of the health status and health-related quality of life of teen-aged children who were extremely low birth weight and term controls. Pediatrics 105 569–574 Occurrence Handle10.1542/peds.105.3.569 Occurrence Handle10699111
S Saigal BL Stoskopf D Feeny et al. (1999) ArticleTitleDifferences in preferences for neonatal outcomes among health care professionals, parents, and adolescents. JAMA 281 1991–1997 Occurrence Handle10.1001/jama.281.21.1991 Occurrence Handle10359387
WJ Furlong DH Feeny GW Torrance RD Barr (2001) ArticleTitleThe Health Utilities Index (HUI) system for assessing health-related quality of life in clinical studies. Ann Med 33 375–384 Occurrence Handle11491197
J Horsman W Furlong D Feeny G Torrance (2003) ArticleTitleThe Health Utilities Index (HUI™): Concepts, measurement properties and applications. Health and Quality of Life Outcomes 1 54–67 Occurrence Handle10.1186/1477-7525-1-54 Occurrence Handle14613568
JW Varni M Seid CA Rode (1999) ArticleTitleThe PedsQL™: Measurement Model for the Pediatric Quality of Life Inventory. Med Care 37 126–139 Occurrence Handle10.1097/00005650-199902000-00003 Occurrence Handle10024117
B Starfield AW Riley BF Green et al. (1995) ArticleTitleThe adolescent child health and illness profile. A population-based measure of health Med Care 33 553–566 Occurrence Handle7739277
U Ravens-Sieberer M Bullinger (1998) ArticleTitleAssessing health-related quality of life in chronically ill children with the German KINDL: First psychometric and content analytical results. Qual Life Res 7 399–407 Occurrence Handle10.1023/A:1008853819715 Occurrence Handle9691720
JM Landgraf L Abetz JE Wave SuffixJr (1996) The CHQ user’s manual EditionNumber1 The Health Institute, New England Medical Center Boston, MA
Landgraf J, Abetz L. The infant/toddler quality of life questionnaire: Conceptual framework, logic, content, and preliminary psychometric results. Final Report to Schering–Plough Laboratories and Health Technology Associates. New England Medical Centre; July 1994.
JW Varni M Seid PS Kurtin (2001) ArticleTitlePedsQL 4.0: Reliability and validity of the pediatric quality of life inventory version 4.0 generic core scales in healthy and patient populations. Med Care 39 800–812 Occurrence Handle10.1097/00005650-200108000-00006 Occurrence Handle11468499
ME Msall K Di Gaudio LC Duffy S LaForest S Braun CV Granger (1994) ArticleTitleWeeFIM: Normative sample of an instrument for tracking functional independence in children. Clin Pediatr 33 431–438
M Fekkes NCM Theunissen E Brugman et al. (2000) ArticleTitleDevelopment and psychometric evaluation of the TAPQOL: A health-related quality of life instrument for 1–5-year-old children. Qual Life Res 9 961–972 Occurrence Handle10.1023/A:1008981603178 Occurrence Handle11284215
lassen Ann F, Landgraf JM, Lee SK, et al. Health related quality of life in 3 and 4 year old children and their parents: Preliminary findings about a new questionnaire. Health and Quality of Life Outcomes 2003; 1:81 (http://www.hqlo. com/content/l/l/8l).
DL Streiner GR Norman (1995) Health measurement scales. A Practical Guide to Their Development and Use EditionNumber2 Oxford University Press New York
I McDowell C Newell (1987) Measuring Health: A Guide to Rating Scales and Questionnaires (Chapter 2). Oxford University Press New York
GW Torrance MH Boyle SP Horwood (1982) ArticleTitleApplication of multi-attribute utility theory to measure social preferences for health states. Oper Res 30 1043–1069 Occurrence Handle10259643
MH Boyle GW Torrance JC Sinclair SP Horwood (1983) ArticleTitleEconomic evaluation of neonatal intensive care of very-low-birth-weight infants. N Engl J Med 308 1330–1337 Occurrence Handle6405272
D Feeny W Furlong RD Barr GW Torrance P Rosenbaum S Weitzman (1992) ArticleTitleA comprehensive multiattribute system for classifying the health status of survivors of childhood cancer. J Clin Oncol 10 923–928 Occurrence Handle1316952
D Feeny W Furlong M Boyle GW Torrance (1995) ArticleTitleMulti-attribute Health status classification systems. Health Utilities Index. PharmacoEconomics 7 490–502
MH Boyle W Furlong D Feeny GW Torrance J Hatcher (1995) ArticleTitleReliability of the Health Utilities Index–Mark III used in the 1991 cycle 6 Canadian General Social Survey health questionnaire. Qual Life Res 4 249–257 Occurrence Handle7613535
L Swain G Catlin MP Beaudet (1999) ArticleTitleThe National Population Health Survey–its longitudinal nature. Health Reports (Statistics Canada, Catalogue 82-003) 10 69–82
AT Bhutta MA Cleves PH Casey MM Cradock KJ Anand (2002) ArticleTitleCognitive and behavioral outcomes of school-aged children who were born preterm: A meta-analysis. JAMA 288 728–737 Occurrence Handle10.1001/jama.288.6.728 Occurrence Handle12169077
PL Rosenbaum SD Walter SE Hanna et al. (2002) ArticleTitlePrognosis for gross motor function in cerebral palsy: Creation of motor development curves. JAMA 288 IssueID11 1357–1363 Occurrence Handle10.1001/jama.288.11.1357 Occurrence Handle12234229
N Bayley (1993) Manual for the Bayley Scales of Infant Development EditionNumber2 The Psychological Corporation of Harcourt Brace Company San Antonio, Texas
SS Sparrow DA Balla DV Cicchetti (1984) Vineland Adaptive Behavior Scales: Interview Edition, Survey Form Manual. A Revision of the Vineland Social Maturity Scale by E.A Doll American Guidance Service Circle Pines, MN
P Rosenbaum S Saigal P Szatmari L Hoult (1995) ArticleTitleVineland adaptive behaviour scales as a summary of functional outcome of extremely low-birthweight children. Dev Med Child Neurol 37 IssueID7 577–586 Occurrence Handle7542210
DY Teller MA McDonald K Preston SL Sebris V Dobson (1986) ArticleTitleAssessment of visual acuity in infants and children: The acuity card procedure. Dev Med Child Neurol 28 779–789 Occurrence Handle3817317
Thorndike R, Hagan EP, Sattler JM. Stanford-Binet Intelligence Scale, 4th ed. Chicago: Riverside.
R Palisano P Rosenbaum S Walter D Russell E Wood B Galuppi (1997) ArticleTitleDevelopment and reliability of a system to classify gross motor function in children with cerebral palsy. Dev Med Child Neurol 39 IssueID4 214–223 Occurrence Handle9183258
E Wood P Rosenbaum (2000) ArticleTitleThe gross motor function classification system for cerebral palsy: A study of reliability and stability over time. Dev Med Child Neurol 42 IssueID5 292–296 Occurrence Handle10.1017/S0012162200000529 Occurrence Handle10855648
J Kennes P Rosenbaum S Hanna et al. (2002) ArticleTitleHealth status of school-aged children with cerebral palsy: Information from a population-based sample. Dev Med Child Neurol 44 IssueID4 240–247 Occurrence Handle11995892
GR Norman D Streiner (2000) Biostatistics: The Bare Essentials EditionNumber2 Mosby Year Books St. Louis
JC Nunnally (1978) Psychometric Theory EditionNumber2 McGraw-Hill New York
RJ Landis GG Koch (1977) ArticleTitleThe Measurement of observer agreement for Categorical Data. Biometrics 33 159–174 Occurrence Handle843571
GW Torrance W Furlong D Feeny M Boyle (1995) ArticleTitleMulti-attribute preference functions. Health Utilities Index PharmacoEconomics 7 503–520
GW Torrance DH Feeny WJ Furlong RD Barr Y Zhang Q Wang (1996) ArticleTitleMulti-attribute utility function for a comprehensive health status classification system. Health Utilities Index mark 2. Med Care 34 702–722
B Zhang B Schmidt (2001) ArticleTitleDo we measure the right end points? A systematic review of primary outcomes in recent neonatal randomized clinical trials J Pediatr 138 76–80
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Saigal, S., Rosenbaum, P., Stoskopf, B. et al. Development, reliability and validity of a new measure of overall health for pre-school children. Qual Life Res 14, 243–252 (2005). https://doi.org/10.1007/s11136-004-4228-7
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11136-004-4228-7