Article Text

Download PDFPDF

Feasibility and validity of the Health Status Classification System-Preschool (HSCS-PS) in a large community sample: the Generation R study
  1. Xinye Fang1,2,
  2. Guannan Bai3,4,
  3. Dafna A Windhorst3,
  4. David Feeny5,
  5. Saroj Saigal6,
  6. Liesbeth Duijts7,8,
  7. Vincent W V Jaddoe4,9,10,
  8. Shanlian Hu2,
  9. Chunlin Jin1,2,
  10. Hein Raat3
  1. 1 Shanghai Medical Information Center, Shanghai, China
  2. 2 Shanghai Health Development Research Center, Shanghai, China
  3. 3 Department of Public Health, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  4. 4 The Generation R Group, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  5. 5 Department of Economics and Centre for Health Economics and Policy Analysis, McMaster University, Hamilton, Ontario, Canada
  6. 6 Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada
  7. 7 Division of Respiratory Medicine and Allergology, Department of Pediatrics, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  8. 8 Division of Neonatology, Department of Pediatrics, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  9. 9 Department of Pediatrics, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  10. 10 Department of Epidemiology, Erasmus MC - University Medical Center Rotterdam, Rotterdam, The Netherlands
  1. Correspondence to Professor Hein Raat; h.raat{at}erasmusmc.nl

Abstract

Objectives To evaluate the feasibility, discriminant validity and concurrent validity of the Health Status Classification System-Preschool (HSCS-PS) in children aged 3 years in a large community sample in the Netherlands.

Design/setting A prospective population-based cohort in Rotterdam, the Netherlands.

Participants A questionnaire was administrated to a sample of parents of 4546 children (36.7±1.5 months).

Outcome measures Health-related quality of life (HRQOL) of children was measured by HSCS-PS. The HSCS-PS consists of 10 original domains. Two single-item measures of ‘General health’ and ‘Behavior’ were added. A disability score was calculated by summing up all 10 original domains to describe the overall health status. Feasibility was assessed by the response rate, percentages of missing answers, score distributions and the presence of floor/ceiling effects. Discriminant validity was analysed between subgroups with predefined conditions: low birth weight, preterm birth, wheezing, Ear-Nose-Throat surgical procedures and behaviour problems. In the absence of another HRQOL measure, this study uses the single-items ‘General health’ and ‘Behavior’ as a first step to evaluate concurrent validity of the HSCS-PS.

Results Feasibility: response rate was 69%. Ceiling effects were observed in all domains. Discriminant validity: the disability score discriminated clearly between subgroups of children born with a ‘very low birth weight’, ‘very preterm birth’, with ‘four or more than four times wheezing’, ‘at least one ear-nose-throat surgical procedures’, ‘behaviour problems present’ and the ‘reference’ group. Concurrent validity: HSCS-PS domains correlated better with hypothesised parallel additional domains than with other non-hypothesised original domains.

Conclusions This study supports the feasibility and validity of the HSCS-PS among preschoolers in community settings. We recommend developing a utility-based scoring algorithm for the HSCS-PS. Further empirical studies and repeated evaluations in varied populations are recommended.

  • concurrent validity
  • discriminant validity
  • quality of llife
  • preschool
  • children

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strength and limitations of this study

  • This study is the first to apply and to evaluate the Health Status Classification System-Preschool (HSCS-PS) in a very large community sample of preschool children.

  • Because our sample consisted of relatively healthy children, we were not able to describe the HSCS-PS in seriously ill populations.

  • The population for analysis was relatively well-educated and non-migrant families compared with the non-respondents which may limit the generalisability of the results.

  • Some indicators for the reliability of the HSCS-PS, such as inter-rater reliability and test–retest reliability were not able to be evaluated in our study. We recommend to assess this in future studies.

  • In the absence of an accepted ‘gold standard’ in this study, we recommend to assess the association between HSCS-PS with one or more other established measures of health-related quality of life in a future study.

Introduction  

Patient-reported health status and health-related quality of life (HRQOL) are essential outcome measures in addition to clinical outcomes in both general medicine and paediatrics.1 2 HRQOL refers to quality of life as modified by the functional states, impairments, perceptions and social opportunities as influenced by chronic conditions, injury, treatment or policy.3 4 Studies on HRQOL of preschool children are scarce due to the early stage of development and the need for proxy reporting.5 In addition to ‘health profile measures’ (eg, the Infant and Toddler Quality of Life Questionnaire; ITQOL) for economic analyses and guiding value-based healthcare, we need preference-based measures where the ‘health status description’ is ‘valued’ (ie, ‘weighted’) by a relevant panel in society.6–9 The most widely used preference-based measure is the Health Utilities Index (HUI; ie, HUI2 and HUI3) for children/people aged 4 years and above.1 10 There is a need for a similar, preference-based instrument for preschool children.

The Health Status Classification System-Preschool (HSCS-PS), developed by Saigal et al 11 is a multidimensional system to describe the HRQOL of preschool children aged 2.5–5 years.11 It is a parental (or clinician) proxy measurement of the health status of the child with a structure similar to the HUI.12 The instrument includes 10 mutually exclusive domains, that is, ‘Vision’, ‘Hearing’, ‘Speech’, ‘Mobility’, ‘Dexterity’, ‘Self-care’, ‘Emotion’, ‘Learning and remembering’, ‘Thinking and problem solving’, ‘Pain and discomfort’. Saigal et al 11 proposed two additional parent-reported single-item measures: ‘General health’ and ‘Behavior’.11

So far, the HSCS-PS has been validated in clinical cohorts of children with a very low birth weight (VLBW) and children with cerebral palsy.11 The HSCS-PS was applied in studies regarding the development of health of young children after extremely preterm birth.13 14 The reliability and validity of the HSCS-PS were supported in previous studies that applied HSCS-PS in patients who were diagnosed with neuroblastoma at 2–5 years of age.15 16 Little is known about the feasibility and validity among children in generally healthy populations.

The present study uses a large general population sample to describe and evaluate the parent-completed HSCS-PS by using information regarding birth outcomes (eg, low birth weight (LBW) and preterm birth), wheezing and ear-nose-throat (ENT) surgical procedures, and behaviour problem in preschool children identified by the Child Behavior Checklist (CBCL 1.5–5). Previous studies have shown that children with the above-mentioned health condition were reported by their parents or caregivers with relatively low HRQOL.17–25 For example, the parent-reported HRQOL of preschool children born preterm or born with a VLBW was lower than HRQOL of those who were not born preterm or with an LBW.17–20

In the absence of another HRQOL measure, this study uses the above-mentioned parent-reported single-items regarding ‘General health’26 and ‘Behavior’27 as a first step to evaluate concurrent validity of the HSCS-PS.

The aims of this study are to assess: (1) The feasibility of the HSCS-PS considering the response rate, missing answers, score distributions and presence of floor/ceiling effects; (2) The discriminant validity by comparing HSCS-PS scores between subgroups in the general population with presence/absence of LBW, premature delivery, wheezing, ENT surgical procedures and CBCL behaviour problems; and (3) as a first step regarding the concurrent validity by evaluation of the correlations between the original HSCS-PS scores and the ‘General health’ and ‘Behavior’ single-item measures.

Methods

Study design

This study was embedded in the Generation R Study, a population-based prospective child cohort study from fetal life onwards in Rotterdam, the Netherlands.28 All children were born between April 2002 and January 2006.

A total of 7893 children were included in the postnatal follow-up studies.28 In the survey after 36 months of birth, parental consent was available for 7294 children. Children whose caregivers did not fill out the questionnaire at age 3 years (n=2280) were excluded. Additionally, we excluded children with missing data on one or more domains of the HSCS-PS (n=468), leaving 4546 children for the analyses (see online supplementary figure S1).

Supplemental material

Public involvement

Generation R discusses the strategy of the cohort study and the outcomes of the studies with the Municipality of Rotterdam on a regular basis; as the Municipality represents parents (and youth) in general. Moreover, participating parents and youth are regularly informed by newsletters regarding general outcomes of Generation R studies, and by a personal ‘passport’ with findings from the measurements for the participating family. Parents and youth are invited to comment on the outcomes at the website. At the individual level, the ‘passport’ and the individual results are discussed with the parents (and youth) by a physician, after the measurements on a certain day are finished.

Health Status Classification System—Preschool

The HSCS-PS is a parent-reported health status questionnaire applicable to children aged 2.5–5 years which consists of 10 mutually exclusive domains, based on the HUI.11 In addition, Saigal et al proposed two additional parent-reported single-item questions regarding ‘general health’ and ‘behaviour’, given the relatively high prevalence of general health and behaviour problems among the VLBW infants.29 30 The HSCS-PS was initially applied to approximately 80 children across Canada by paediatricians and neonatologists regarding the structured and qualitative feedback. After several rounds of refinements, the final version contains 10 domains each with 3–5 levels, and the two additional items. (see online supplementary table S1). The overall health status is described as a 10-element vector consisting of one level for each of the domains. In this study, to facilitate comparisons between groups, a total ‘disability score’ for the overall health state of a child was calculated as the sum of the level codes for the original domains. Therefore, the range of the disability score varied from 10 (no disability on any domain) to 41 (maximum disability on all 10 domains).16

Birth outcomes

In the present study, birth weight and gestational age at birth was obtained from medical records. LBW was defined as a birth weight less than 2500 g. To construct extreme groups, we further divided LBW into VLBW (<1500 g) and moderate LBW (1500–2500 g).31 Children were defined as preterm when they were born alive before 37 weeks of gestation. Preterm birth was further subdivided into very preterm (<32 weeks) and moderate to late preterm (32–37 weeks).32

Wheezing

Parent-reported frequency of wheezing in the past 12 months at age 3 years was assessed using core questions from the International Study of Asthma and Allergies in Childhood and classified as ‘no wheezing’, ‘1–3 episodes’ and ‘≥4 episodes’.33

ENT surgical procedures

At age 3 years, the parents were asked whether the child had undergone an ENT surgical procedure (ie, removal of the adenoids, removal of the tonsils and inserting tubes to aerate the middle ear).34 If at least one of these procedures was reported, the child was classified as ‘with ENT surgical procedure(s)’.

Behaviour problems

The presence of child behaviour problems was assessed at age 3 years by the CBCL parent questionnaire.35 A borderline cut-off score (83rd percentile of a Dutch norm group) of the CBCL total problem score was used to differentiate between children with and without behaviour problems in the borderline/clinical range.36

Other data

Socio-demographic characteristics were assessed by parent questionnaires, including marital status, educational level and ethnic background of the main caregiver, household income and child’s age when the questionnaire was completed. Child’s gender was obtained from medical records.

Statistical analyses

The scores of the HSCS-PS domains and the HSCS-PS disability score were treated as continuous variables. Statistical analyses were conducted in SPSS, V.21.0 for Windows (IBM).

Feasibility

Feasibility of the HSCS-PS was evaluated by assessing the response rate, percentage of missing answers, score distributions and the presence of floor/ceiling effects (ie, >50% of the respondents in the best/worst option).

Discriminant validity

We evaluated the ability of the HSCS-PS to discriminate between subgroups with and without LBW, preterm birth, wheezing, ENT surgical procedures and behaviour problems. Additionally, we calculated how many of these five conditions a child had (ie, whether a child had a LBW, was born preterm, is reported to have wheezing, to have had ENT surgical procedures, to have behaviour problems). This cumulative number of conditions was recoded into four categories: no condition, one condition, two conditions and three or more conditions. The ability of the HSCS-PS to discriminate between subgroups differing in the number of conditions was assessed.

Because of the non-normal distribution of HSCS-PS scores, Mann-Whitney non-parametric tests were used to assess differences in HSCS-PS scores between subgroups. Additionally, Cohen’s effect sizes (d) were calculated by dividing the difference in mean scores between subgroups by the largest SD, and interpreted as: 0.2≤d<0.5 small difference, 0.5≤d<0.8 moderate difference, d≥0.8 large difference.37 Significant differences were indicated at the level of p<0.05. We expected that the disability score would be higher in the subgroups in which the children were reported to have a ‘condition’ (preterm  birth, low birth weight, wheezing, ENT surgical procedure, or behavior problems) compared with the reference group without this condition. Additionally, we hypothesised that the disability score would be higher in the subgroups with a higher number of conditions, compared with the reference subgroup in which the children were reported to have none of the conditions.

Concurrent validity

In the absence of a ‘gold standard’ measure of HRQOL, as a first step to evaluate the concurrent validity of the 10-domains HSCS-PS, it was assessed whether specific HSCS-PS domains correlated better with their assumed ‘parallel’ single-item measures of ‘General health’ and/or ‘Behavior’ than with a ‘non-parallel’ measure. Considering the non-normal distribution of the data, Spearman rank correlation was applied. We calculated bootstrapped 95% CIs for Spearman correlation coefficients. When (a) the 95% CI is not ‘across 0’; and (b) the p value <0.05, the correlation coefficient was regarded as statistically significant. We hypothesised relatively high correlation coefficients between the following ‘parallel’ pairs of a HSCS-PS- domain/single-item parent-rated measure (in italics): ‘Pain and discomfort’/‘General health’; ‘Self-care’/‘Behavior’; ‘Emotion’/‘Behavior’; ‘Learning and remembering’/‘Behavior’; ‘Thinking and problem solving’/‘Behavior’; and we hypothesised the correlation coefficients for all other pairs to be lower.

Non-response analysis

Children with missing data on the HSCS-PS at age 3 years, including children whose parents did not complete the entire questionnaire (n=2748) were compared with children who did not have missing data on any HSCS-PS domain and thus were included in the analyses (n=4546).

Results

Of the respondents, 94.3% were mothers. Children’s mean age at the HSCS-PS questionnaire was 36.7 months (SD 1.5); 49.6% were boys; 5.2% of the children had a LBW (<2500 g); 6% of the children were born preterm (gestational age at birth <37 weeks); 12.7% had wheezing in the previous year; 11.5% had any previous ENT surgical procedure and 5.7% had parent-reported behaviour problems (see online supplementary table S2).

Non-response analysis

Significant differences were present in all characteristics, except for children’s age, gender and presence of ENT surgical procedures and wheezing. Excluded children relatively more often had single parents (p<0.001); parents with a low educational level (p<0.001); and more often a non-Dutch parent (p<0.001) (see online supplementary table S3).

Feasibility

The response rate of the questionnaire at 36 month after birth was 69%.28 Considering all questionnaires that were received at age 3 years (n=5014), there were on average 1.7% missing answers regarding the HSCS-PS items in the questionnaire; this was highest for ‘Vision’ (4.19%) and ‘Hearing’ (3.19%). Score distributions of the HSCS-PS domains and the total ‘disability score’ are presented in table 1. Floor effects were absent. Near to perfect scores (level 1=normal health/no impairment) were reported by >90.0% in 7 out of 10 domains; exceptions were ‘Speech’ (66.8%), ‘Self-care’ (89.4%) and ‘Pain and discomfort’ (88.5%). All HSCS-PS domains and the total ‘disability score’ showed a ceiling effect.

Table 1

Score distributions of the HSCS-PS domains in the population sample (n=4546)

Discriminant validity

Table 2 shows the ability of the total ‘disability score’ to discriminate between the subgroup of children born with a ‘VLBW’ (effect size 0.39; p<0.05) and ‘very preterm birth’ (0.42; p<0.01), and the ‘reference’ subgroup; the differences between the subgroups with ‘moderate LBW’(effect size 0.17; p≥0.05) and ‘moderate to late preterm’ (0.20; p<0.001) compared with the ‘reference’ subgroup were lower, as hypothesised. The domains ‘Learning and remembering’, ‘Self-care’ showed the largest discriminant validity regarding ‘VLBW’ (effect size 0.44; p<0.001) and ‘very preterm birth’ (0.42; p<0.001).

Table 2

Discriminative ability of the HSCS-PS between subgroups differing in birth outcomes: birth weight (n=4541) and gestational age at birth (n=4526)†

Table 3 shows the ability of the total ‘disability score’ to discriminate between the subgroup of children with ‘≥4 times wheezing in the previous year’ (effect size 0.27; p<0.01) and ‘at least 1 ENT surgical procedure’ (0.33; p<0.001) and CBCL ‘behaviour problems present’ (0.52; p<0.001), and the ‘reference’ subgroup, as hypothesised. In these three comparisons (table 4) the single ‘original domains’ that showed the largest discriminant validity were, respectively, ‘Pain and discomfort’ (effect size 0.31; p<0.001), ‘Pain and discomfort’ (0.35; p<0.001), ‘Self-care’ (0.40; p<0.001).

Table 3

Discriminative ability of the HSCS-PS between subgroups differing in: wheezing chest in the previous year (n=4407), ear-nose-throat (ENT) surgical procedures ever (n=4346), Child Behavior Checklist behaviour problem present in the last 2 months (n=4490)†

Table 4

Concurrent validity of the HSCS-PS assessed by Spearman correlations between original HSCS-PS domains and two additional domains (n=4546)†

The total ‘disability score’ discriminated clearly between the subgroup with a total of ‘≥3 conditions present’ (0.47; p<0.001), and the ‘reference’ subgroup, as hypothesised. The domain ‘Pain and discomfort’ (0.56; p<0.001) showed the largest discriminant validity (online supplementary table S4).

Concurrent validity

All five hypothesised correlation coefficients between the ‘parallel’ HSCS-PS-domains and ‘General health’/‘Behavior’ were positive (0.21, 0.17, 0.16, 0.16, 0.18, respectively; p<0.01). All 15 ‘non-hypothesised correlations’ were lower than the hypothesised correlations (see table 4).

Discussion

The present study evaluated the HSCS-PS among children at 3 years of age in a community setting using a large general population sample. The results support the feasibility, discriminant validity and concurrent validity of the HSCS-PS.

Feasibility

The HSCS-PS was well accepted by parents, as shown by the high response and relatively few missing answers. All levels of the potential answer categories were observed for 5 of the 10 domains in this community sample: ‘Speech’; ‘Mobility’; ‘Self-care’; ‘Emotion’; ‘Thinking and problem solving’. Yet, the study showed considerable ceiling effects, specifically regarding ‘Dexterity’ and ‘Emotion’. Such ceiling effects are a common phenomenon in community samples with a generally healthy population; they were also observed in studies with other HRQOL measures.6 10 However, they may limit the use of the instrument to detect changes and to describe health beyond the average. The domain ‘Speech’ showed the highest variation in the obtained scores, which may be related to the individual differences in the development of children’s speech skills.38

Discriminant validity

The results support the ability of HSCS-PS to discriminate across subgroups characterised by absence/presence of adverse perinatal conditions or distinct chronic or medical conditions. The total ‘disability score’ showed consistent differences between the subgroups with no adverse condition/situation (the reference subgroup), and subgroups with a ‘mild condition/situation’ (if present), and subgroups with a ‘severe condition/situation’, concerning six outcomes (birth weight; gestational age at birth; wheezing in the previous year; ENT surgical procedures; behaviour problem present in the last 2 months; total number of chronic/medical conditions), as hypothesised.

Regarding ‘VLBW’, the highest effect sizes were found in ‘Self-care’ and ‘Learning and remembering’. A similar pattern was observed regarding ‘very preterm birth’. Previous studies showed that perinatal adversity may be associated with neurodevelopmental disabilities that may cause cognitive impairment and attention problems during child development.39 The results of our study are also supported by Msall and Tremont who measured functional outcomes in self-care in infants with VLBW: of children with and without neurodevelopmental impairment, 41% and 13%, respectively, had self-care limitations.40

Regarding wheezing frequency, the highest effect sizes were found regarding ‘Pain and discomfort’ between children with at least four times of wheezing in the past year and children with no wheezing. This is in accordance with earlier reports that wheezing is associated with low HRQOL, especially in the domain of bodily pain.41 Similarly, regarding ENT surgical procedures, the highest effect size was found regarding ‘Pain and discomfort’, which is consistent with studies on pain after ENT procedures.42

Regarding behaviour problems, the highest effect sizes were found regarding ‘Self-care’. This is in line with the results of previous studies that documented the impact of behaviour problems on self-care.43

Concurrent validity

The finding that the five hypothesised correlations between the HSCS-PS domains and respective parallel single-item parent reports on ‘General health’/‘Behavior’ were higher than the 15 ‘non-hypothesised correlations’ supports the concurrent validity of the HSCS-PS. The strength of the five hypothesised correlations varied. It should be noted that 11 of the 15 ‘non-hypothesised correlations’ were statistically significant, although they were relatively small. The correlation between ‘Pain and discomfort’ and ‘General health’ was the highest which is consistent with previous studies; pain may play a major role in the rating of quality of life.44 The relatively strong correlation between HSCS-PS ‘Thinking and problem solving’ and ‘Behaviour’ is consistent with previous reports regarding associations between cognition deficits in children and behaviour problems.45 The observed associations to assess concurrent validity in this community sample are slightly lower than those that were found by Saigal et al who used selected clinical cohorts. This may be explained by the relatively low prevalence of serious impairments in a general population sample such as in our study.11

It should be noted that relatively little is known about the acceptance and validity of parent-report single-items to describe ‘General health’ and ‘Behavior/Mental health’ of children compared with the body of knowledge regarding the validity of such measures in adult populations.26 27 Therefore, in the future, we recommend the concurrent validity of the HSCS-PS should be evaluated by comparing it with an accepted ‘gold standard’ HRQOL measure such as the ITQOL.6 The evaluation of the concurrent validity of the 10-domains HSCS-PS in this study is a first step and results should be interpreted with caution.

Methodological considerations

First, in this study, measurements were primarily done using parent questionnaires, including accepted validated instruments such as the CBCL parent questionnaire.35 Only the birth outcomes were obtained from medical files. ‘Reporting tendency’ by, for example, ‘optimistic’ or ‘pessimistic’ parents may have applied to all measures in the questionnaires and may have induced relatively high statistical associations in this study. For future validation studies we recommend to use as many as possible ‘objective’ external measures to validate the 10-domains HSCS-PS.

Second, no formal power calculations were made with regard to the validation study, given multiple comparisons and studies of associations. However, the size of the population for analysis (n=4526) is relatively large for a validation study; therefore many associations, even with a small effect size, were statistically significant. The smallest subgroups regarding the evaluation of discriminative validity (birth weight <1500 g, n=28; gestational age <32 weeks, n=31) resulted in almost half of the comparisons being statistically significant. All other subgroups regarding the evaluation of discriminative validity ranged from n=104 up to n=4307.

Third, in our study, the non-participants were children from vulnerable families, who more often had single parent, and whose parents more often had lower educational level or had an immigrant background. These children may have more health conditions/problems than their counterparts from non-vulnerable families. This issue may impose an impact on results. For instance, the high ceiling effect may be caused by the relatively better health status of the participants. In addition, the generalisability of results in the present study may be limited due to this issue.

Fourth, while a utility-based scoring algorithm for HSCS-PS has not yet been developed, a total ‘disability score’ summing up the scores regarding each of the 10 original domains was applied in this study.16 Two previous studies supported the feasibility and validity of the HSCS-PS total ‘disability score’ in absence of a utility-based scoring algorithm, which we recommend to be developed in future studies.15 16 46 Given the relative paucity of experience with the HSCS-PS system, no specific guidelines for clinically important differences are available; we recommend such guidelines to be developed. Regarding the HUI for patients aged 4 years and above, it was proposed that a difference of one level within any domain may be interpreted as a clinically important difference.12 In our case, for example, the subgroup with CBCL ‘behaviour problems present’ and the subgroup with ‘≥3 chronic/medical conditions’ have both a mean total ‘disability score’ that is more than one point (one level) higher compared with the reference group, which may be interpreted as a clinically important difference. From a statistical point of view, we propose to apply Cohen’s effect size (d), and to interpret 0.50 (half an SD) as a meaningful difference. Effect sizes were relatively small in this study, which reflects that the general population in a society with modern and accessible healthcare is relatively healthy.37 47

Fifth, we would like to note that regarding the procedure of developing the HSCS-PS, items were mainly derived from the HUI system and additionally two new items were based on experts’ opinion. Qualitative studies, such as using focus group interviews have not been mentioned in this procedure; we recommend that qualitative research may be applied in the future, for example, to reduce the number of items, or to evaluate the content of the items.

Finally, in the present study, indicators of the reliability of the HSCS-PS, such as test–retest reliability were not evaluated. We recommend assessing this in future studies in the large varied community population.

Conclusion

This study is the first to apply and to evaluate the HSCS-PS in a large community sample of preschool children. This is a relevant addition to previous studies among VLBW children and children with cerebral palsy. For the assessment of the validity, we applied objectively measured conditions (birth weight, gestational age at birth) in addition to validated parent-reported outcome measures (CBCL). This study supports the feasibility and validity of the HSCS-PS among preschool children in community settings. We recommend developing utility-based scoring algorithms for the HSCS-PS, and conducting empirical studies of what changes are meaningful, as well as repeated studies of reliability and validity in large varied populations with objectively measured, external benchmarks. In the meantime, the HSCS-PS may be used by clinicians and researchers as parent-reported health outcome in addition to clinical outcomes for economic evaluations, and may be used to support the development of value-based healthcare regarding interventions for preschool children.

Acknowledgments

The Generation R Study was conducted by the Erasmus Medical Center, Rotterdam, the Netherlands, in close collaboration with the School of Law and Faculty of Social Sciences of the Erasmus University, Rotterdam; the Municipal Health Service, Rotterdam area; the Rotterdam Homecare Foundation; and the Stichting Trombosedienst & Artsenlaboratorium Rijnmond (STAR), Rotterdam. We gratefully acknowledge the contribution of general practitioners, hospitals, midwives and pharmacies in Rotterdam, and all of the women participating in the present study. We also acknowledge Henning W. Tiemeier who collected data of CBCL in the Generation R Study.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.

Footnotes

  • Contributors XF conceptualised and designed the study, carried out the analyses, interpreted the data, drafted the initial manuscript, critically reviewed and revised the manuscript. GB conceptualised and designed the study, carried out the analyses, interpreted the data, critically reviewed and revised the manuscript. DAW, DF and SS conceptualised and designed the study, interpreted the data, critically reviewed and revised the manuscript. SH and CJ interpreted the data, critically reviewed and revised the manuscript. LD and VWVJ aided in the collection of data, interpreted the data, critically reviewed and revised the manuscript. HR initiated the study, conceptualised and designed the study, collected the data, interpreted the data, and critically reviewed and revised the manuscript. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.

  • Funding XF is supported by a fellowship from the China Medical Board-Collaborating Program in Evidence-based Health Policy-making (grant number: CMB-CP14-190, https://www.chinamedicalboard.org/). GB is supported by a China Scholarship Council (CSC) PhD Fellowship for her PhD study in Erasmus MC, Rotterdam, the Netherlands. The scholarship file number is 201406010271, CSC URL: [http://www.csc.edu.cn/].

  • Competing interests None declared.

  • Patient consent Not required.

  • Ethics approval Medical Ethics Committee of the Erasmus University Medical Center, Rotterdam (MEC-2007-413).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement The data (actual SPPS data) on which our study is based are derived from a large birth cohort in Rotterdam (also known as the Generation R Study). Individual researchers do not have the right to distribute data from the Generation R Study. For the purpose of verification/validation/replication/meta-analyses, the external researcher can contact our data managers (Claudia J. Kruithof, c.kruithof@erasmusmc.nl or datamanagementgenr@erasmusmc.nl) and contact the Director Generation R, Vincent Jaddoe (v.jaddoe@erasmusmc.nl). Postal address: Generation R, Postbox 2040, 3000 CA Rotterdam, the Netherlands. Data will be made available via these contact persons after a written agreement about the use of the data has been made via the Technology Transfer Office of Erasmus MC.