Article Text

Download PDFPDF

Developing a core outcome set for infant colic for primary, secondary and tertiary care settings: a prospective study
  1. Nina F Steutel1,2,
  2. Marc A Benninga1,
  3. Miranda W Langendam2,
  4. Judith J Korterink1,
  5. Flavia Indrio3,
  6. Hania Szajewska4,
  7. Merit M Tabbers1
  1. 1Department of Paediatric Gastroenterology and Nutrition, Emma Children's Hospital, Academic Medical Centre, Amsterdam, The Netherlands
  2. 2Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Centre, Amsterdam, The Netherlands
  3. 3Department of Paediatrics, Giovanni XXIII Hospital, University of Bari, Bari, Italy
  4. 4Department of Paediatrics, The Medical University of Warsaw, Warsaw, Poland
  1. Correspondence to Nina F Steutel; n.f.steutel{at}amc.uva.nl

Abstract

Objective Infant colic (IC) is defined as recurrent and prolonged crying without an obvious cause or evidence of failure to thrive or illness. It is a common problem with a prevalence of 5%–25%. The unknown aetiology results in a wide variety in interventions and use of heterogeneous outcome measures across therapeutic trials. Our aim was to develop a core outcome set (COS) for IC to facilitate and improve evidence synthesis.

Design and setting Prospective study design; primary, secondary and tertiary care.

Methods The COS was developed using a modified Delphi technique. First, healthcare professionals (HCPs) and parents of infants with IC were asked to list up to five outcomes they considered relevant in the treatment of IC. Outcomes mentioned by >10% of participants were forwarded to a shortlist. In the second round, outcomes on this shortlist were rated and prioritised. The final COS was defined in a face-to-face expert meeting of paediatricians.

Results F of invited stakeholders (133 HCPs and 55 parents of infants with IC) completed both Delphi rounds. Duration of crying, family stress, sleeping time of infant, quality of life (of family), discomfort of infant and hospital admission/duration were rated as most important outcomes in IC, framing the final COS.

Conclusions The use of this COS should serve as a minimum of outcomes to be measured and reported. This will benefit evidence synthesis, by enhancing homogeneity of outcomes, and enable evaluation of success in therapeutic trials on IC. Researchers are strongly encouraged to use this COS when setting up a clinical trial in primary, secondary and/or tertiary care or performing a systematic review on IC.

  • Outcome measures
  • patientreported outcomes
  • core outcome set
  • paediatrics

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • Healthcare professionals and parents of infants with infant colic were involved in a modified Delphi procedure to ensure appropriate outcomes are measured.

  • Including stakeholders from around the globe increases the applicability of this core outcome set.

  • During the translation of the questionnaires and answers, subtle changes in questions or answers might have occurred and answers may have been misinterpreted.

Background

Infant colic (IC) is a common problem with an estimated prevalence of 5%–25%.1–4 Diagnostic criteria, formulated by the Rome IV committee, are recurrent and prolonged periods of crying without an obvious cause or evidence of failure to thrive or illness in infants younger than 5 months.5

Although IC is self-limiting, it may have negative short-term and/or long-term consequences. It has been postulated that, for example, a disturbed parent–infant interaction, child abuse, recurrent abdominal pain, migraine, allergy, hyperactivity and learning problems occur more often in children with (a history of) IC.6–13 In addition, IC is associated with the development of postpartum depression in mothers.14 15 Furthermore, IC can lead to feeding changes, medication use, paediatrician or emergency department visits, hospitalisation and loss of parental working days.4 16

Despite decades of research, the aetiology of IC remains unknown. Many theories exist, ranging from changes in the enteric nervous system, alterations in gut motility and microbiota, to different functioning of the central nervous system, allergy and early adverse life events.17 This diversity leads to a wide variety of interventions. Consequently, the unknown aetiology also leads to the use of heterogeneous outcome measures in trials of IC. Heterogeneity in defining and measuring outcomes impedes comparison of results between trials regarding the efficacy of an intervention.18

In several paediatric fields, such as asthma and acute diarrhoea, the Delphi technique was used to identify outcomes, relevant to both clinicians and parents, and instruments to measure these outcomes.19–21

Given the current lack of agreement on definitions and outcomes for IC, it is necessary to develop a core outcome set (COS).22 This need has been affirmed by the Rome IV committee.5A COS describes the agreed minimum set of outcomes that should be measured and reported in all trials in a specific area. They increase consistency across efficacy trials, maximising the potential for trials to be included in a meta-analysis. This will enhance consensus about the efficacy of an intervention. For example, Xu et al23 published a meta-analysis about the efficacy of probiotics for IC, including six randomised controlled trials (RCTs). They conclude that their study is limited by the heterogeneity of outcomes in the included trials and that their results should be interpreted with caution. Standardising the minimum amount of outcomes to be measured can reduce outcome heterogeneity and selective outcome reporting.

Furthermore, a COS enables comparison of trials and prevents healthcare professionals (HCPs) from overlooking important outcomes when treating patients with IC or when setting up a new trial or systematic review (SR) for IC. In addition, if stakeholders are involved in the development, a COS makes it more likely that appropriate outcomes are measured.24

The need to improve outcome measurement was first recognised by formation of the Outcome Measures in Rheumatology (OMERACT) initiative in 1992. This international network focuses on improving outcome measurement in rheumatology.25 The launch of the COMET (Core Outcome Measures in Effectiveness Trials) Initiative in January 2010 reinforced the need for the development of COS in other fields of medicine. The COMET Initiative aims to bring people together that are interested in the development of COS.24

In 2012, the Consensus Group on Outcome Measures Made in Pediatric Enteral Nutrition Clinical Trials (COMMENT) was established by the European Society for Paediatric Gastroenterology, Hepatology and Nutrition (ESPGHAN) for this purpose. Six working groups were established to develop a COS for clinical trials in different areas, including IC.21 26 In this article, we describe the development of a COS for infants with IC to enable evaluation of effectiveness in therapeutic trials of IC, in primary, secondary and tertiary care settings.

Methods

The project consists of four steps: preparation (step 1), identifying outcomes (step 2), development of a COS (step 3) and measurement of the COS (step 4). This article describes the second and third step, using the Core Outcome Set - STAndards for Reporting (COS-STAR) statement to benefit reporting (see Supplementary file).20 27

Registry entry

This study was not registered.

Ethical approval and consent to participate

The Medical Ethics Review Committee confirmed that the Medical Research Involving Human Subjects Act (Wet medisch-wetenschappelijk onderzoek met mensen, WMO) did not apply to this study, and therefore official approval by the committee was not required.

Data analysis

Descriptive statistics were used to summarise our results.

Step 1—Preparation: reporting outcome measures in trials of IC

This step consisted of identifying which outcomes related to IC were reported in (SRs of) therapeutic RCTs. The databases CENTRAL, Embase, and MEDLINE/PubMed were searched from inception to December 2012. English language SRs (of RCTs) and RCTs concerning IC in children aged 0–9 months were included. Reference lists of included SRs were searched for additional articles. This was published previously.18

Step 2—Identifying important treatment outcomes (HCPs and parents)

The first aim of this step was to identify which outcomes are used by HCPs when treating IC.

As the best strategy to select outcomes for clinical trials in paediatrics is unknown, we adhered to the methodology as defined by the COMMENT Working Group.21 28

We did not predefine a long list of outcomes based on the outcome measures mentioned, but instead invited HCPs visiting two international paediatric gastroenterology conferences in 2014 to participate in our survey. HCPs were eligible if they worked in primary, secondary and/or tertiary care and had experience with the treatment of infants with IC. We did not specify a priori which subgroup of HCPs had to be included. Participants were handed an English questionnaire on paper. They were asked to list up to five harmful and/or beneficial treatment outcomes for IC (definition was given), which they considered important and that guided their clinical decision-making. Separate questions were asked for the outpatient and inpatient settings because outcomes may differ between these settings (such as symptom severity or parental burden). Informed consent was assumed if an HCP completed the questionnaire. Data were collected on professional background and country of practice. This questionnaire was completed at the conference. Answers were processed anonymously. We did not perform a sample size calculation. On the basis of the study of Karas et al,21 we aimed to include at least 100 HCPs.

The second aim of this step was to assess which treatment outcomes were relevant to parents of infants with IC. We aimed to include a total of 50 parents,20 in five different countries (Croatia, Italy, Poland, Portugal and The Netherlands). Parents were eligible for inclusion if they consulted a healthcare professional because their infant was diagnosed with IC. They were randomly invited to participate by their infant’s doctor at the (general) paediatric outpatient clinic, representing primary, secondary and/or tertiary care. After oral informed consent, parents were asked to list up to five treatment outcomes for IC (definition was given) that made them feel their child was being treated adequately or made them feel comfortable. Because outcomes that make parents worry could differ, they were also asked to list up to five treatment outcomes that made them feel their child was being treated inadequately or made them feel uncomfortable. Demographic data were not collected. This questionnaire was completed at the outpatient clinic or by telephone. Answers were processed anonymously. The questionnaire was originally developed in English, but was provided to parents in their mother tongue. Answers were carefully translated back to English by the HCPs who invited the parents.

Step 3a—Creating a shortlist

First, listed outcomes were classified in domains. Domains functioned as subcategory to group outcome measures with similar characteristics. Domains were predefined based on our findings in step 1 (SR on outcomes18), supplemented with domains we considered to be relevant (such as ‘quality of life’ and ‘costs’) and domains that emerged from the respondents answers (such as ‘growth’ and ‘medication’).

Reported outcomes were combined when considered appropriate (by NFS and MMT). For example, ‘less (time) crying’, ‘duration of crying’, ‘crying’, ‘number of hours crying per day/week’, ‘number of days/week without crying >3 hours’, ‘patient with crying >3 hours/day’ and ‘reduced hours of crying per episode’ were combined into ‘duration of crying'.

After combining the answers, outcomes that were mentioned by >10% of participants were forwarded to the shortlist. The threshold of 10% was chosen by COMMENT to keep the shortlists manageable. A separate shortlist was created for every question: two for HCPs (outpatient and inpatient settings) and two for parents of infants with IC (adequately treated and inadequately treated).

Step 3b—Rating the outcomes on the shortlist

During the second phase of this step, the shortlists for HCPs were sent to HCPs that had agreed previously to take part in this phase. They were asked to rate the clinical relevance of outcomes on the shortlist on a scale of 0–4 (0 = not relevant, 4 = very relevant) and to prioritise these outcomes by selecting the five outcomes which they thought to be most important to guide their clinical decision-making.

Simultaneously, parents of infants with IC were invited to participate in this phase. Because IC resolves before the age of 5 months and answers were collected anonymously, a new group of parents was approached by their infant’s doctor at (general) paediatric outpatient clinics in five countries (Belgium, Croatia, Italy, Poland and The Netherlands). After oral informed consent, they received two shortlists: one with outcomes reported by parents to give them the feeling their child was treated adequately and one with outcomes reported by parents to give them the feeling their child was treated inadequately. We asked them to rank the outcomes on a scale of 0–4 (0 = does not make me feel my child is treated adequately /inadequately, 4 = makes me feel my child is treated adequately/inadequately) and to prioritise them by selecting the five outcomes that made them feel most as if their child was treated adequately/inadequately. Parents completed the questionnaire either at the outpatient clinic or by telephone. Answers were processed anonymously.

Step 3c—Creating preliminary outcome sets for HCPs and parents

In line with the COMMENT methodology,21 a top five was created for both groups: the five outcomes with the highest rank after rating and prioritising formed the separate preliminary outcome sets for HCPs and parents. Four preliminary outcome sets existed: two for HCPs (outpatient and inpatient settings) and two for parents (adequately treated and inadequately treated).

Step 3d—Creating the final set

After combining the four preliminary sets (see Results section), a draft COS was presented to an expert panel during the COMMENT Working Group meeting at the 48th annual ESPGHAN meeting in Amsterdam, The Netherlands (2015). Consensus was defined as a unanimous decision from the expert panel.

Results

Step 1—Preparation: reporting outcome measures in trials of IC

Our SR demonstrated a lack of agreement about definitions, primary outcome measures and instruments used in intervention trials on IC.18

Step 2—Identifying important treatment outcomes

Healthcare professionals

In total, 133/143 (93%) HCPs responded to the first questionnaire (see figure 1). They originated from 29 countries and included 63 paediatric gastroenterologists, 26 general paediatricians, 18 fellows, 8 researchers, 4 residents, 4 nutritionists, 4 others (1 intern and 3 not specified), 2 paediatric allergy specialists, 2 neonatologists and 2 general doctors (see figure 2A,B). For the outpatient setting, 50 different outcomes were reported; for the inpatient setting, 59 outcomes were reported (see tables 1 and 2).

Table 1

Outcome measures as reported by healthcare professionals for the outpatient setting (n=133) (six unclear outcomes, such as ‘cooperative’ and ‘eczema/atopy’, are not displayed)

Table 2

Outcome measures as reported by healthcare professionals for the inpatient setting (n=133) 

(four unclear outcomes, such as ‘easy-simple delivery’, are not displayed)

Figure 1

Flowdiagram of respondents. HCPs, healthcare professionals.

Figure 2

(A) Professional background of healthcare respondents (n=133). (B) Country of practice of healthcare respondents (n=133).

Parents

All 55 parents of infants with IC (as diagnosed by their doctor), originating from five different countries, completed the first questionnaire (see figure 1). In total, parents reported 39 treatment outcomes that made them feel their child was treated adequately and 29 treatment outcomes that made them feel their child was treated inadequately (see tables 3 and 4).

Table 3

Outcome measures that make parents feel their child was treated adequately (n=55)

Table 4

Outcome measures that make parents feel their child was treated inadequately (n=55)

Step 3—Creating a shortlist and final COS

Healthcare professionals

The shortlists that were developed based on outcomes reported in step 2 are displayed in table 5a. In total, 68/133 (51%) HCPs agreed to participate in this step. This group consisted of more paediatric gastroenterologists and general paediatricians (74%), compared with the group of non-respondents (53%). In the latter group, profession was not specified in 11% (vs 6% in the respondent group). In both groups, more than half of the HCPs was European (68% vs 56%, in the respondent and non-respondent groups, respectively).

Table 5A

Shortlist outcome measures healthcare professionals (rated and prioritised)

There were more HCPs from South America in the group of respondents (11%) compared with the group of non-respondents (2%). Fifty-four (79%) HCPs completed the second questionnaire which resulted in two preliminary outcome sets (outpatient and inpatient settings, see table 5b). After comparing these, outcomes for outpatient and inpatient settings turned out to be rather similar—therefore, we combined these preliminary outcome sets into one set, consisting of: ‘duration of crying’, ‘family stress’, ‘sleeping time of infant’, ‘quality of life (of family)’, ‘discomfort of infant’ and ‘hospital admission/duration’.

Table 5B

Preliminary outcome set healthcare professionals

Parents

The shortlists that were developed based on reported outcomes in step 2 are displayed in table 6a. In total, 43/50 parents of infants with IC (86%) completed the second questionnaire which resulted in two preliminary outcome sets (adequately treated and inadequately treated). The first preliminary outcome set (adequately treated, see table 6b) consisted of: ‘no or less crying’, ‘better infant sleep’, ‘no or less pain’, ‘comfortable/happy baby’ and ‘less irritable/nervous infant’. The second preliminary outcome set (inadequately treated, see table 6b) consisted of: ‘constant crying/cannot be soothed’, ‘sleeping problems of the infant’, ‘gastrointestinal symptoms’, ‘worsening of symptoms’ and ‘appearance of new symptoms’.

Table 6A

Shortlist outcome measures parents (rated and prioritised)

Table 6B

Preliminary core outcome sets parents

Creating the final COS

When we compared these preliminary outcome sets with the outcome set for HCPs, these appeared to be comparable as well (see tables 5 and 6), except for three outcomes: ‘worsening of symptoms’, ‘gastrointestinal symptoms’ and ‘appearance of new symptoms’. Therefore, we combined the outcomes mentioned by HCPs and parents into a draft COS: ‘duration of crying’, ‘family stress’, ‘sleeping time of infant’, ‘quality of life (of family)’, ‘discomfort of infant’, ‘hospital admission/ duration’, ‘worsening of symptoms’, ‘gastrointestinal symptoms’ and ‘appearance of new symptoms’.

This draft COS was thoroughly discussed at the consensus meeting of the COMMENT WG. The WG consisted of general paediatricians, neonatologists and paediatric gastroenterologists. The WG aimed to reach unanimity on each decision that was made. It was unanimously decided not to include ‘worsening of symptoms’, ‘gastrointestinal symptoms’ and ‘appearance of new symptoms’. In the case of IC, ‘worsening of symptoms’ refers to increased infant crying, which is already included as ‘crying duration’. ‘Gastrointestinal symptoms’ and ‘appearance of new symptoms’ were not included because these outcomes cannot, with certainty, be attributed to IC or the effect of treatment. For example, if an infant develops diarrhoea, it is likely that this has a different cause. In addition, ‘symptoms’ can be very broad and, therefore, multi-interpretable.

The final COS, therefore, consists of ‘duration of crying’, ‘family stress’, ‘sleeping time of infant’, ‘quality of life (of family)’, ‘discomfort of infant’ and ‘hospital admission/ duration’ (see table 7).

Table 7

Final core outcome set for infant colic

Discussion

Currently, COS are a hot topic in research. Given the heterogeneous outcomes used for IC, we aimed to develop a COS to solve this issue. Using a modified Delphi technique, both HCPs and parents of infants with IC were approached to identify relevant outcomes. Outcomes as mentioned by >10% of HCPs and parents turned out to be comparable.

One major strength of our study is the high response rate, which is comparable to, or even higher than, response rates in similar studies.20 29 About 188/198 (95%) invited HCPs and parents completed the first questionnaire. The second questionnaire was completed by 97/113 (86%) HCPs and parents. In total, 97/198 (49%) invited stakeholders completed both Delphi rounds. Another strength is that we included opinions of HCPs from around the globe. Europe was represented most frequently (58% of respondents from 17 countries), followed by Asia (16% of respondents from 5 countries). The input of different cultures increases the applicability of our COS. As stated in a recent SR, only 16% of studies included public representatives in the development of their COS. Because clinical trials are conducted to assess whether interventions are effective and safe for patients, it is crucial to include outcomes that are important to them.30 Given the potential impact IC has on a family, we included outcomes relevant to parents of infants with IC.14 15 31

This study has some limitations. First, the use of questionnaires poses us for several potential shortcomings. Because HCPs and parents were asked slightly different questions, this might explain some of the difference in answers. They were developed in English and thereafter translated. Since this was not done by a professional translator, it is possible that subtle changes in questions or answers arose. Furthermore, we may have misinterpreted answers, especially when we combined answers that were comparable in our opinion. Another potential limitation is the use of the 5-point Likert scale, for the rating of the importance of the outcome measures, instead of the 7- or 9-point Likert scale. The latter options would have improved nuance in the results. It has been stated, however, that respondents might not be able to differentiate properly between more than five potential answers.32

Second, we collected data from HCPs at two international paediatric gastroenterology conferences. This may have caused bias because they might be more focused on gastrointestinal causes for IC than other HCPs treating patients with IC. Including HCPs from for instance, the developmental field might have given a different perspective, although it should be emphasised that the outcomes in our COS are not related to gastrointestinal causes of IC. We did not decide a priori which subtypes of HCPs had to be included. It was only decided to include HCPs working in primary, secondary and/or tertiary care that had experience with treating infants with IC. The inclusion of specialist nurses or well child nurses might have been valuable as well, as they are part of the multidisciplinary team that parents encounter in some countries. However, infants with IC are often referred to general paediatricians or paediatric gastroenterologists, represented by 67% of respondents. Furthermore, in several participating countries, healthcare is organised in such a manner that paediatricians represent primary care as well (eg, Italy, France and Poland). Third, although we included respondents from around the globe, responses from Northern America (2%) and South East Asia (3%) were minimal. Fourth, it should be noted that some of the outcomes mentioned by parents were not included in the COS. In keeping with the methodology used by COMMENT,21 the consensus meeting consisted solely of HCPs. Due to logistic and financial reasons, we were unable to invite parents of infants with IC to this WG meeting. This WG unanimously decided that the occurrence of some outcomes, such as ‘appearance of new symptoms’, cannot, with certainty, be explained by IC or the effect of treatment. However, clinicians should pay attention to beliefs and worries of parents at all times.

‘Hospital admission/duration’ might seem a peculiar core outcome measure to some COS users. Occasionally, however, excessively crying infants may be admitted to hospital to unburden the crisis situation at home.33

Currently, the WG on IC has completed three out of four steps of the COS project. So far, we focused on which outcomes should be measured in trials on IC. In our next step, we will search for (validated) instruments to measure these outcomes. It should be noted that this COS should function as a ‘dynamic COS’. If our understanding of IC changes, the COS should evolve over time. Furthermore, since COS have the potential to improve evidence-based healthcare, we need to consider ways to implement this COS, so it will be available to relevant communities.24 Finally, to enable comparison of trial results, there is a need for homogeneity in outcomes and consensus on the definition of IC. Therefore, we recommend that the recently published and internationally accepted Rome IV criteria for IC should be used in future trials of IC.5

Clinical trials are only as credible as their endpoints.34 There is a need to develop COS for other common disorders such as functional constipation and gastro-oesophageal reflux disease as well.

Conclusion

The COS for IC consists of the following outcomes: duration of crying, family stress, sleeping time of infant, quality of life (of family), discomfort of infant and hospital admission/duration. It should serve as a minimum of outcomes to be measured and reported. This will facilitate and improve evidence synthesis, by enhancing homogeneity. Finally, it will enable the evaluation of effectiveness in therapeutic trials of IC. Therefore, we recommend researchers to use this COS when setting up a new clinical trial or performing an SR on IC.

Supplementary Material

Supplementary file

Acknowledgments

We thank all the healthcare professionals and parents of infants with infant colic for their valuable contributions.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.

Footnotes

  • Contributors NFS carried out the initial analyses, drafted the initial manuscript and approved the final manuscript as submitted.

    MWL contributed to data analysis, critically reviewed the manuscript and approved the final manuscript as submitted.

    JJK coordinated and supervised data collection, critically reviewed the manuscript and approved the final manuscript as submitted.

    MAB, FI, and HS conceptualized and designed the study, critically reviewed the manuscript and approved the final manuscript as submitted.

    MMT conceptualized and designed the study, contributed to data analysis, critically reviewed the manuscript and approved the final manuscript as submitted.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement All data generated or analysed during this study are included in this article and its supplementary information files.