Adding non-randomised studies to a Cochrane review brings complementary information for healthcare stakeholders: an augmented systematic review and meta-analysis

BMC Health Serv Res. 2016 Oct 21;16(1):598. doi: 10.1186/s12913-016-1816-5.

Abstract

Background: To reduce the burden of asthma, chronic disease management (CDM) programmes have been widely implemented and evaluated. Reviews including randomised controlled trials (RCTs) suggest that CDM programmes for asthma are effective. Other study designs are however often used for pragmatic reasons, but excluded from these reviews because of their design. We aimed to examine what complementary information could be retrieved from the addition of non-randomised studies to the studies included in a published Cochrane review on asthma CDM programmes, for healthcare stakeholders involved in the development, implementation, conduct or long-term sustainability of such programmes.

Methods: Extending a previously published Cochrane review, we performed a systematic review (augmented review) including any type of study designs instead of only those initially accepted by Cochrane and the Effective Practice and Organization of Care Review group. After double data selection and extraction, we compared study and intervention characteristics, assessed methodological quality and ran meta-analyses, by study design.

Results: We added 37 studies to the 20 studies included in the Cochrane review. The applicability of results was increased because of the larger variety of settings and asthma population considered. Also, adding non-randomised studies provided new evidence of improvements associated with CDM intervention (i.e. healthcare utilisation, days off work, use of action plan). Finally, evidence of CDM effectiveness in the added studies was consistent with the Cochrane review in terms of direction of effects.

Conclusions: The evidence of this augmented review is applicable to a broader set of patients and settings than those in the original Cochrane review. It also strengthens the message that CDM programmes have a beneficial effect on quality of life and disease severity, meaningful outcomes for the everyday life of patients with asthma. Despite the moderate to low methodological quality of all studies included, calling for caution in results interpretation and improvements in CDM evaluation methods and reporting, the inclusion of a broader set of study designs in systematic reviews of complex interventions, such as chronic disease management, is likely to be of high value and interest to patients, policymakers and other healthcare stakeholders.

Keywords: Asthma; Chronic disease management; Complex interventions; Meta-analysis; Study design; Systematic review.

Publication types

  • Meta-Analysis
  • Review
  • Systematic Review

MeSH terms

  • Absenteeism
  • Adult
  • Asthma / psychology
  • Asthma / therapy*
  • Chronic Disease
  • Clinical Trials as Topic
  • Disease Management
  • Female
  • Forced Expiratory Volume / physiology
  • Hospitalization / statistics & numerical data
  • Humans
  • Male
  • Medication Adherence
  • Patient Acceptance of Health Care / statistics & numerical data
  • Patient Satisfaction
  • Peak Expiratory Flow Rate / physiology
  • Quality of Life
  • Self Efficacy
  • Treatment Outcome