Article Text
Abstract
Objective This umbrella review summarises and critically appraises the evidence on the effects of regulated or high-volume perinatal care on outcome among very low birth weight/very preterm infants born in countries with neonatal mortality <5/1000 births.
Intervention/exposition Perinatal regionalisation, centralisation, case-volume.
Primary outcomes Death.
Secondary outcomes Disability, discomfort, disease, dissatisfaction.
Methods On 29 November 2019 a systematic search in MEDLINE and Embase was performed and supplemented by hand search. Relevant systematic reviews (SRs) were critically appraised with A MeaSurement Tool to Assess systematic Reviews 2.
Results The literature search revealed 508 hits and three SRs were included. Effects of perinatal regionalisation were assessed in three (34 studies) and case-volume in one SR (6 studies). Centralisation has not been evaluated. The included SRs reported effects on ‘death’ (eg, neonatal), ‘disability’ (eg, mental status), ‘discomfort’ (eg, maternal sensitivity) and ‘disease’ (eg, intraventricular haemorrhages). ‘Dissatisfactions’ were not reported. The critical appraisal showed a heterogeneous quality ranging from moderate to critically low. A pooled effect estimate was reported once and showed a significant favour of perinatal regionalisation in terms of neonatal mortality (OR 1.60, 95% CI 1.33–1.92). The qualitative evidence synthesis of the two SRs without pooled estimate suggests superiority of perinatal regionalisation in terms of different mortality and non-mortality outcomes. In one SR, contradictory results of lower neonatal mortality rates were reported in hospitals with higher birth volumes.
Conclusions Regionalised perinatal care seems to be a crucial care strategy to improve the survival of very low birth weight and preterm births. To overcome the low and critically low methodological quality and to consider additional clinical and patient-reported results that were not addressed by the SRs included, we recommend an updated SR. In the long term, an international, uniformly conceived and defined perinatal database could help to provide evidence-based recommendations on optimal strategies to regionalise perinatal care.
PROSPERO registration number CRD42018094835.
- health policy
- quality in health care
- risk management
- neonatal intensive & critical care
- paediatric intensive & critical care
- neonatology
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
- health policy
- quality in health care
- risk management
- neonatal intensive & critical care
- paediatric intensive & critical care
- neonatology
Strengths and limitations of this study
To our knowledge this is the first umbrella review to synthesise and critically appraise present systematic reviews with and without pooled estimate to the effects of perinatal regionalisation in very low birth weight or very preterm birth cohorts.
A systematic and comprehensive procedure was applied to find all published studies on this topic.
An a priori protocol was registered.
Evidence presented based solely on articles written in English or German.
Heterogeneous quality of included reviews limits valid conclusions in terms of effectiveness of perinatal regionalisation programmes.
Introduction
Preterm birth and/or low birth weight are among the leading causes for child and infant mortality across high-income and middle-income countries and the main reason of disability adjusted life years,1 despite of a decreased mortality due to very low birth weight (VLBW) or very preterm (VPT) birth in the past decades.2 Preterm birth and low birth weight infants represent a highly vulnerable group with serious risks for death or severe morbidities.3 Different interventions to improve the physical, psychological and social outcomes of low birth weight and preterm infants range from medical treatments (eg, caffeine), psychosocial interventions (eg, parental empowerment) to political requirements like perinatal regionalisation.4–6
The terms perinatal regionalisation and centralisation are often used interchangeably but both healthcare concepts have to be carefully distinguished. Perinatal regionalisation however, is a care strategy usually enforced by law. Centralisation is defined as a non-enforced concentration of care in well-experienced and equipped, usually large clinics.7 Depending on the case complexity, newborns are transferred to different levels of care, starting with basic care in well newborn nurseries, followed by special care nurseries and neonatal intensive care units that usually provide highest level of care.
The aim of perinatal regionalisation is to improve newborn and maternal outcomes based on a risk-appropriate and specialised care.8 The forms, mechanisms and intensity of perinatal regionalisation programmes can differ and range from financial incentives and hospital (coordination, legislative requirements), geographical or patient characteristics.9
In different countries (eg, Germany, Finland, Norway, USA), neonatal care is provided at different levels of care, with well-defined technical and personal requirements. Otherwise, the centre is not allowed to provide this complex care.10 11
Despite the potential benefit of perinatal regionalisation and minimal case-volume on perinatal and neonatal mortality and morbidity, there is still great controversy to implement these strategies. Opponents argue with potential difficulties (eg, in-utero transport) due to a subsequently reduced number of hospitals providing neonatal care.12
Thus, the present umbrella review aims to synthesise and critically appraise the current evidence concerning the association between both perinatal regionalisation, centralisation and case-volume on perinatal and postnatal death and morbidity to provide recommendations for healthcare regulations.
Methods
In addition to a synthesis and critical appraisal of the existing systematic reviews (SRs), a further objective was to identify research gaps regarding possible populations, interventions or outcomes in order to make recommendations for the need of an updated SR. This prospectively registered13 umbrella review was conducted and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline.14
Patient and public involvement
Since this is an SR and no patient-related primary data were collected, there was no involvement of patients or the public.
Inclusion and exclusion criteria
As presented in table 1, articles were included if they met our predefined inclusion criteria.15 Eligible articles were published as a systematic review or meta-analysis in English or German until 29 November 2019. To be defined as SR, the following contents had to be reported according to the PRISMA statement14:
A clear research question (details of the population, intervention and outcome).
A search strategy.
Study selection criteria.
Some form of a (critical) appraisal of the studies included. While tools for the critical appraisal of the methodological study quality help to identify and understand the strengths and weaknesses of a study, reporting guidelines define a minimum amount of information necessary to ensure a clear and transparent process in conducting the study.16
Furthermore, relevant SRs had to include studies of (national) healthcare settings with a neonatal mortality <5/1000 births according to the child mortality report of 2017 to be able to analyse a comparable study population.15
Literature search and study selection procedure
Based on a priori defined eligible criteria, a comprehensive search was conducted for relevant SRs in MEDLINE and Embase (via Ovid interface) published up to 29 November 2019 using different search terms like ‘very low birth weight’, ‘perinatal’, ‘neonatal’, ‘volume’, ‘size’ and ‘regionalisation’. The detailed search strategy is outlined in online supplemental file 1. The search strategy included a combination of free text words and database-specific subject headings (eg, infant mortality/Perinatal Care). For ‘systematic reviews’ the search strategy proposed by the Scottish Intercollegiate Guidelines Network (SIGN) were applied.17 Additionally, a manual search by screening reference lists of included and full-text-screened articles was performed to identify further potentially relevant reviews. Two authors (FW and AB) independently screened titles/abstracts and full texts for eligibility. Disagreements were resolved by discussion and, if needed, by consulting a third reviewer (SD).
Supplemental material
Data extraction
A predefined data extraction form in Excel was used including characteristics of the included reviews (eg, population/setting, number and types of included studies, definition of intervention) and outcomes (eg, label and definition) and study results (pooled estimate or descriptive). Data were extracted by one reviewer (FW) and verified by another reviewer (DBK) with discrepancies resolved by consensus between both reviewers.
Assessment of methodological quality of included reviews
The established instrument ‘A MeaSurement Tool to Assess systematic Reviews 2 (AMSTAR 2) guideline, V.2’ was used to assess the quality of the SRs. Due to the complexity of perinatal regionalisation as an intervention, we expected reviews that included both randomised and non-randomised study designs. Therefore ‘A MeaSurement Tool to Assess systematic Reviews 2 (AMSTAR 2) guideline, V.2’ facilitates the evaluation of reviews of both randomised and non-randomised study designs.
AMSTAR 2 contains 16 items which cover contents regarding transparent and prospectively registered inclusion criteria (items 1–3), search strategy (item 4), methods of study selection (items 5, 7), data extraction (item 6), quality appraisal (items 9, 13), reporting of study details and funding (items 8, 10), methods for quantitative synthesis (items 11, 12, 15) and funding (item 16). AMSTAR 2 focuses on ‘critical weaknesses’ and ‘critical flaws’ to provide a rating for overall confidence (‘high’, ‘moderate’, ‘low’, ‘critically low’) and is not intended to generate an overall score. Online supplemental file 2 contains detailed methodological explanations and definitions in the context of the application of the AMSTAR 2 checklist. Two reviewers (FW and DBK) conducted the quality assessment of included SRs independently. A third reviewer (SD) arbitrated discrepancies.
Data synthesis
Results and characteristics of included reviews were summarised in tabular format, organised according to intervention/exposition and outcomes.
Results
In total 508 records were identified and 3 SRs18–20 were included for this umbrella review (figure 1). During the full-text screening, four articles were excluded.21–24 One review lacked a reporting guideline or a quality appraisal of its included studies22 and three did not evaluate an intervention24 or evaluated irrelevant interventions like performance-based incentives21 or different therapy and emergency approaches.23
Objectives and characteristics of included SRs
The included SRs were published between 2010 and 2014 and included 43 publications encompassing 40 different studies, which cover a study period starting in 1979 and ending in 2008 with study types varying from controlled before–after studies, retrospective cohort studies to randomised controlled trials. As presented in table 2, the studies were conducted in the USA (27/40), different European countries (8/40), Canada (4/40) and USA/Europe (1/40). Every review included the assessment of neonatal mortality, which was defined solely in one SR as death within 28 days of life.20 One SR conducted a pooled estimate20 and two SRs reported results descriptively.18 19 A quality appraisal of the studies included was performed by two SRs using either the risk of bias assessment of the Cochrane’s Effective Practice and Organisation of Care group18 25 or an own quality assessment providing overall results of ‘insufficient’, ‘adequate’ and ‘high’ quality evidence without items applied.20 One SR reported the application of the reporting guideline of the Meta-analysis Of Observational Studies in Epidemiology study group26 without providing results.19
As illustrated in table 2 and more detailed in online supplemental file 3, all three SRs reported outcome-effects for perinatal regionalisation18–20 and one additionally reported size/volume-outcome relationships.19 The effects of perinatal centralisation were neither reported in any of the reviews nor conceptually distinguished from perinatal regionalisation. Rashidian et al descriptively summarised effects of perinatal regionalisation and focused on perinatal outcomes and process-outcomes of neonatal care in controlled or uncontrolled experimental or quasi-experimental study designs. The intervention, perinatal regionalisation, had to include ‘formal levels of care and a referral arrangement between hospitals in a specified region or territory’. These inclusion criteria were fulfilled by eight studies published between 1979 and 2007.18
Neogi et al descriptively summarised the effects of perinatal regionalisation programmes and other factors like unit size and case-volume on neonatal and perinatal mortality compared with standard care/small units in six studies published between 1983 and 2007. The volume-thresholds in the reported studies varied in terms of definition of the population (low-risk vs high risk) and thresholds (2000 annual births vs 3000 annual births). Perinatal regionalisation was evaluated in 17 studies and defined as a regionally coordinated and cooperative system in which maternal and perinatal care is designed according to the structural and procedural capabilities of the hospitals carrying it out.19 Due to lack of reporting, detailed results were only provided for 13 studies. The authors of this umbrella review additionally extracted the remaining four studies.27–30
Lasswell et al quantitatively analysed the effects of perinatal regionalisation and focused on neonatal mortality of liveborn VLBW (≤1.500 g) or VPT (≤32 weeks’ gestational age) neonates born after 1975. Lasswell et al defined perinatal regionalisation according to level-based system issued by the March of Dimes.20 The model ‘Improving the Outcome of Pregnancy’ starts with basic, uncomplicated care of healthy neonates/infants (level I) to care for ill infants in level II and care for serious complications (eg, VLBW) and illnesses around the birth in level III.31 Included study types were randomised controlled trials, case–control studies and prospective or retrospective cohort studies. Twelve studies met inclusion criteria for the meta-analysis and were published between 1982 and 2008.20
Given the slightly different inclusion criteria of the three SRs, there is minimal overlap of studies that were included in more than one review. As illustrated in figure 2, two studies were analysed for the outcome neonatal mortality in multiple reviews. Bode et al32 was included in all three18–20 and Cifuentes et al28 in two SRs.19 20
Effects of perinatal regionalisation and case-volume on neonatal and perinatal mortality and secondary outcomes
Table 3 summarises the effects of perinatal regionalisation and/or case-volume on neonatal and perinatal outcomes in the single study results (n/N) per SR.
Neonatal mortality
Rashidian et al reported on seven studies in which mortality decreased significantly (3/7) and non-significantly (4/7) after the implementation of perinatal regionalisation.18 Neogi et al reported that neonatal mortality of low and VLBW infants decreased significantly (4/10) and non-significantly (6/10) after perinatal regionalisation. For units with higher annual birth rates significantly (3/6) and non-significantly (3/6) lower neonatal mortality rates of VLBW and VPT infants were reported in comparison to units with smaller numbers of birth. Definition of ‘higher birth rates’ varied between 1000 and 3000 births per year in the different studies.19
Lasswell et al performed a pooled estimate (meta-analysis) and reported significantly decreased ORs in neonatal mortality for VLBW (OR 1.60 (95% CI: 1.33–1.92)), extremely low birth weight (OR 1.80 (95% CI: 1.31–2.46)) and VPT infants (OR 1.42 (95% CI: 1.06–1.88)) treated and born in highly equipped and well-staffed perinatal care centres.20
Perinatal mortality
Rashidian et al reported a non-significant/descriptive decrease of perinatal mortality in three studies after implementing perinatal regionalisation programmes.18
Other types of mortality
For other types of mortality (fetal/stillbirth, 1-year mortality, unspecified, outborn), both significant and non-significant reductions were reported in two SRs.18 19 In three studies results of fetal, outborn and unspecified infant mortality could not be interpreted due to a lack of provided values and multiple inter-group comparisons.19
Other clinical outcomes
After implementing perinatal regionalisation, the incidence of possible ‘disease’-outcomes and perinatal complications like intraventricular haemorrhage (1/1) and low 5-min Apgar Score (2/2) decreased significantly. The rate of low birth weight deliveries decreased either significantly (2/3) and non-significantly (1/3). Maternal sensitivity as a possible outcome of ‘discomfort’ increased significantly in one study. Motor development and mental status of the infant at an age of 1 year as a possible outcome of ‘disability’ improved non-significantly in one study.18 The secondary outcome ‘dissatisfaction’ has not been reported in any systematic review.
Critical appraisal
As shown in table 4, the quality of the included reviews appeared to be heterogeneous (more details can be found in online supplemental file 4). Complete or partial complete information for most of the AMSTAR 233 items has been considered by Rashidian et al (9/12, ‘moderate confidence’) and Lasswell et al (11/16 ‘low confidence’).18 20 Neogi et al lacked information concerning review methods in summary (3/12, ‘critically low confidence’).19 The majority of reviews did not provide complete Population, Intervention, Comparison, Outcome Study-based inclusion and exclusion criteria, a priori published protocols, justifications for exclusions of studies or provide transparent risk of bias assessments. The SR of Neogi et al unveiled inconsistencies in both the provided quality appraisals, extracted results and review methods. The lacking information in both the reporting quality of the included studies and five critical domains (items 2, 4, 7, 9, 13) led to two critical flaws and to a ‘critically low confidence’. The authors were contacted once about the inconsistencies described, but did not reply. The meta-analysis of Lasswell et al with a low confidence level included ‘adequate and high-quality’ studies without providing either detailed results or the instrument itself that was used for the quality appraisal.20 This led to a lack of understanding for the quality rating itself and the reasons why studies were included for or excluded from the pooled estimate. This critical flaw and the insufficient information in three critical domains (items 7, 9 and 11) led to a ‘low confidence’ rating.
Discussion
Main findings
Three SRs18–20 were included after the electronic and manual search of 508 titles and abstracts. These three reviews included 43 publications encompassing 40 different studies. Due to the slightly varying inclusion criteria of the included reviews, two studies were examined in several included reviews.28 32 As focused, the SRs mostly reported on neonatal mortality and different other mortality outcomes (eg, perinatal, infant, outborn). One SR reported results for different non-mortality outcomes like low birth weight or maternal sensitivity.18 Both the meta-analysis20 and the qualitatively summarised SRs18 19 showed that neonatal mortality and other mortality outcomes decreased in the course of perinatal regionalisation and higher case-volumes. In addition, one review reported benefits associated with perinatal regionalisation for the outcomes intraventricular haemorrhage, low 5-minute Apgar score, low birth weight and maternal sensitivity.18
The methodological quality appeared to be heterogeneous between the three SRs with moderate, low and critically low confidence. This means that two out of three SRs did not meet the methodological criteria to give an accurate and careful umbrella review of the evidence presented. In particular, the non-transparent reporting on the results of the quality assessment limits traceability to such an extent that the results of one SR with20 and one SR without a pooled estimate19 do not appear trustworthy. Since the reviews’ publication date (2010–2014), more studies were published recently, showing the continuous importance of this topic for both research and perinatal care. Results of several studies indicate that perinatal regionalisation, avoidance of postnatal transfer and particularly high-volume care led to decreased mortality and morbidity outcomes of (very) low birth weight and preterm births.34–36 The results for (very) low birth weight and (very) preterm birth led to the question whether regionalisation/case-volume could improve the outcome of low-risk births as well. The impact of case-volume and/or perinatal regionalisation on neonatal and/or maternal outcomes after healthy pregnancy is in the focus of current research but shows inconsistent results.37–39 Therefore, an updated SR seems to be necessary to overcome the methodological limitations in already published SRs and to include additional clinical and patient-reported outcomes.
In addition, an assessment of regionalisation or volume effects must take into account both the national individual design of healthcare (eg, neonatal transport) and methodological differences in study design (eg, different definitions of neonatal mortality).40–42 Additionally, a specific international perinatal database (eg, European Union) could help to describe homogeneous settings, study populations, outcomes and care-volumes for low-risk as well as high-risk births.
Strengths and limitations
One strength of this umbrella review is the clear and replicable method used to select appropriate SRs to answer the research question. In addition to the comprehensive search strategy, screenings of reference lists and citations of potentially relevant SRs were performed to capture all available evidence. Two independent reviewers performed screening of potentially relevant SRs, data extraction and critical appraisal by using a standardised checklist of all SRs included.33
However, the global approach of an umbrella review leads to methodological weaknesses.43 The analysis relied on information that were given in the included SRs. Given the results of our critical appraisal of all three reviews, the presented evidence synthesis of this umbrella review suffers from heterogeneous reporting and low respectively critically low methodological quality in two SRs. For example, in the meta-analysis of Lasswell et al,20 it was not possible to understand the study selection for the pooled estimate. Neither the (self-conceptualised) quality rating and its validity nor detailed results per study were illustrated. In consequence, we do not know if the pooled evidence has the ‘high quality’ as reported by Lasswell et al.20
It has to be taken into consideration that perinatal regionalisation programmes are designed differently with basic similarities (level-based care) and heterogeneous additional mechanisms (eg, financial incentives).9 Neither the included SRs broadly described the interventions with detailed frameworks, structures and requirements nor did they distinguish perinatal regionalisation and perinatal centralisation. In the SR of Neogi et al different volume-thresholds of ‘large’ and ‘small’ hospitals were described, which is strongly limiting comparability. Additionally, the included studies cover a time span of 29 years in which the setting and the birth care changed fundamentally.
Implications for policy and research
The three included reviews analysed primarily data on neonatal mortality and reported an improved survival due to perinatal regionalisation/high case-volume care of VLBW and VPT infants. Whereas the available evidence favours perinatal regionalisation programmes and high-volume settings, an updated meta-analysis of recent studies would help to overcome the questionable quality of two SRs and would provide data on additional clinical and patient-reported outcomes. In a long-term perspective, the development and implementation of a specific international perinatal database that consider both care and patient context with the goal to overcome differences in the definition of thresholds, population and outcomes would help to establish a sustainable comparability between results of future studies and local policies of perinatal care.
References
Footnotes
JS and SD contributed equally.
Contributors FW designed the concept of this umbrella review; performed the literature search, screening, data extraction and quality appraisal; and prepared and revised the first draft. DBK performed data extraction and quality appraisal, and revised the first draft. AB performed screening and revised the first draft. MR revised the first draft. JM designed the concept of this umbrella review and revised the first draft. JS designed the concept of this umbrella review and revised the first draft. SD designed the concept of this umbrella review; performed screening and quality appraisal; and performed and revised the first draft.
Funding This umbrella review was funded by a German statutory health insurance (AOK) [no grant number given]. Open Access Funding by the Publication Fund of the TU Dresden.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement All data relevant to the review are included in the article or uploaded as supplemental information.