You are here

  • Home
  • Archive
  • Volume 8, Issue 8
  • Systematic review to identify proxy indicators to quantify the impact of eHealth tools on maternal and neonatal health outcomes in low-income and middle-income countries including Delphi consensus

Article Text

Article menu

Download PDFPDF

XML
Global health
Research
Systematic review to identify proxy indicators to quantify the impact of eHealth tools on maternal and neonatal health outcomes in low-income and middle-income countries including Delphi consensus
  1. Caroline Perrin,
  2. Lothaire Hounga,
  3. Antoine Geissbuhler
  1. Department of Radiology and Medical Informatics, Faculty of Medicine, University of Geneva, Geneva, Switzerland
  1. Correspondence to Caroline Perrin; caroline.perrin{at}hcuge.ch

Abstract

Objective To identify interventions that could serve as reliable proxy indicators to measure eHealth impact on maternal and neonatal outcomes.

Design Systematic review and Delphi study.

Methods We searched PubMed, Embase and Cochrane from January 1990 to May 2016 for studies and reviews that evaluated interventions aimed at improving maternal/neonatal health and reducing mortality. Interventions that are not low-income and middle-income context appropriate and that cannot currently be diagnosed, managed or impacted by eHealth (eg, via telemedicine distance diagnostic or e-learning) were excluded. We used the Cochrane risk of bias, Risk Of Bias In Non- randomised Studies - of Interventions and ROBIS tool to assess the risk of bias. A three-step modified Delphi method was added to identify additional proxy indicators and prioritise the results, involving a panel of 13 experts from different regions, representing obstetricians and neonatologists.

Results We included 44 studies and reviews, identifying 40 potential proxy indicators with a positive impact on maternal/neonatal outcomes. The Delphi experts completed and prioritised these, resulting in a list of 77 potential proxy indicators.

Conclusions The proxy indicators propose relevant outcome measures to evaluate if eHealth tools directly affect maternal/neonatal outcomes. Some proxy indicators require mapping to the local context, practices and available resources. The local mapping facilitates the utilisation of the proxy indicators in various contexts while allowing the systematic collection of data from different projects and programmes. Based on the mapping, the same proxy indicator can be used for different contexts, allowing it to measure what is locally and temporally relevant, making the proxy indicator sustainable.

PROSPERO registration number CRD42015027351.

  • information technology
  • telemedicine
  • maternal medicine
  • neonatology
  • health informatics

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

https://doi.org/10.1136/bmjopen-2018-022262

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • Limitation: some potential proxy indicators may not have been identified in the systematic review for two possible reasons: (1) due to, for example, a very low GRADE quality, as for some interventions based on ethical reasons, it is not possible to conduct high-quality randomised studies, or (2) no studies have investigated these as they are standard of care. They may also have been overlooked as unforeseen, for example, disruptive uses of eHealth may emerge and offer unexpected ways to improve practices.

    • Strength: to address the limitation of potentially overlooked proxy indicators, the results were assessed and completed in a Delphi consensus process with a group of international experts.

    • Strength: a review of this kind, aiming at identifying proxy indicators that could be used to measure the impact of eHealth interventions on maternal and neonatal health outcomes, particularly in low-income and middle-income countries has not yet been conducted.

    Introduction  

    Since 1990, maternal and child mortality have approximately halved; however, most of the remaining deaths are preventable.1 Child mortality decreased disproportionately for older children, and neonatal deaths account now for 45% of under-5 mortality.2 Uneven progress between countries and within countries, with prorich and prourban inequalities, leaves women and children in rural areas with insufficient access to quality health care services.1

    Information and communication technologies (ICTs) can provide innovative approaches for alleviating these inequalities, particularly in rural and isolated settings. They do so by overcoming geographical barriers, increasing access to healthcare services, providing continuing education and enabling collaborative healthcare in remote locations.3–13 The WHO defines electronic health (eHealth) as the cost-effective and secure use of ICTs for health and health-related fields.14 The potential of eHealth on positive therapeutic and clinical outcomes has been repeatedly postulated, but strong evidence is scarce. Although scientific literature offers an increasing number of publications studying the impact of eHealth tools on the quality, safety and cost-effectiveness of health care , there is still a significant gap between the postulated and empirically demonstrated benefits, including therapeutic and clinical outcomes.15–20 It is essential to devote more effort to evaluation and to ensure that the methodology adopted is multidisciplinary and thus capable of disentangling the often complex web of factors that may influence the results. It is equally important that existing activities are subject to rigorous, multidisciplinary and independent assessment. Even though low-cost telemedicine applications have proven to be feasible, clinically useful, sustainable and scalable, they are not being adopted on a significant scale due to a variety of barriers, including the absence of robust and general supportive scientific evidence of their impact.15–17 21 22

    The need for evaluating eHealth impact on patient outcomes has been strongly emphasised.19 20 22–28 The main barrier remains in the limited identification of measurable and reliable indicators.29 The relevance of these indicators may be context dependent and their extrapolation considerably restricted. Availability of outcome indicators (direct and proxy) will facilitate consistent outcome measurements and comparability of studies.29

    Health outcomes research established as a mean to evaluate the effectiveness of healthcare interventions and an approach to inform resource allocation.30 31 Obstacles for the outcomes evaluation of eHealth tools include the absence of methodologies and indicators.29 The identification of indicators is complex as the timespan between intervention and potential outcome (reduction in maternal/neonatal mortality) is long. Due to this duration, the outcome might be influenced by various confounding factors, and it is difficult to attribute the outcome to the eHealth intervention. The use of proxy indicators helps addressing this issue by measuring changes closer to the intervention.

    The objective of this review is to identify proxy indicators that can be used in future studies aiming at measuring the impact of eHealth interventions on maternal/neonatal health outcomes in low-income and middle-income countries (LMICs). The review question is: which interventions that can be impacted by eHealth applications have results that can be clearly linked to maternal and neonatal health outcomes in LMIC countries and could therefore serve as reliable proxy indicators?

    Methods

    The review was conducted and reported in line with the standards of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.32 The review protocol is registered in PROSPERO; the detailed description can be accessed on the platform.33 In short, the review identified interventions, which have an alleged impact on maternal/neonatal health, and are suitable for delivery in LMICs to serve as proxy indicators. In this article, previous reviews are included according to the recommendations for integrating existing systematic reviews into new reviews by Robinson et al.34

    Searching

    To identify studies and reviews that evaluated the effect of interventions on maternal and neonatal health, a comprehensive search of PubMed, Embase and the Cochrane Library was carried out using a combination of text words and controlled vocabulary terms related to the interventions and possible outcome measures. The search strategy was adapted for each database. Studies with an abstract published in English from 1990 to May 2016 were considered for inclusion. The third phase consisted of searching databases of multilateral organisations and Google Scholar.

    Inclusion/exclusion criteria

    Randomised controlled trials, quasiexperimental studies, observational studies, systematic reviews and intergovernmental and non-governmental agency reports were considered for this review.

    Population: pregnant women at any gestation age, postpartum women up to 6 weeks after giving birth and neonates (up to 28 days after birth).

    Intervention

    We included any intervention at health system level aiming at improving maternal/neonatal health and reducing maternal/neonatal mortality.

    Type of outcome measures: neonatal outcomes (eg, neonatal mortality, stillbirth, low birth weight and preterm birth) and maternal outcomes (eg, maternal mortality, pre-eclampsia and gestational hypertension).

    Studies were excluded if they were not LMIC context appropriate or if the interventions cannot currently be diagnosed, managed or impacted by eHealth interventions, such as telemedicine distance diagnostics or e-learning, as well as qualitative studies and opinion pieces.

    Study selection

    One author conducted an initial screening to exclude articles whose titles were obviously irrelevant. Subsequently, two reviewers independently rated titles and abstracts based on relevance to the study objectives. The third reviewer resolved discrepancies in the rating. All studies that were rated potentially relevant or definitely relevant underwent full-text review. For each included study, the authors verified that these were not comprised in the included systematic reviews and if so they were excluded. Figure 1 summarises the study selection.

    Figure 1
    Figure 1

    Flow chart of study selection for inclusion in the systematic review. LMIC, low-income and middle-income country.

    Data abstraction, quality assessment and data synthesis and analysis

    Study design, setting, study population characteristics, description of the intervention, outcomes measured and effects of studies, which were assessed as eligible, were abstracted by one author into a standardised spreadsheet and were thoroughly checked by the second reviewer. Disagreements were resolved by discussion and, if necessary, by arbitration involving the third reviewer. The risk of bias was assessed for all included studies and reviews. Randomised trials were assessed with the Cochrane risk of bias, non-randomised studies with the Cochrane Risk Of Bias In Non-randomised Studies - of Interventions and systematic reviews with the ROBIS (tool to assess risk of bias in systematic reviews) tool.35–37 The level of evidence of studies and reviews that met the inclusion criteria were summarised by outcome (proxy indicators) including a quality assessment in a tabular form. For each proxy indicator, the summary of findings (SOFs) table includes the number of studies, a summary of the intervention effect and a measure of the quality of evidence for each outcome according to GRADE.38–40 Existing GRADE assessments of systematic reviews have been included after verification and are marked with an asterisk (*) in the SOF table.

    Delphi consensus

    A three-step modified Delphi method was used to add additional proxy indicators and to establish consensus on the interventions’ (proxy indicators) potential to reduce morbidity and mortality, if they should be considered an ’essential' intervention, and the appropriate level of care.

    Thirteen international experts, with backgrounds in obstetrics and neonatal care, from different regions were approached. All of them agreed to participate and all completed the three rounds.

    In round 1, the experts added potential proxy indicators to the provisional list (table 1). Some proxy indicators may have been missed in the systematic review due to for example, very low GRADE quality, as some interventions could not be conducted as randomised studies for ethical reasons.

    View this table:
    Table 1

    Summary of findings table

    View this table:
    View this table:
    View this table:

    In round 2, the completed list of indicators was circulated to the experts and they were asked to assess each, as proxy-indicator identified intervention according to (1) their potential to reduce maternal and neonatal morbidity and mortality, (2) whether they should be considered an ‘essential’ intervention and (3) the appropriate level of care (primary, referral or both). An essential intervention was defined as an essential medical intervention, or ‘signal function’, that treat the major causes of maternal/neonatal morbidity and mortality and that should be prioritised. Primary level care was defined as care provided by a nurse, family physician or other type of health worker. For example, a rural health centre in Africa would be considered as primary level. Referral level care was defined as care provided in hospitals in general (district or referral); the health care providers at this level are professionals.

    The rankings were summarised using the median and the IQR and included in a repeat version of the questionnaire.

    In round 3, the experts reranked their agreement with each statement, with the opportunity to change their score in view of the group’s response. The rerankings were summarised and assessed for degree of consensus using IQRs for continuous numerical scales and were accepted when the IQR was 2 or less.

    The results of the Delphi consensus are summarised in table 2 and are rated as low (+) if the median was between 0– and 3, medium (++) if the median was between 4 and 6 and high (+++) if the median was between 7 and 9.

    Patient involvement

    Patients were not involved in setting the research question, the outcome measures, the design or the implementation of the study. No patients were asked to advise on interpretation or writing up of results. No patients were advised on dissemination of the present study and its main results.

    Results of the systematic review

    Our initial search identified 1725 publications, 44 additional records were identified through hand searching. The title and abstract scan resulted in 141 publications that underwent full-text review. Forty-four articles met our selection criteria after the full-text review. The results of the review are 40 potential proxy indicators that are summarised in the SOF table (table 1).

    Preconception

    The preconception interventions reviewed included birth spacing and micronutrient supplementation.

    Higher risk for preterm birth and low birth weight (LBW) are associated to short interpregnancy intervals (IPIs) (less than 6 months) as well as long IPIs (60 months or more after birth), compared with an IPI of 18–23 months.41

    Folic acid supplementation and fortification are effective in reducing neonatal mortality.42

    Pregnancy

    The antenatal interventions reviewed included micronutrient and diet supplementation, maternal immunisation, screening and management of infections (syphilis, HIV/AIDS and malaria), prevention and management of pregnancy-induced disorders (notably arterial hypertension), management of prelabour rupture of membranes and preterm labour, drug misuse and management of unintended pregnancy.

    Multiple micronutrient supplementation (iron and folic acid) is improving birth outcomes.43 For women with a history of a baby with neural tube defect, folic acid reduces the recurrence by 70%.44

    LBW is a major contributor to neonatal mortality and over 95% of LBW babies are born in LMIC countries.45 While there has been controversy about whether dietary supplementation (eg, high energy biscuits for chronically undernourished women) in pregnancy can increase birth weight,46–49 the 5-year prospective randomised controlled trial in 28 rural Gambian villages by Ceesay et al 50 concludes that supplementation significantly reduces perinatal mortality in at-risk mothers.

    Major progress has been achieved for neonatal tetanus, but it remains a significant preventable cause of neonatal mortality globally.2Immunisation of pregnant women or women of reproductive age with at least two doses of tetanus toxoid is estimated to reduce mortality from neonatal tetanus by 94%.51

    Infection is a well-acknowledged cause of stillbirth and accounts for an estimated half of all stillbirth, particularly in LMICs.52 Syphilis screening and treatment with penicillin reduces syphilis-related stillbirth by 82% and syphilis-specific neonatal death by 80%.53 The effect in all studies was large, and there is a clear biological mechanism, but as only few of the included studies were adjusted for potential confounding factors, quality of the evidence was graded as low.53 54

    Intermittent preventive treatment of malaria in pregnancy is a routine drug administration to prevent malaria and its consequences in pregnant women in areas of moderate to high malaria transmission. Routine chemoprevention for malaria and its consequences have been extensively tested in RCTs, with clinically important benefits on anaemia and parasitaemia in the mother55 and reduced neonatal mortality.51

    The majority of HIV-infected children acquired their infections as a result of mother-to-child transmission during pregnancy, labour or breast feeding. In areas with lower health services infrastructure, infections may stay undetected, which is problematic as early diagnosis and treatment demonstrated improved clinical outcomes.56 57 About 50% of people living with HIV are unaware of their diagnosis.58 59 Reliable point-of-care HIV diagnostic tests, administering antiretroviral drugs to the HIV-infected mother and/or to her child during pregnancy, labour or breast feeding and adherence to antiretroviral medication are essential to prevent vertical transmission.60–62

    Preterm birth is a major contributor to perinatal mortality and morbidity. Calcium channel blockers for women in preterm labour have benefits over placebo or no treatment in terms of postponement of birth and were shown to have benefits over beta-mimetics with respect to prolongation of pregnancy, serious neonatal morbidity and maternal adverse effects.63 Corticosteroid therapy used to accelerate foetal lung maturation for women at risk of preterm birth is relatively inexpensive and feasible to implement at primary level in an LMIC context if skilled health care providers are available to identify women at risk of preterm birth and administer intramuscular injections.64 65

    Gestational hypertensive diseases, including pregnancy-induced hypertension, pre-eclampsia and eclampsia are leading causes of maternal and infant morbidity and mortality.66 Early detection is crucial for monitoring and prevention. Pre-eclampsia is related to a lack of placental invasion, and its complications on the pregnancy can be detected by ultrasound.67–69 Gestational calcium supplementation is associated with a reduction in hypertensive disorders in pregnancy, especially for women with a low calcium intake70–72 and reduces gestational hypertension, severe pre-eclampsia and pre-eclampsia.70 73 Administration of antiplatelets (eg, low-dose aspirin) to pregnant women at high risk of pre-eclampsia or those with gestational hypertension prevents pre-eclampsia.44 74 Magnesium sulfate is one of the most effective anticonvulsant to protect women from severe pre-eclampsia and eclampsia and, if administered timely, reduces the risk of seizure repetition and reduces case fatality rate of severe pre-eclampsia and eclampsia.75–77 Magnesium sulfate more than halves the risk of eclampsia.78 79 For women who received a magnesium sulfate injection before referral, case fatality rate of severe pre-eclampsia and eclampsia was reduced by 79%.80 Even though the effect was strong, due to a small sample size, the evidence was graded low. WHO recommends that magnesium sulfate is administered to women with severe pre-eclampsia before they are transferred to a secondary or tertiary level facility.81

    A combination of contraceptive promoting and educational interventions reduce unintended pregnancy, while only contraceptive-promoting interventions showed little or no difference in the risk of unintended first pregnancy (RR 1.01, 95% CI (0.81 to 1.26)).82

    Medical abortion uses drugs (mifepristone and misoprostol) to terminate a pregnancy and is an important alternative to surgical methods of pregnancy termination, especially in areas where access to surgical termination is not available.83 84

    Childbirth

    Interventions during and close to childbirth include clean birth and postnatal practices, the management of postpartum haemorrhage and preventive uterotonic drugs in the absence of active management of labour.

    Clean birth practices include: hand washing, clean perineum, clean birth surface, cutting of the umbilical cord using a clean implement and clean cord tying.85 Clean postnatal practices include: chlorhexidine, other antimicrobial applications to the cord, avoidance of harmful cord applications, skin applications and emollients and hand washing.85 These are estimated to reduce neonatal mortality in a facility and home setting. Even though the evidence quality is low or very low, as there is strong biological plausibility, the GRADE recommendation for these practices is strong.51 85

    Active management of third stage of labour (AMTSL) is a package of three components or steps: (1) administration of an uterotonic, preferably oxytocin, immediately after birth of the baby; (2) controlled cord traction to deliver the placenta, if skilled birth attendants are available86 87; and (3) massage of the uterine fundus after the placenta is delivered, with administration of an uterotonic as most important part.87 88 In the absence of AMTSL, a preventive uterotonic drug (oxytocin or misoprostol) should be administered by a health worker trained in its use for prevention of preventing postpartum haemorrhage (PPH).87 89 If both oxytocin and misoprostol are available, oxytocin is the preferred first-line treatment.87 89 Oral or sublingual misoprostol compared with placebo is effective in reducing severe and is a suitable first-line treatment alternative for PPH in settings where the use of oxytocin is not feasible.89 90

    Uterine balloon tamponade is a relatively simple approach and demonstrated to be an effective technique to treat PPH in developed countries but is underused in LMICs due to the high cost of the balloon. A sterile rubber catheter fitted with a condom was developed as innovative low cost alternative in Bangladesh in 2001.91 Three studies suggest that condom catheter uterine balloon tamponade (C-UBT) is simple to use, inexpensive, safe and may be used by any healthcare provider involved in delivery for controlling massive PPH.92–94

    Neonatal care

    Interventions for all neonates include hygienic care, prevention of hypothermia, support for immediate breast feeding and prophylactic vitamin K.

    Early skin-to-skin contact benefits breastfeeding outcomes at 0–4 months postbirth,95 while early initiation of breast feeding lowers all-cause neonatal mortality among live birth.96 Exclusive breast feeding reduces the risk of neonatal mortality compared with partial breast feeding.97

    Thermal care (immediate drying, warming, skin to skin and delayed bathing) of neonates prevents hypothermia.44 Bathing in warm water 1 hour after delivery is associated with a significant increase in hypothermia in both measurement methods, rectal and tympanic.98

    Neonatal chlorhexidine cord care reduces the incidence of omphalitis and neonatal mortality.99

    A single dose of 1 mg of intramuscular vitamin K after birth is effective in the prevention of classic haemorrhagic disease of the neonate.100

    Interventions for small and ill neonates include neonatal resuscitation and immediate assessment, prevention of hypothermia and danger signs predicting severe neonatal illness to be assessed during postnatal contacts.

    Every year, an estimated 10 million babies require assistance to initiate breathing. Basic neonatal care (warming, drying, stimulation and resuscitation including bag-and-mask ventilation) would be sufficient to save most babies in need of resuscitation in low-resource settings.101 Training of neonatal resuscitation in facilities could reduce 30% of intrapartum-related mortality RR 0.70, 95% CI (0.59 to 0.84) and 38% of early neonatal mortality.102 The coverage of this intervention remains low in countries where most neonatal deaths occur, which presents a missed opportunity to save lives.102

    Kangaroo mother care (KMC), among other benefits, reduces neonatal mortality.103 KMC in LBW infants is an alternative to conventional neonatal care.

    The Young Infants Clinical Signs Study Group developed a single simple algorithm that can identify severe illness in infants aged 0–2 months who are brought to health facilities.104 The algorithm was developed from a large prospectively collected dataset and consists of seven signs: (1) history of difficulty feeding, (2) history of convulsions, (3) movement only when stimulated, (4) respiratory rate of 60 breaths per minute or more, (5) severe chest in-drawing, (6) temperature of 37.5°C or more and (7) temperature below 35.5°C. Each of these signs is predictive for the need of hospitalisation in infants of the age group 0–6 days and 7–59 days and should be used to identify sick infants that need referral faster.104

    Results of the Delphi consensus

    The Delphi experts completed and prioritised the results of the systematic review, resulting in a table of 77 proxy indicators (table 2). Indicators that were added or modified in the Delphi process are marked with an asterisk (*).

    View this table:
    Table 2

    Delphi consensus summary table

    View this table:
    View this table:
    View this table:
    View this table:

    Discussion

    Evidence documents the benefits of eHealth tools in terms of increasing satisfaction of health care professionals (HCPs), deisolation, acquisition of new knowledge and their potential impact (largely based on observational studies).3–13 However, there is little evidence demonstrating that these tools lead to changes in health behaviours, which have a meaningful impact on the patient outcomes. An evaluation of a mobile tool for health workers in India used an approach that is similar to the proposed proxy indicators, measuring the impact of the mobile tools on key health behaviours.105 On the one hand, this evaluation demonstrated the feasibility of the proposed approach, showing large and statistically significant impacts on many outcomes in the antenatal care domain; on the other hand, it accentuated the need to evaluate the impact of eHealth tools on patient outcomes beyond knowledge acquisition.105 The evaluation showed that even though there were significant impacts on mother’s knowledge on exclusive breast feeding, this did not translate into significant impacts on reported exclusive breast feeding for 6 months.105

    The main difficulty of evaluating the impact on patient outcomes can be attributed to the limited identification of measurable and reliable indicators. This systematic review identified a set of proxy indicators (table 1) to evaluate the impact of maternal and neonatal eHealth tools in low-resource settings on health outcomes. Experts completed the results with additional proxy indicators, for example, ‘Whooping cough immunization at T2 or T3’, and reorganised them in a Delphi consensus (table 2). Table 3 provides a summarised view on the identified intervention domains of the proxy indicators, while the granularity of the list of proxy indicators (table 2) is necessary to identify the most appropriate proxy indicators for specific eHealth projects or programmes.

    View this table:
    Table 3

    Categories of proxy indicators

    Some of the via the Delphi consensus identified supplementary proxy indicators were not determined in the systematic review, as there were no direct relation to outcomes. They were however added by the experts as they provide essential information for a better case management that may lead to improved outcomes, for example, measurement of blood loss (blood collection bag and blood collection sheets)106 or nutritional status of mother (BMI).107 For example, systematically collecting information on blood loss does not prevent PPH, but early detection of excess bleeding may allow for fast and efficient treatment.106

    The experts also added more general proxy indicators like ‘Antihypertensive drugs to treat pregnancy-induced hypertension (PIH)’ in addition to the more specific ones, for example, antiplatelet drugs for pre-eclampsia (low dose aspirin), which were identified in the systematic review. Furthermore, some additional proxy indicators measure whether cases are managed better, which is assumed to improve outcomes, for example, early referral if prolonged labour or antenatal transfer to higher level of neonatal care.108 In practice, they will need to be mapped to the local context, as the appropriate time for referral in case of, for example, prolonged labour varies depending on the location and context (availability of medication and of the facility.

    Moreover the experts identified ‘Tranexamic acid in post-partum haemorrhage’ in the Delphi consensus as an additional proxy indicator. The systematic review did not identify this due to inconclusive literature or poor quality evidence at the time of the systematic review. However, recently, a new randomised, double-blind, placebo-controlled trial was published, concluding that tranexamic acid reduces PPH death of clinically diagnosed women and that early treatment seems to optimise benefits.109

    Limitations

    The proxy indicators are probably more suitable to evaluate maternal and neonatal eHealth  programmes or components of a programme. For specific maternal/neonatal eHealth  programmes or projects (eg, targeted at HIV infected mothers), additional indicators might be identifiable (eg, vertical transmission of HIV/AIDS). Some proxy indicators may also have been overlooked as unforeseen, and disruptive uses of eHealth may emerge and offer unexpected ways to improve practices.

    Application

    When applied in future studies, proxy indicators related to the eHealth intervention are identified from table 2. Some of them need to be mapped to the local context, practices and available resources. For example ‘the use of uterotonics for PPH prevention’: oxytocin is the preferred choice when available, while oral misoprostol should be the second choice, when injectable uterotonics are not available for treatment.87 89 The proxy indicators can detect and attest changes in behaviour and may explain changes in mortality, even if causality cannot be formally demonstrated.

    The local mapping enables the utilisation of the proxy indicators in various contexts, while the ‘high level’ of the indicators allows systemically collecting data from different projects and programmes (collective data/evidence). Because of the mapping, it is the same proxy indicator for different context, measuring what is locally and temporally relevant and therefore sustainable.

    Table 2 could also serve as a checklist when implementing a project or as a basis for the baseline questionnaire and for creating the didactic contents.

    Conclusion

    The identified proxy indicators provide a workable approach to measuring the impact of eHealth interventions on maternal and neonatal health. However, their validation and calibration in various settings with different methodologies is still required.

    The availability of indicators (direct and proxy) facilitates consistent outcome measurements and comparability of studies,29 and this methodology could be applied to other domains, for example, chronic diseases.

    This implementation research aims at creating evidence to support decision makers to answer questions like ‘why should we invest in eHealth rather than medical staff, immunization or medications?’ and to identify and implement solutions with the greatest potential impact on health. The availability of indicators and the possibility to measure and demonstrate scientific evidence for medical benefits that is based on reliable indicators will accelerate decision makers’ ability to institutionalise eHealth activities and to commit strategically at the regional and national level.

    Acknowledgments

    The authors would like to thank the following persons (in alphabetical order) for their valuables inputs and useful comments: M. Benissa, N. Bhatta, M. Boulvain, D. Desseauve, O. Irion, J. Krishnakumar, S. Masheer, N. Najmi, S. Nausheen, R. Pfister, L. Sheikh, S. Sizonenko, B. Stoll, M. Temmerman and G. Walraven.

    References

    1. 1.↵
      2. Victora CG ,
      3. Requejo JH ,
      4. Barros AJD , et al
      . Countdown to 2015: a decade of tracking progress for maternal, newborn, and child survival. The Lancet 2016;387:2049–59.doi:10.1016/S0140-6736(15)00519-X
      OpenUrl
    2. 2.↵
      2. Liu L ,
      3. Oza S ,
      4. Hogan D , et al
      . Global, regional, and national causes of child mortality in 2000–13, with projections to inform post-2015 priorities: an updated systematic analysis. The Lancet 2015;385:430–40.doi:10.1016/S0140-6736(14)61698-6
      OpenUrl
    3. 3.↵
      2. Curran VR ,
      3. Fleet L ,
      4. Kirby F
      . Factors influencing rural health care professionals' access to continuing professional education. Aust J Rural Health 2006;14:51–5.doi:10.1111/j.1440-1584.2006.00763.x
      OpenUrlCrossRefPubMed
    4. 4.↵
      2. Childs S ,
      3. Blenkinsopp E ,
      4. Hall A , et al
      . Effective e-learning for health professionals and students-barriers and their solutions. A systematic review of the literature-findings from the HeXL project. Health Info Libr J 2005;22(s2):20–32.doi:10.1111/j.1470-3327.2005.00614.x
      OpenUrl
    5. 5.↵
      2. Clarke A ,
      3. Lewis D ,
      4. Cole I , et al
      . A strategic approach to developing e-learning capability for healthcare. Health Info Libr J 2005;22(s2):33–41.doi:10.1111/j.1470-3327.2005.00611.x
      OpenUrlCrossRefPubMedWeb of Science
    6. 6.↵
      2. Bagayoko CO ,
      3. Perrin C ,
      4. Gagnon M-P , et al
      . Continuing distance education: a capacity-building tool for the de-isolation of care professionals and researchers. J Gen Intern Med 2013;28:666–70.doi:10.1007/s11606-013-2522-1
      OpenUrl
    7. 7.↵
      2. Bagayoko CO ,
      3. Niang M ,
      4. Traoré ST , et al
      . Deploying portable ultrasonography with remote assistance for isolated physicians in Africa: lessons from a pilot study in Mali. Stud Health Technol Inform 2010;160(Pt 1):554–8.
      OpenUrlPubMed
    8. 8.↵
      2. Bediang G ,
      3. Franck C ,
      4. Raetzo M-A , et al
      . Developing clinical skills using a virtual patient simulator in a resource-limited setting. Stud Health Technol Inform 2012;192:102–6.
      OpenUrl
    9. 9.↵
      2. Geissbuhler A ,
      3. Bagayoko CO ,
      4. Ly O
      . The RAFT network: 5 years of distance continuing medical education and tele-consultations over the Internet in French-speaking Africa. Int J Med Inform 2007;76(5-6):351–6.doi:10.1016/j.ijmedinf.2007.01.012
      OpenUrlCrossRefPubMed
    10. 10.↵
      2. Bagayoko CO ,
      3. Gagnon MP ,
      4. Traoré D , et al
      . E-Health, another mechanism to recruit and retain healthcare professionals in remote areas: lessons learned from EQUI-ResHuS project in Mali. BMC Med Inform Decis Mak 2014;14:4.doi:10.1186/s12911-014-0120-8
      OpenUrl
    11. 11.↵
      2. Bagayoko C ,
      3. Traoré D ,
      4. Thevoz L , et al
      . Medical and economic benefits of telehealth in low- and middle-income countries: results of a study in four district hospitals in Mali. BMC Health Serv Res 2014;14(Suppl 1):S9.doi:10.1186/1472-6963-14-S1-S9
      OpenUrl
    12. 12.↵
      2. Bediang G ,
      3. Perrin C ,
      4. RRd C , et al
      . The RAFT Telemedicine network in low and middle income countries: educational and clinical services, lessons learnt and perspectives. Front Public Health 2014;2:180.doi:10.3389/fpubh.2014.00180
      OpenUrl
    13. 13.↵
      2. Bagayoko CO ,
      3. Anne A ,
      4. Fieschi M , et al
      . Can ICTs contribute to the efficiency and provide equitable access to the health care system in Sub-Saharan Africa? The Mali experience. Yearb Med Inform 2011;6:33–8.
      OpenUrlPubMed
    14. 14.↵
      eHealth. Fifty-eighth World Health Assembly, Geneva. Geneva: World Health Organization, 2005.
    15. 15.↵
      2. Roine R ,
      3. Ohinmaa A ,
      4. Hailey D
      . Assessing telemedicine: a systematic review of the literature. CMAJ 2001;165:765–71.
      OpenUrlAbstract/FREE Full Text
    16. 16.↵
      2. Ekeland AG ,
      3. Bowes A ,
      4. Flottorp S
      . Effectiveness of telemedicine: A systematic review of reviews. Int J Med Inform 2010;79:736–71.doi:10.1016/j.ijmedinf.2010.08.006
      OpenUrlCrossRefPubMedWeb of Science
    17. 17.↵
      2. Black AD ,
      3. Car J ,
      4. Pagliari C , et al
      . The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med 2011;8:e1000387.doi:10.1371/journal.pmed.1000387
      OpenUrlCrossRefPubMed
    18. 18.↵
      2. Al-Shorbaji N
      . Is there and do we need evidence on eHealth interventions? IRBM 2013;34:24–7.doi:10.1016/j.irbm.2012.11.001
      OpenUrl
    19. 19.↵
      2. Al-Shorbaji N ,
      3. Geissbuhler A
      . Establishing an evidence base for e-health: the proof is in the pudding. Bull World Health Organ 2012;90:322–22A.doi:10.2471/BLT.12.106146
      OpenUrlCrossRefPubMedWeb of Science
    20. 20.↵
      2. Tomlinson M ,
      3. Rotheram-Borus MJ ,
      4. Swartz L , et al
      . Scaling up mHealth: where is the evidence? PLoS Med 2013;10:e1001382.doi:10.1371/journal.pmed.1001382
      OpenUrlCrossRefPubMed
    21. 21.↵
      2. Wootton R
      . Telemedicine support for the developing world. J Telemed Telecare 2008;14:109–14.doi:10.1258/jtt.2008.003001
      OpenUrlCrossRefPubMed
    22. 22.↵
      2. Kiberu VM ,
      3. Mars M ,
      4. Scott RE
      . Barriers and opportunities to implementation of sustainable e-Health programmes in Uganda: A literature review. Afr J Prim Health Care Fam Med 2017;9:1–10.doi:10.4102/phcfm.v9i1.1277
      OpenUrl
    23. 23.↵
      2. Beratarrechea A ,
      3. Lee AG ,
      4. Willner JM , et al
      . The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed J E Health 2014;20:75–82.doi:10.1089/tmj.2012.0328
      OpenUrlCrossRefPubMed
    24. 24.↵
      2. Lewis T ,
      3. Synowiec C ,
      4. Lagomarsino G , et al
      . E-health in low- and middle-income countries: findings from the Center for Health Market Innovations. Bull World Health Organ 2012;90:332–40.doi:10.2471/BLT.11.099820
      OpenUrlCrossRefPubMedWeb of Science
    25. 25.↵
      2. Piette JD ,
      3. Lun KC ,
      4. Moura LA , et al
      . Impacts of e-health on the outcomes of care in low- and middle-income countries: where do we go from here? Bull World Health Organ 2012;90:365–72.doi:10.2471/BLT.11.099069
      OpenUrlCrossRefPubMed
    26. 26.↵
      2. Scott RE ,
      3. Mars M
      . Principles and framework for ehealth strategy development. J Med Internet Res 2013;15:e155.doi:10.2196/jmir.2250
      OpenUrl
    27. 27.↵
      2. Khoja S ,
      3. Durrani H ,
      4. Scott RE , et al
      . Conceptual framework for development of comprehensive e-health evaluation tool. Telemed J E Health 2013;19:48–53.doi:10.1089/tmj.2012.0073
      OpenUrl
    28. 28.↵
      2. Khoja S ,
      3. Durrani H
      . Introduction to mHealth-focused issue on evidence-based eHealth adoption and application: AME Publications, 2017.
    29. 29.↵
      2. Fraser H ,
      3. Bailey C ,
      4. Sinha C , et al
      . Call to action on global eHealth evaluation: consensus statement of the WHO Global eHealth Evaluation Meeting, Bellagio, September 2011. Bellagio, Italy: Bellagio eHealth Evaluation Group, 2011.
    30. 30.↵
      2. Guadagnoli E ,
      3. McNeil BJ
      . Outcomes research: hope for the future or the latest rage? Inquiry 1994:14–24.
    31. 31.↵
      2. Hepworth J
      . Debate. Evaluation in health outcomes research: linking theories, methodologies and practice in health promotion. Health Promot Int 1997;12:233–8.doi:10.1093/heapro/12.3.233
      OpenUrlCrossRefWeb of Science
    32. 32.↵
      2. Moher D ,
      3. Liberati A ,
      4. Tetzlaff J , et al
      . Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. PLoS Med 2009;6:e1000097.doi:10.1371/journal.pmed.1000097
    33. 33.↵
      2. Caroline Perrin LH ,
      3. Geissbuhler A
      . A systematic review to identify proxy-indicators to quantify the impact of eHealth tools on maternal and neonatal health outcomes in low and middle-income countries - including Delphi consensus. Prospero 2018 https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=27351.
    34. 34.↵
      2. Robinson KA ,
      3. Chou R ,
      4. Berkman ND , et al
      . Twelve recommendations for integrating existing systematic reviews into new reviews: EPC guidance. J Clin Epidemiol 2016;70:38–44.doi:10.1016/j.jclinepi.2015.05.035
      OpenUrl
    35. 35.↵
      2. Higgins JPT ,
      3. Altman DG ,
      4. Gotzsche PC , et al
      . The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928.doi:10.1136/bmj.d5928
      OpenUrlFREE Full Text
    36. 36.↵
      2. Sterne J ,
      3. Higgins J ,
      4. Reeves B , et al
      . A Cochrane risk of bias assessment tool: For non-randomized studies of interventions (ROBINS-I). BMJ.
    37. 37.↵
      2. Whiting P ,
      3. Savović J ,
      4. Higgins JPT , et al
      . ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol 2016;69:225–34.doi:10.1016/j.jclinepi.2015.06.005
      OpenUrlCrossRefPubMed
    38. 38.↵
      2. Guyatt GH ,
      3. Oxman AD ,
      4. Vist GE , et al
      . GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008.
    39. 39.↵
      2. Balshem H ,
      3. Helfand M ,
      4. Schünemann HJ , et al
      . GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64:401–6.doi:10.1016/j.jclinepi.2010.07.015
      OpenUrlCrossRefPubMedWeb of Science
    40. 40.↵
      2. Guyatt G ,
      3. Oxman AD ,
      4. Akl EA , et al
      . GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011;64:383–94.doi:10.1016/j.jclinepi.2010.04.026
      OpenUrlCrossRefPubMed
    41. 41.↵
      2. Conde-Agudelo A ,
      3. Rosas-Bermúdez A ,
      4. Kafury-Goeta AC
      . Birth Spacing and Risk of Adverse Perinatal Outcomes. JAMA 2006;295:1809–23.doi:10.1001/jama.295.15.1809
      OpenUrlCrossRefPubMedWeb of Science
    42. 42.↵
      2. Blencowe H ,
      3. Cousens S ,
      4. Modell B , et al
      . Folic acid to reduce neonatal mortality from neural tube disorders. Int J Epidemiol 2010;39(Suppl 1):i110–21.doi:10.1093/ije/dyq028
      OpenUrlCrossRefPubMed
    43. 43.↵
      2. Haider BA ,
      3. Bhutta ZA
      . Multiple‐micronutrient supplementation for women during pregnancy. The Cochrane Library 2012.
    44. 44.↵
      2. Lassi ZS ,
      3. Mansoor T ,
      4. Salam RA , et al
      . Essential pre-pregnancy and pregnancy interventions for improved maternal, newborn and child health. Reprod Health 2014;11:S2.doi:10.1186/1742-4755-11-S1-S2
      OpenUrl
    45. 45.↵
      2. Wardlaw TM
      . Low birthweight: country, regional and global estimates: UNICEF WHO, 2004.
    46. 46.↵
      2. Susser M
      . Prenatal nutrition, birthweight, and psychological development: an overview of experiments, quasi-experiments, and natural experiments in the past decade. Am J Clin Nutr 1981;34:784–803.doi:10.1093/ajcn/34.4.784
      OpenUrlFREE Full Text
    47. 47.↵
      2. Kramer MS
      . Effects of energy and protein intakes on pregnancy outcome: an overview of the research evidence from controlled clinical trials. Am J Clin Nutr 1993;58:627–35.doi:10.1093/ajcn/58.5.627
      OpenUrlAbstract/FREE Full Text
    48. 48.↵
      2. Prentice AM ,
      3. Cole TJ ,
      4. Foord FA , et al
      . Increased birthweight after prenatal dietary supplementation of rural African women. Am J Clin Nutr 1987;46:912–25.doi:10.1093/ajcn/46.6.912
      OpenUrlAbstract/FREE Full Text
    49. 49.↵
      2. Kusin JA ,
      3. Kardjati S ,
      4. Renqvist UH
      . Chronic undernutrition in pregnancy and lactation. Proc Nutr Soc 1993;52:19–28.doi:10.1079/PNS19930033
      OpenUrlCrossRefPubMed
    50. 50.↵
      2. Ceesay SM ,
      3. Prentice AM ,
      4. Cole TJ , et al
      . Effects on birth weight and perinatal mortality of maternal dietary supplements in rural gambia: 5 year randomised controlled trial. BMJ 1997;315:786–90.doi:10.1136/bmj.315.7111.786
      OpenUrlAbstract/FREE Full Text
    51. 51.↵
      2. Bhutta ZA ,
      3. Das JK ,
      4. Bahl R , et al
      . Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? The Lancet 2014;384:347–70.doi:10.1016/S0140-6736(14)60792-3
      OpenUrl
    52. 52.↵
      2. Goldenberg RL ,
      3. McClure EM ,
      4. Saleem S , et al
      . Infection-related stillbirths. The Lancet 2010;375:1482–90.doi:10.1016/S0140-6736(09)61712-8
      OpenUrl
    53. 53.↵
      2. Blencowe H ,
      3. Cousens S ,
      4. Kamb M , et al
      . Lives Saved Tool supplement detection and treatment of syphilis in pregnancy to reduce syphilis related stillbirths and neonatal mortality. BMC Public Health 2011;11:11:1.doi:10.1186/1471-2458-11-S3-S9
    54. 54.↵
      2. Ishaque S ,
      3. Yakoob MY ,
      4. Imdad A , et al
      . Effectiveness of interventions to screen and manage infections during pregnancy on reducing stillbirths: a review. BMC Public Health 2011;11(Suppl 3):S3.doi:10.1186/1471-2458-11-S3-S3
      OpenUrlCrossRef
    55. 55.↵
      2. Radeva-Petrova D ,
      3. Kayentao K ,
      4. ter Kuile FO , et al
      . Drugs for preventing malaria in pregnant women in endemic areas: any drug regimen versus placebo or no treatment. Cochrane Database Syst Rev 2014;9.doi:10.1002/14651858.CD000169.pub3
    56. 56.↵
      2. Siegfried N ,
      3. Uthman OA ,
      4. Rutherford GW
      . Optimal time for initiation of antiretroviral therapy in asymptomatic, HIV-infected, treatment-naive adults. Cochrane Database Syst Rev 2010:CD008272.doi:10.1002/14651858.CD008272.pub2
    57. 57.↵
      2. Kitahata MM ,
      3. Gange SJ ,
      4. Abraham AG , et al
      . Effect of early versus deferred antiretroviral therapy for HIV on survival. N Engl J Med 2009;360:1815–26.doi:10.1056/NEJMoa0807252
      OpenUrlCrossRefPubMedWeb of Science
    58. 58.↵
      2. Pottie K ,
      3. Medu O ,
      4. Welch V , et al
      . Effect of rapid HIV testing on HIV incidence and services in populations at high risk for HIV exposure: an equity-focused systematic review. BMJ Open 2014;4:e006859.doi:10.1136/bmjopen-2014-006859
    59. 59.↵
      2. Miro JM ,
      3. Manzardo C ,
      4. Mussini C , et al
      . Survival outcomes and effect of early vs. deferred cART among HIV-infected patients diagnosed at the time of an AIDS-defining event: a cohort analysis. PLoS One 2011;6:e26009.doi:10.1371/journal.pone.0026009
    60. 60.↵
      2. Siegfried N ,
      3. van der Merwe L ,
      4. Brocklehurst P , et al
      . Antiretrovirals for reducing the risk of mother‐to‐child transmission of HIV infection. The Cochrane Library 2011.
    61. 61.↵
      2. Horvath T ,
      3. Azman H ,
      4. Kennedy GE , et al
      . Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev 2012;376.doi:10.1002/14651858.CD009756
    62. 62.↵
      2. Wu G ,
      3. Zaman MH
      . Low-cost tools for diagnosing and monitoring HIV infection in low-resource settings. Bull World Health Organ 2012;90:914–20.doi:10.2471/BLT.12.102780
      OpenUrlCrossRefPubMedWeb of Science
    63. 63.↵
      2. King JF ,
      3. Flenady V ,
      4. Papatsonis D , et al
      . Calcium channel blockers for inhibiting preterm labour. The Cochrane Library 2014.
    64. 64.↵
      2. Roberts D ,
      3. Dalziel S
      . Antenatal corticosteroids for accelerating fetal lung maturation for women at risk of preterm birth (Review). Cochrane Database Syst Rev 2006;19.
    65. 65.↵
      2. Crowther CA ,
      3. McKinlay CJ ,
      4. Middleton P , et al
      . Repeat doses of prenatal corticosteroids for women at risk of preterm birth for improving neonatal health outcomes. Cochrane Database Syst Rev 2015;24:CD003935.doi:10.1002/14651858.CD003935.pub4
      OpenUrl
    66. 66.↵
      2. Say L ,
      3. Chou D ,
      4. Gemmill A , et al
      . Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health 2014;2:e323–33.doi:10.1016/S2214-109X(14)70227-X
      OpenUrlCrossRefPubMed
    67. 67.↵
      2. Lopez-Mendez MA ,
      3. Martinez-Gaytan V ,
      4. Cortes-Flores R , et al
      . Doppler ultrasound evaluation in preeclampsia. BMC Res Notes 2013;6:477.doi:10.1186/1756-0500-6-477
      OpenUrlCrossRefPubMed
    68. 68.↵
      2. Cnossen JS ,
      3. Morris RK ,
      4. ter Riet G , et al
      . Use of uterine artery Doppler ultrasonography to predict pre-eclampsia and intrauterine growth restriction: a systematic review and bivariable meta-analysis. Can Med Assoc J 2008;178:701–11.doi:10.1503/cmaj.070430
      OpenUrlAbstract/FREE Full Text
    69. 69.↵
      2. Roberts JM ,
      3. Escudero C
      . The placenta in preeclampsia. Pregnancy Hypertens 2012;2:72–83.doi:10.1016/j.preghy.2012.01.001
      OpenUrlPubMed
    70. 70.↵
      2. Imdad A ,
      3. Bhutta ZA
      . Effects of calcium supplementation during pregnancy on maternal, fetal and birth outcomes. Paediatr Perinat Epidemiol 2012;26(8):138–52.doi:10.1111/j.1365-3016.2012.01274.x
      OpenUrlCrossRefPubMed
    71. 71.↵
      2. Ortega RM ,
      3. Martínez RM ,
      4. López-Sobaler AM , et al
      . Influence of calcium intake on gestational hypertension. Ann Nutr Metab 1999;43:37–46.doi:10.1159/000012765
      OpenUrlPubMed
    72. 72.↵
      2. Imdad A ,
      3. Jabeen A ,
      4. Bhutta ZA
      . Role of calcium supplementation during pregnancy in reducing risk of developing gestational hypertensive disorders: a meta-analysis of studies from developing countries. BMC Public Health 2011;11:11(3):1.doi:10.1186/1471-2458-11-S3-S18
    73. 73.↵
      2. Hofmeyr GJ ,
      3. Lawrie TA ,
      4. Atallah AN , et al
      . Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. Cochrane Database Syst Rev 2014;3:CD001059.doi:10.1002/14651858.CD001059.pub4
      OpenUrl
    74. 74.↵
      2. Duley L ,
      3. Henderson-Smart D ,
      4. Meher S , et al
      . Antiplatelet agents for preventing pre-eclampsia and its complications (Review). Cochrane Database Syst Rev 2007;2:121.
      OpenUrl
    75. 75.↵
      2. Okereke E ,
      3. Ahonsi B ,
      4. Tukur J , et al
      . Benefits of using magnesium sulphate (MgSO4) for eclampsia management and maternal mortality reduction: lessons from Kano State in Northern Nigeria. BMC Res Notes 2012;5:421.doi:10.1186/1756-0500-5-421
      OpenUrlPubMed
    76. 76.↵
      2. Duley L
      . Evidence and practice: the magnesium sulphate story. Best Pract Res Clin Obstet Gynaecol 2005;19:57–74.doi:10.1016/j.bpobgyn.2004.10.010
      OpenUrlPubMed
    77. 77.↵
      2. Altman D ,
      3. Carroli G ,
      4. Duley L , et al
      . Do women with pre-eclampsia, and their babies, benefit from magnesium sulphate? The Magpie Trial: a randomised placebo-controlled trial. Lancet 2002;359:1877–90.
      OpenUrlCrossRefPubMedWeb of Science
    78. 78.↵
      2. Duley L ,
      3. Gülmezoglu AM ,
      4. Henderson‐Smart DJ
      . Magnesium sulphate and other anticonvulsants for women with pre‐eclampsia. The Cochrane Library 2003.
    79. 79.↵
      2. Tukur J ,
      3. Ahonsi B ,
      4. Mohammed Ishaku S ,
      5. Ishaku SM , et al
      . Maternal and fetal outcomes after introduction of magnesium sulphate for treatment of preeclampsia and eclampsia in selected secondary facilities: a low-cost intervention. Matern Child Health J 2013;17:1191–8.doi:10.1007/s10995-012-1105-9
      OpenUrlCrossRefPubMedWeb of Science
    80. 80.↵
      2. Shamsuddin L ,
      3. Nahar K ,
      4. Nasrin B , et al
      . Use of parenteral magnesium sulphate in eclampsia and severe pre-eclampsia cases in a rural set up of Bangladesh. 2005.
    81. 81.↵
      WHO. WHO recommendation on use of magnesium sulfate to prevent and treat eclampsia, where the full regimen cannot be administered. Geneva: World Health Organization: WHO Reproductive Health Library, 2011.
    82. 82.↵
      2. Oringanje C ,
      3. Meremikwu MM ,
      4. Eko H , et al
      . Interventions for preventing unintended pregnancies among adolescents. Cochrane Database Syst Rev 2016;27.doi:10.1002/14651858.CD005215.pub3
    83. 83.↵
      2. Ngo TD ,
      3. Park MH ,
      4. Shakur H , et al
      . Comparative effectiveness, safety and acceptability of medical abortion at home and in a clinic: a systematic review. Bull World Health Organ 2011;89:360–70.doi:10.2471/BLT.10.084046
      OpenUrlCrossRefPubMedWeb of Science
    84. 84.↵
      2. Creinin MD
      . Medical abortion regimens: historical context and overview. Am J Obstet Gynecol 2000;183:S3–S9.doi:10.1067/mob.2000.107948
      OpenUrlCrossRefPubMed
    85. 85.↵
      2. Blencowe H ,
      3. Cousens S ,
      4. Mullany LC , et al
      . Clean birth and postnatal care practices to reduce neonatal deaths from sepsis and tetanus: a systematic review and Delphi estimation of mortality effect. BMC Public Health 2011;11:11.doi:10.1186/1471-2458-11-S3-S11
      OpenUrlCrossRefPubMed
    86. 86.↵
      2. Hofmeyr GJ ,
      3. Mshweshwe NT ,
      4. Gülmezoglu AM
      . Cochrane Pregnancy and Childbirth Group. Controlled cord traction for the third stage of labour. Cochrane Database Syst Rev 2015;107.doi:10.1002/14651858.CD008020.pub2
    87. 87.↵
      WHO. WHO recommendatioins for the prevention and treatment or postpartum haemorrhage: evidence base. 2012.
    88. 88.↵
      2. Begley CM ,
      3. Gyte GM ,
      4. Devane D , et al
      . Active versus expectant management for women in the third stage of labour. Cochrane Database Syst Rev 2015;6:CD007412.doi:10.1002/14651858.CD007412.pub4
      OpenUrl
    89. 89.↵
      2. Winikoff B ,
      3. Dabash R ,
      4. Durocher J , et al
      . Treatment of post-partum haemorrhage with sublingual misoprostol versus oxytocin in women not exposed to oxytocin during labour: a double-blind, randomised, non-inferiority trial. The Lancet 2010;375:210–6.doi:10.1016/S0140-6736(09)61924-3
      OpenUrl
    90. 90.↵
      2. Ö T ,
      3. Hofmeyr GJ ,
      4. Gülmezoglu AM
      . Prostaglandins for preventing postpartum haemorrhage. Cochrane Database Syst Rev 2012;8.
    91. 91.↵
      2. Akhter S ,
      3. Begum MR ,
      4. Kabir Z , et al
      . Use of a condom to control massive postpartum hemorrhage. MedGenMed 2003;5:38.
      OpenUrlPubMed
    92. 92.↵
      2. Tindell K ,
      3. Garfinkel R ,
      4. Abu-Haydar E , et al
      . Uterine balloon tamponade for the treatment of postpartum haemorrhage in resource-poor settings: a systematic review. BJOG 2013;120:5–14.doi:10.1111/j.1471-0528.2012.03454.x
      OpenUrl
    93. 93.↵
      2. Burke TF ,
      3. Ahn R ,
      4. Nelson BD , et al
      . A postpartum haemorrhage package with condom uterine balloon tamponade: a prospective multi-centre case series in Kenya, Sierra Leone, Senegal, and Nepal. BJOG 2016;123.doi:10.1111/1471-0528.13550
    94. 94.↵
      2. Aderoba AK ,
      3. Olagbuji BN ,
      4. Akintan AL , et al
      . Condom-catheter tamponade for the treatment of postpartum haemorrhage and factors associated with success: a prospective observational study. BJOG 2017;124.doi:10.1111/1471-0528.14361
    95. 95.↵
      2. Moore ER ,
      3. Anderson GC ,
      4. Bergman N , et al
      . Early skin-to-skin contact for mothers and their healthy newborn infants. Cochrane Database Syst Rev 2012;5.
    96. 96.↵
      2. Debes AK ,
      3. Kohli A ,
      4. Walker N , et al
      . Time to initiation of breastfeeding and neonatal mortality and morbidity: a systematic review. BMC Public Health 2013;13:1.doi:10.1186/1471-2458-13-S3-S19
      OpenUrlCrossRefPubMed
    97. 97.↵
      WHO. WHO recommendations on postnatal care of the mother and newborn: World Health Organization, 2014.
    98. 98.↵
      2. Bergström A ,
      3. Byaruhanga R ,
      4. Okong P
      . The impact of newborn bathing on the prevalence of neonatal hypothermia in Uganda: a randomized, controlled trial. Acta Paediatr 2005;94:1462–7.doi:10.1080/080352505100366750
      OpenUrlPubMed
    99. 99.↵
      2. Sinha A ,
      3. Sazawal S ,
      4. Pradhan A , et al
      . Chlorhexidine skin or cord care for prevention of mortality and infections in neonates. Cochrane Database Syst Rev 2015;379.doi:10.1002/14651858.CD007835.pub2
    100. 100.↵
      2. Puckett RM ,
      3. Offringa M
      . Prophylactic vitamin K for vitamin K deficiency bleeding in neonates. Cochrane Database Syst Rev 2000;33:CD002776.doi:10.1002/14651858.CD002776
      OpenUrl
    101. 101.↵
      2. Wall SN ,
      3. Lee AC ,
      4. Niermeyer S , et al
      . Neonatal resuscitation in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obstet 2009;107:S47–64.doi:10.1016/j.ijgo.2009.07.013
      OpenUrlPubMed
    102. 102.↵
      2. Lee AC ,
      3. Cousens S ,
      4. Wall SN , et al
      . Neonatal resuscitation and immediate newborn assessment and stimulation for the prevention of neonatal deaths: a systematic review, meta-analysis and Delphi estimation of mortality effect. BMC Public Health 2011;11:11.doi:10.1186/1471-2458-11-S3-S12
      OpenUrlCrossRefPubMed
    103. 103.↵
      2. Conde-Agudelo A ,
      3. Díaz-Rossello JL
      . Kangaroo mother care to reduce morbidity and mortality in low birthweight infants. Cochrane Database Syst Rev 2014:CD002771.doi:10.1002/14651858.CD002771.pub3
    104. 104.↵
      Young Infants Clinical Signs Study Group. Clinical signs that predict severe illness in children under age 2 months: a multicentre study. Lancet 2008;371:135–42.doi:10.1016/S0140-6736(08)60106-3
      OpenUrlCrossRefPubMedWeb of Science
    105. 105.↵
      2. Borkum E ,
      3. Sivasankaran A ,
      4. Sridharan S , et al
      . Evaluation of the Information and Communication Technology (ICT) Continuum of Care Services (CCS): Intervention in Bihar: Mathematica Policy Research, 2015.
    106. 106.↵
      2. Edhi MM ,
      3. Aslam HM ,
      4. Naqvi Z , et al
      . "Post partum hemorrhage: causes and management". BMC Res Notes 2013;6:236.doi:10.1186/1756-0500-6-236
      OpenUrlCrossRefPubMed
    107. 107.↵
      2. Koblinsky MA
      . Beyond maternal mortality–magnitude, interrelationship, and consequences of women’s health, pregnancy-related complications and nutritional status on pregnancy outcomes. Int J Gynaecol Obstet 1995;48:S21–32.doi:10.1016/0020-7292(95)02322-4
      OpenUrlCrossRefPubMed
    108. 108.↵
      2. Biswas A ,
      3. Anderson R ,
      4. Doraiswamy S , et al
      . Timely referral saves the lives of mothers and newborns: Midwifery led continuum of care in marginalized teagarden communities - a qualitative case study in Bangladesh. F1000Res 2018;7:365.doi:10.12688/f1000research.13605.1
      OpenUrl
    109. 109.↵
      WOMAN Trial Collaborators. Effect of early tranexamic acid administration on mortality, hysterectomy, and other morbidities in women with post-partum haemorrhage (WOMAN): an international, randomised, double-blind, placebo-controlled trial. Lancet 2017;389:2105–16.doi:10.1016/S0140-6736(17)30638-4
      OpenUrl
    110. 110.
      2. Demicheli V ,
      3. Barale A ,
      4. Rivetti A
      . Cochrane Pregnancy and Childbirth Group. Vaccines for women for preventing neonatal tetanus. Cochrane Database Syst Rev 2015;58.doi:10.1002/14651858.CD002959.pub4
    111. 111.
      2. Chamberlain C ,
      3. O’Mara-Eves A ,
      4. Oliver S , et al
      . Psychosocial interventions for supporting women to stop smoking in pregnancy. Cochrane Database Syst Rev 2013:CD001055.doi:10.1002/14651858.CD001055.pub4
    112. 112.
      2. Hofmeyr GJ ,
      3. Kulier R ,
      4. West HM
      . Cochrane Pregnancy and Childbirth Group. External cephalic version for breech presentation at term. Cochrane Database Syst Rev 2015;91.doi:10.1002/14651858.CD000083.pub3
    113. 113.
      2. Hussain AA ,
      3. Yakoob MY ,
      4. Imdad A , et al
      . Elective induction for pregnancies at or beyond 41 weeks of gestation and its impact on stillbirths: a systematic review with meta-analysis. BMC Public Health 2011;11:11.doi:10.1186/1471-2458-11-S3-S5
      OpenUrlCrossRefPubMed
    114. 114.
      2. Cherniak W ,
      3. Anguyo G ,
      4. Meaney C , et al
      . Effectiveness of advertising availability of prenatal ultrasound on uptake of antenatal care in rural Uganda: A cluster randomized trial. PLoS One 2017;12:e0175440.doi:10.1371/journal.pone.0175440

    Footnotes

    • Contributors CP designed the work with input from AG. CP designed the protocol with input of AG and LH. CP did the initial screening of studies. CP and LH rated the studies; AG solved discrepancies in the ratings. CP extracted the data, which was thoroughly checked and verified by LH. CP drafted the article. AG and LH made a critical revision of the article. All authors gave their final approval of the version to be published.

    • Funding Department of Radiology and Medical Informatics, Faculty of Medicine, University of Geneva.

    • Competing interests None declared.

    • Patient consent Not required.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement No additional data sharing available.