Objectives To evaluate the impact of Newhints community-based surveillance volunteer (CBSV) assessments and referrals on access to care for sick newborns and on existing inequities in access.
Design We evaluated a prospective cohort nested within the Newhints cluster-randomised controlled trial.
Setting Community-based intervention involving more than 750 000, predominantly rural, population in seven contiguous districts in the Brong-Ahafo Region, Ghana.
Participants Participants were recently delivered women (from more than 120 000 women under surveillance) and their 16 168 liveborn babies. Qualitative in-depth interviews with referral narratives (IDIs) were conducted with 92 mothers, CBSVs and health facility front-desk and maternity/paediatrics ward staff.
Interventions Newhints trained and effectively supervised 475 CBSVs (existing within the Ghana Health Service) in 49 of 98 supervisory zones (clusters) to assess and refer newborns with any of the 10-key-danger signs to health facilities within the first week after birth; promote independent care seeking for sick newborns and problem-solve around barriers between November 2008 and December 2009.
Primary outcomes The main evaluation outcomes were rates of compliance with referrals and independent care seeking for newborn illnesses.
Results Of 4006 sampled, 2795 (69.8%) recently delivered women received CBSV assessment visits and 279 (10.0%) newborns were referred with danger signs. Compliance with referrals was unprecedentedly high (86.0%) with women in the poorest quintile (Q1) complying better than the least poor (Q5):87.5%(Q1) vs 69.7%(Q5); p=0.038. Three-quarters went to hospitals; 18% were admitted and 58% received outpatient treatment. Some (24%) mothers were turned away at facilities and follow-on IDIs showed that some of these untreated babies subsequently died. Independent care seeking for severe newborn illness increased from 55.4% in control to 77.3% in Newhints zones, especially among Q1 where care seeking almost doubled (95.0% vs 48.6%; RR=1.94 (1.32, 2.84); p=0.001). Rates were the highest among rural residents but urban residents complied quicker.
Conclusions Home visits are feasible and a potentially pro-poor approach to link sick newborns to facilities. Its effectiveness in improving survival hinges on matched improvement in facility quality of care.
Trial registration number NCT00623337.
- PRIMARY CARE
- PREVENTIVE MEDICINE
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The evaluation used a population-based nested cohort in a trial with an optimum design-cluster randomised controlled trial. The findings are therefore representative of the population and may have external validity in similar settings especially in low and middle-income countries of sub-Saharan Africa and south Asia.
The use of qualitative methods to evaluate the process and the observed consistency and complementarity with quantitative findings gives strength to these evaluation findings.
A key limitation was the inability to reconcile referral records with facility records because of poor facility record keeping, where babies who were not treated and sent home had no records of contact with the facility. However, in-depth interviews with professionals in the facilities supported women's account of experiences within the facilities and the general poor quality of care.
Globally, an estimated 41% (3.3 million)1 of child deaths occur in the first 28 days of life (neonatal period) and 99% of these are in low and middle-income country (LMIC) settings.2 Although causes of neonatal deaths are difficult to ascertain in LMIC settings because contacts are not made with health systems,3 three direct causes: infections, asphyxia and prematurity or low birthweight and its complications account for ∼80% of these deaths, the majority of which are preventable.1 ,4 Infection is the single most important cause contributing to about a quarter (and up to half in high-mortality settings) of all neonatal deaths.5–7 Evidence exists that prompt detection and treatment of these infections and effective preventive measures can significantly reduce newborn deaths, but complex interventions are not necessary to save newborn lives.8 ,9
Care seeking for sick newborns is often poor;10–14 identified barriers include poor recognition of newborn illnesses,5 ,10 ,12 ,15 cultural practices such as seclusion after delivery and a belief in traditional remedies for some newborn illnesses, and geographical and financial inaccessibility to care.12 ,13 ,16 ,17 Most newborn deaths, therefore, occur at home.18–20
Family and community practices around care seeking for newborn illnesses can be strengthened by interventions to improve the identification of illness and the likelihood that families access appropriate care. Studies in rural India and Bangladesh have demonstrated that training community health workers/volunteers (CHWs) to promote essential newborn care (ENC) practices and to identify and manage sick newborns (with home treatment and/or referral to hospital) can result in substantial (30–62%) reductions in neonatal mortality.20–22 In addition, this approach has the potential to be equitable.23 No trials have been conducted to date in sub-Saharan Africa where the rates of neonatal mortality are the highest.4
The Newhints cluster-randomised controlled trial (CRT) in rural Ghana evaluated the impact of home visits by community-based surveillance volunteers (CBSVs) on ENC practices and neonatal mortality.24 It achieved improved coverage of key ENC practices and non-significant reductions of 8% in neonatal deaths and 15% in deaths occurring after the first day, the period particularly targeted by the intervention.24 The Newhints intervention adopted a three-pronged approach to increase access to care for sick newborns: first, during home visits in the first week of life, the time of the greatest vulnerability for the newborn,4 CBSVs weighed and assessed newborns for 10-key danger signs and referred to health facilities when any was present. Doing this sent a strong message to the community about the vulnerability of newborns and reinforced the second approach in which CBSVs promoted care seeking for newborn illnesses by counselling families on danger signs and emphasising the need for urgent action when newborns fell ill. Third, they dialogued and problem-solved with families around barriers to seeking care, both during its promotion and at the time of any referral. In addition, CBSVs counselled families on the importance of saving during pregnancy for emergencies.
In this paper, we present findings on the success of this three-pronged approach, evaluating whether the Newhints intervention has increased access to care for sick newborns (including compliance with referral and independent care-seeking for sick newborns) and in particular assess whether it has reduced inequities in this access.
This study is a prospective study nested within the Newhints cluster-randomised controlled trial.
An overview of Newhints trial design and study setting
Details of the Newhints trial design have already been published.24 ,25 In brief, it was a CRT with 49 of 98 supervisory zones randomised for Newhints implementation and 49 acting as controls receiving routine Ghana Health Service (GHS) programmes. In addition, ENC training was conducted in the main health facilities covering both intervention and control zones. The trial covered seven contiguous districts (figure 1) in the Brong-Ahafo Region in central Ghana; an area of ∼12 000 km2 with a multiethnic and predominantly (80%) rural population of more than 700 000,26 engaged primarily in subsistence agriculture. Educational levels were low and communities, mostly served by unpaved roads, lacked modern infrastructure. The four main hospitals located in the relatively urban district capital towns of Techiman, Kintampo, Nkoranza and Wenchi (figure 1) provided comprehensive emergency obstetric and newborn care services and were referral destinations for subdistrict and community-based facilities. Distances between families and hospitals vary from a few metres for urban residents to more than 80 km from some villages.
Newhints was fully implemented by end of October 2008. Data for impact and process evaluations were obtained through an on-going surveillance system24 ,27 covering 120 000 women of child-bearing age. Trial participants were women with babies born between November, 2008 and December, 2009.
The Newhints assessment and referral
Newhints was an integrated intervention package25 which included a three-pronged approach to increasing access to care for sick newborns (figure 2). The core components of Newhints were training more than 450 CBSVs, over 9 days, to identify pregnant women and conduct five focused home visits (two during pregnancy and three on days 1, 3 and 7 in the first week after birth) to promote ENC practices, weigh and assess newborns and refer to health facilities if any of the 10 danger signs was present (table 1). To reach babies timely after birth CBSVs left their contact details with families to be contacted whenever women delivered. In addition, they increased the frequency of home visits to women who were in their late pregnancy. CBSVs were provided with portable weighing scales with colour-coded bands: red for weights <1.5 kg identifying very low birthweight (vLBW) babies; yellow for weights of 1.5–2.4 kg identifying LBW babies; and green for weights of 2.5 kg and above; a digital thermometer; and a timer.
CBSV training involved interactive discussions, group exercises and practical newborn assessment video exercises using the WHO's Integrated Management of Childhood Illnesses (IMCI) Computerized Adaptation and Training Tool (ICATT). Two training days were dedicated for clinical assessments within hospitals where each CBSV assessed at least two babies.
When CBSVs identified babies with any danger sign, they referred them to health facilities issuing them with a referral card to take along, and counselled on the importance of keeping the baby warm and frequent breastfeeding on the way to the facility. They dialogued and problem-solved around barriers to compliance, followed-up within 24 hours to check compliance and discussed continued ENC (figure 2). If families had not complied, CBSVs re-assessed and referred again when danger signs persisted.
Promotion of care seeking
At the second and third postnatal visits, CBSVs additionally promoted the importance of prompt care seeking, and discussed five key illness signs: if the baby has stopped to feed or is not feeding well; if baby is too hot or too cold to touch (fever or hypothermia); if the baby is having difficult or fast breathing (dyspnoea); if the baby has become yellow all over the body (jaundice); and if the baby has become less active (lethargy).
CBSVs were supervised by two trained district-based project supervisors (illness) in each district. DiPS carried out monthly visits to pay CBSV incentives, replenish their stocks and provide supportive supervision by accompanying them into communities and directly observing them carry out home visits; in some of these visits they also carried out repeat assessments of babies. DiPS completed structured performance records for these directly observed supervision (DOS) visits and gave supportive feedback to reinforce CBSV skills. The DiPS were supervised by Newhints research fellows.
Two main indicators were used to measure newborn access to care: referral compliance defined as the percentage of families who took their babies to health facilities after CBSV referrals and overall care seeking defined as the percentage of newborns taken to a hospital/clinic among those reported by the mother in the first surveillance visit (usually up to 56 days) after birth as having had severe illness.
The evaluation of compliance achieved in Newhints and assessing whether Newhints has reduced inequities in care seeking for severely ill newborns was based on four types of data (the details are provided in the following sections): surveillance, process evaluation, assessment quality checks (of CBSVs and DiPS) and in-depth interviews with mothers, CBSVs and health professionals.
Individual informed consent was obtained from all women under surveillance, recently delivered mothers selected for process interviews and the in-depth interviews; CBSVs and their supervisors and health professionals. Interviewers read an information sheet to potential participants in the local language or in English, checked their understanding and answered any questions before consent was requested. Consent forms were read to them and agreement for participation was indicated with a signature or a thumbprint. Participants were assured of confidentiality and their rights to withdraw from the study at any point without prejudice to their position, participation in the main Newhints study or health services received in any facility. They were not required to provide reasons for such decisions.
Trained resident-fieldworkers identified pregnancies, births and deaths through 4-weekly home visits to all women of reproductive age. They collected data on sociodemographic characteristics for all pregnancies, including an assets inventory, newborn care practices, morbidity and mortality in the first visit after the birth was identified. From July 2009, this was amended to 8-weekly visits to follow-up pregnant women and their infants.
From March 2009, trained field supervisors visited a random subsample of 64 recently delivered women (within 8 weeks of delivery) per week to collect process data on CBSV visits including coverage, assessments, referrals and compliance with referrals including its timing, facilities used and care received. From August 2009, these data were collected from all women at the first surveillance visit after birth. In total, 4006 women in the Newhints zones were interviewed within 8 weeks after the birth.
Assessment quality checks
With the DOS form, the supervisors (DiPS) recorded the findings of the CBSVs' newborn assessment and their own independent findings during the observation of the CBSV home visits. In July 2009, the DiPS validated the results by comparing outcome of each DiPS' assessment of four babies to an independent assessment conducted by the study clinician (AM) and this took place in the four main hospitals in Kintampo, Nkoranza, Techiman and Wenchi.
In-depth interviews on perceptions and experiences with CBSV assessments, referrals and treatment at the health facility were conducted by the lead author (AM) with 55 recently delivered women whose babies were referred (up to 4 months after birth); purposively selected from the surveillance database to reflect balance with respect to maternal age, rural/urban residence, ethnicity and parity. IDIs on similar topics were also conducted with 21 CBSVs who referred babies, purposively selected to obtain balance on age, gender and place of residence and 15 health facility staff (2 front-desk staff, 10 nurses/midwives, 3 doctors including a paediatrician) from the 4 main hospitals. IDIs were either in the local (Akan) language (women and CBSVs) or English (facility staff). They lasted 60–90 min and were digitally recorded; notes on interview settings were also made.
Statistical analyses were carried out using Stata V.11.2 (StataCorp. Stata Statistical Software: Release 11.2. College Station, Texas, USA: StataCorp; 2009). Principal components analysis was conducted on the assets inventory to generate a wealth index, which was used to divide mothers into socioeconomic status quintiles (SEQs). Simple tabulations and cross tabulations were carried out for the outcomes by key maternal (education, place of residence, SEQ), newborn (sex) and other factors (visited by the 2nd day after delivery, issuance of referral card) specific to Newhints. Percentage agreements and κ statistics were estimated for agreement between CBSVs and DiPS and between DiPS and clinician assessments. Generalised estimating equations with a log link function were used to estimate the risk ratios of care seeking by SEQs adjusted for clustering, together with 95% CIs.
Recordings from the IDIs together with the field notes were transcribed into English and exported into NVIVO V.9.2 (QSR International Pty Ltd. NVivo qualitative data analysis software: Version 9; 2010) for analysis. Analysis involved multiple reading of the transcripts to familiarise with the data, generation of themes (codes), systematic coding and interpretation of text, language, trends and relationships.
Newhints and this evaluation received ethical approvals from London School of Hygiene & Tropical Medicine and Kintampo Health Research Centre. Newhints is registered at clinicaltrials.gov(number=NCT00623337).
Almost 70% of 4006 recently delivered women in the process evaluation subsample reported receiving a postnatal visit from their CBSV, and at these visits, almost all CBSVs assessed babies for danger signs (table 2). The quality of assessments was also high; CBSVs achieved near-perfect agreement with the supervisors (κ=0.85–1.00), who in turn agreed almost perfectly with the study clinician (κ>0.9).
Referral of sick newborns
Of 2795 babies assessed at postnatal visits, 279 (10.0%) had danger signs and were referred for facility care; compliance with these referrals was high with 240 (86.0%) taken to a health facility (table 2). The poorest families complied better than the least poor (figure 3), with an average 88.4% compliance among the four lower quintiles (Q1–Q4) compared with 69.7% compliance among the least poor (Q5) (p=0.003). Although rural families complied marginally more than urban ones, they did so less quickly (figure 4). Their compliance within 1 hour after referral was less than half the level of their urban counterparts (p=0.007). This slower compliance persisted until after the second day. Maternal education did not affect compliance: more than 85% of mothers across all educational levels (primary, secondary or higher) and similar among those with/without formal education (86.4% vs 85.9%; p=0.91).
‘a baby you have just given birth to who is ‘kitikiti’ (very small) and is being said to have these problems; it is not an easy thing. We thought if we did not go, something bad might happen to the baby,’ [35-year-old mother who complied with referral]
In-depth interviews with non-compliers identified the family's perception that their baby was not severely ill and would improve spontaneously as the commonest reason for non-compliance. Unfortunately, some babies died as a result:
‘I thought this was not my first time of having a baby so when he said my baby's breathing was “high”, I ignored his advice; If I had listened, probably my child would be alive; the younger girls who listened to his advice have their babies now’ [35-year-old mother of three]
CBSVs advised families to go straight to hospitals, and the majority (74.0%) did so; this was higher among urban families than rural (p=0.01). Apart from hospitals, urban residents next patronised clinics (including privately owned facilities) whereas rural residents went to health centres (table 3). Eighteen per cent of babies whose mothers complied with referral were admitted to facilities; this represents 15% of all referred babies, including the non-compliers ; all admissions except one were to hospitals. Admission rates tended to be higher for babies from lower compared with higher SEQs (figure 3) and from rural compared with urban families (17.8% vs 14.3%; p=0.7).
About one in four babies were sent home without treatment (table 4). This was most likely to occur at clinics; 8 (44%) of the 18 babies sent there were not treated. IDIs revealed that some babies had died after contacts with health facilities and being sent home without treatment; for instance 4 of the 32 who went to hospitals and were sent home without treatment subsequently died:
‘…I was sad about the way they handled our case because the way the CBSV stressed that I should go to the hospital, I thought he (health professional) was also going to, at least, count the breaths and check everything again to see if there was any problem; but he did not do anything. They did not treat the baby well.’ (20-year-old single mother)
Care seeking for severely ill newborns
Table 5 and figure 5 show care seeking for babies considered to be severely ill by the mothers. At baseline, there was no difference in care seeking for sick newborns between Newhints and control zones. Care seeking was higher among urban than rural families and increased with increasing SEQ. Post Newhints implementation, care-seeking rates in the control zones were very similar to those at baseline. In contrast, care-seeking rates were 43% higher (95% CI 18% to 72%; p<0.0001) in Newhints compared with control zones with the largest increases occurring among the poorest (Q1); care seeking was increased by 94% (95% CI of increase=32% to 184%; p=0.001) by families from the poorest SEQ. As can be seen from figure 5, these increases occurred predominantly among rural and not urban families.
Information on both care-seeking and CBSV assessments was available for a subsample of mothers who provided data for process evaluation. This included 60 of the 132 babies in the Newhints zones perceived as severely ill, of whom 27 had been referred by CBSVs and 33 had been independently recognised as being severely ill. The care-seeking rates for the two groups were similar, 88.9% and 84.8%, respectively.
The results of this study show that with adequate training and support, CBSVs were able to identify sick newborns and facilitate compliance to referral even in an area where the majority of families rely on subsistence agriculture and have poor access to care. Newhints substantially increased sick newborn access to facility care; CBSV referrals elicited 86.0% (95% CI 81.4% to 89.9%) compliance (unequalled in any previous community newborn intervention) which was prompt and mainly to hospitals. Families' overall care seeking for severe newborn illnesses increased from 55.4% in control zones (similar to baseline levels) to 77.3% within Newhints zones. This increased sick newborn access to care was pro-poor with referral compliance and care seeking higher among the poorest (or rural residents) compared with the least poor (or urban residents).
Prerequisites for success of such interventions are assessments being carried out, on time and accurately. Families should also be convinced to take sick newborns for care when asked. With only 14 months of implementation, Newhints achieved 70% postnatal visit coverage which compares with 73% attained in the Projahnmo-2 trial (Bangladesh)28—one of the highest attained in a community newborn CRT—although the latter only attained this in the third year of implementation. Assessment coverage in Newhints was almost universal (more than 95%) and of high quality.
Newhints reduced all-cause neonatal mortality (NMR) by a modest and non-significant 9%; post-day 1 NMR for singleton babies was reduced by 41% (2–65%, p=0.04)25 in the 7 months after improved implementation strategies were introduced. Given the high rates of compliance with referrals and the subsequent dramatic care-seeking differences between intervention and control zones, improved sick newborn access to care could have been a large contributor to any mortality reductions.
Newhints impact on access to care for sick newborns, in the short duration of implementation, was maximal among the poorest and rural families compared with the least poor and urban. This is contrary to predictions of the inverse equity hypothesis29 that, in the short term, the impact of such interventions will be maximal among the least poor compared with the poorest. Several reasons could explain the pro-poor results: Newhints was specifically designed to be pro-poor by using existing CBSVs selected and living with community members. In rural settings more than urban, community cohesion is likely to be high and hence CBSV awareness and acceptability of CBSV assessments and referrals may be higher. Geographical distance contributed to delays in care seeking but did not prevent compliance of rural families despite the main hospitals (the preferred care-seeking destination) being located in urban areas.
Directly observed assessments as implemented in Newhints supervision were liable to the Hawthorne effect where volunteers may want to impress supervisors with their assessment skills. This supervisory approach had the advantage of directly reinforcing volunteer assessment skills and confidence but the quality of CBSV assessment may be an overestimate. In previous validation studies,13 ,30 ,31 physician assessments lagged behind CHWs' and since newborn danger signs such as breathing rate or chest indrawing can change rapidly,28 the validity of comparisons remain questionable. Independent confirmation of referral compliance and care seeking was not feasible: Newhints was not able to be present at facilities to record care seeking and facility recordkeeping was poor with babies sent home without treatment having no contact records.
The Newhints referral process has potential for low specificity as newborns were referred to hospitals when any danger sign was present including signs of local infections. This may increase hospital workload (admissions and bed occupancy), costs and possibly has an impact on quality of care delivered. However, newborn care experts advise prompt care seeking at facilities on the slightest suspicion of infection.32 Again, it may be cost-effective treating early disease (requiring minimal resources) to achieve better outcomes than severe disease. Moreover, it would be difficult for programmes to selectively reduce inappropriate care seeking without affecting appropriate ones.33 The feasibility and adequacy of referring local infections to lower level facilities or training volunteers in their management should be explored in African settings.
Duality of expert opinions for community-based management of sick newborn persists; some are in favour of community-based treatment while others warn about the possibility of developing drug resistance.34 Studies in Asia successfully implemented home-based antibiotic treatment but subsequent referral of severely ill newborns elicited very low and often delayed compliance,20 ,22 ,35–39 with poor subsequent independent care seeking for newborn illnesses.13 ,28 In settings where access to health facilities is low, community treatment may be crucial to improve newborn survival. However, this may require more complex algorithms than those used in Newhints and so may be more difficult to implement at scale. Furthermore, if CHWs treat rather than refer sick babies, this may appear to undermine messages that care seeking at health facilities is important when families perceive their babies to be ill in the absence of the CHW.
In spite of the increased access to care for sick newborns, Newhints achieved only modest reductions in NMR.25 Substantial delays at health facilities before first health worker contact, lack of requisite examination before sending babies back home without treatment, some of whom subsequently died, raised questions about the quality of health facility newborn care in the Newhints trial area. A subsequent assessment of newborn care in facilities within the trial area confirmed that despite the Newhints-facilitated ENC training, quality was poor.40 Quality newborn care at facilities is an imperative if community assessment and referral of sick babies is to succeed in saving newborn lives.8 Furthermore, if high quality is not guaranteed, it may fuel community mistrust in health services for newborns and impact adversely on care-seeking practices. Sri Lanka reduced neonatal mortality from 75.5 (1945) to 12.9 (1991) only through coupling high-care seeking with good quality and accessible healthcare.33
In conclusion, the Newhints trial provides evidence showing that implementing community volunteer-facilitated referral at scale within health system settings in sub-Saharan Africa is feasible and potentially pro-poor. It has demonstrated that home visits by community volunteers are an effective approach, at scale, for improving access to care for sick newborns. Harnessing the potential of CBSVs to link communities to health facilities through facilitated referrals is feasible, acceptable and pro-poor but must be matched with improved quality of newborn care within health facilities.
The authors express their gratitude to the management and staff of the Kintampo Health Research Centre and the London School for the various ways they contributed to make this study a success particularly Angela Vega, the administrator. They also thank the Commonwealth Scholarship Secretariat for supporting the corresponding author on a scholarship to complete this work. They also extend their thanks to the leaders and people in the seven districts of the Brong-Ahafo Region of Ghana where this work was conducted.
Contributors The paper was drafted by AM, and reviewed and approved by all authors. BRK, AM, CT-A, SO-A and ZH were responsible for the design of the Newhints trial. AM, ZH, AHtA, CT-A and BRK were responsible for the data collection instruments. AHtA, AM, CT-A, BW, TG, SS and SO-A were responsible for Newhints trial conduct. AM, SD, SAE, SS, BRK and AHtA were responsible for database design and management; and AM for carrying out the analyses.
Funding The Newhints Home Visits CRT was funded by the WHO; Save the Children's Saving Newborn Lives programme from The Bill & Melinda Gates Foundation and UK Department for International Development. Funders had no role in data collection, data analysis or in the writing of the manuscript. The corresponding author had full access to all data and, together with the last author, the final responsibility to submit for publication.
Competing interests None declared.
Patient consent Obtained.
Ethics approval Ethics Review Committees of the World Health Organisation, London School of Hygiene and Tropical Medicine & Kintampo Health Research Centre.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.