Article Text

Download PDFPDF

Systematic review of interventions for improving the performance of community health workers in low-income and middle-income countries
  1. Madeleine Ballard1,
  2. Paul Montgomery2
  1. 1 Centre for Evidence-Based Intervention, University of Oxford, Oxford, UK
  2. 2 Department of Social Policy and Social Work, University of Birmingham, Birmingham, UK
  1. Correspondence to Madeleine Ballard; madeleine.ballard{at}gmail.com

Abstract

Objective To systematically review and critically appraise the evidence for the effects of interventions to improve the performance of community health workers (CHWs) for community-based primary healthcare in low- and middle-income countries.

Design Systematic review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

Methods 19 electronic databases were searched with a highly sensitive prespecified strategy and the grey literature examined, completed July 2016. Randomised controlled trials evaluating interventions to improve CHW performance in low- and middle-income countries were included and appraised for risk of bias. Outcomes were biological and behavioural patient outcomes (primary), use of health services, quality of care provided by CHWs and CHW retention (secondary).

Results Two reviewers screened 8082 records; 14 evaluations were included. Due to heterogeneity and lack of clear outcome data, no meta-analysis was conducted. Results were presented in a narrative summary. The review found one study showing no effect on the biological outcomes of interest, though these moderate quality data may not be indicative of all biological outcomes. It also found moderate quality evidence of the efficacy of performance improvement interventions for (1) improving behavioural outcomes for patients, (2) improving use of services by increasing the absolute number of patients who access services and, perhaps, better identifying those who would benefit from such services and (3) improving CHW quality of care in terms of upstream measures like completion of prescribed activities and downstream measures like adherence to treatment protocols. Nearly half of studies were compound interventions, making it difficult to isolate the effects of individual performance improvement intervention components, though four specific strategies pertaining to recruitment, supervision, incentivisation and equipment were identified.

Conclusions Variations in recruitment, supervision, incentivisation and equipment may improve CHW performance. Practitioners should, however, assess the relevance and feasibility of these strategies in their health setting prior to implementation. Component selection experiments on a greater range of interventions to improve performance ought to be conducted.

  • Community health workers
  • lay health workers
  • supervision
  • incentives
  • recruitment
  • training
  • systematic review
  • human resources for health

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • This is the first systematic review of interventions for improving the performance of community health workers that conducts risk of bias assessment, assessment of the quality of the body of evidence and follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

  • The review strengths include its prespecified, systematic and highly sensitive search strategy; inclusion of published and unpublished literature and inclusion of only the most rigorous evidence.

  • Though the review has carefully specified the inclusion criteria in keeping with previous studies, there is no widely accepted definition for this cadre of health worker and so some exclusions may be debated.

  • Poor reporting and non-response from contacted authors meant it was not possible to obtain some relevant missing data on methodological characteristics, clinical characteristics and outcomes for some trials.

  • Given mounting pressure to meet ambitious new international health goals and avoid repeating the mistakes of large-scale CHW programme of the past, the review is timely.

Introduction

Community health workers (CHWs)—lay workers to whom simple medical procedures can be ‘task shifted’ from higher level medical providers (eg, nurses, doctors)—were widely promoted as a means to provide primary healthcare in resource poor settings as early as the 1978 Alma-Ata Declaration.1 A series of reviews in the late 1980s and early 1990s, however, found that large-scale CHW programme often failed to replicate the success of smaller community-based programmes.2–7

Rigorous evidence has since accumulated on the efficacy of CHWs to deliver assorted health interventions8–11 and—prompted by the failure to meet the health-related Millennium Development Goals12 13 and a continuing global health worker shortage that imperils the new Sustainable Development Goals (SDGs)14—CHWs have once again been proposed as a way to extend services to hard-to-reach populations in remote areas.15–19

The most recent evaluations of national-scale CHW programmes, however, remain unfavourable.20–22 Yet, it is difficult to assess on the basis of such evaluations whether a given CHW programme did not achieve a statistically significant effect because (1) such programme do not work, (2) the CHW programme was not implemented properly (type III error) or (3) the CHW programme design was not yet optimised to achieve maximum effect (eg, via the best or most efficient combination and dose of intervention components).23–26 Given that qualitative assessments suggest that poor outcomes are associated with suboptimal programme design,2 27–30 a systematic review of studies disaggregating the effect of individual intervention components could help improve programme design in future.24

While history has demonstrated that broad contextual factors related to the health system or the political and economic climate can have an impact on CHW performance,31 this review is focused on how modifications to aspects of the delivery mechanism itself—namely, CHW programme components (eg, recruitment, supervision)—can be used to optimise CHW performance.

Methods

Inclusion criteria

Randomisation allows the effects of particular programme components to be isolated; this is a critical step in intervention optimisation and the goal of this review (see protocol in online supplementary appendix A).24 Because health workforce outcomes are empirically testable and workplace interventions possible to randomise, eligible trials were randomised controlled trials (RCTs), cluster-randomised trials, cross-over trials and factorial trials. Studies were only included where the primary objective, or one of the primary objectives, was to determine the efficacy or effectiveness of an intervention to improve the performance of CHWs. This includes ‘head-to-head’ comparison studies of CHWs engaging in the same task (eg, providing antiretroviral therapy (ART) adherence support) in the context of different programme designs (eg, more or less supervision) that have to date been excluded from reviews of CHW effectiveness (eg, 10).

Supplemental material

Several definitions for and variants of the term CHW have been employed in the literature. For the purpose of this review, CHWs were defined as: any lay health workers who (1) live in the catchment they serve, (2) are primarily based in the community (as opposed to a health facility), (3) belong to the formal health system (ie, are managed by the government or an implementing non-governmental organisation), (d) perform tasks related to healthcare delivery and (e) have received organised training but have no formal or paraprofessional certification or tertiary education degree.10 32 Aside from residence in a low- or middle-income country (LMIC) as classified by The World Bank Group (listed in online supplementary appendix B), there were no restrictions on the types of patients for whom data were extracted.

Any intervention designed to improve CHW performance, compared with CHWs who did not experience the intervention, was included. Studies that were designed to examine the efficacy of a particular therapy (eg, zinc tablets for diarrhoea), as opposed to the relative effectiveness of different ways of designing programme that support CHWs to deliver said therapy were excluded. Interventions of any duration or follow-up were included.

A number of processes and outcomes might be affected by interventions that aim to improve the performance of CHWs. Outcomes were extracted and categorised as biological and behavioural patient outcomes (primary), use of health services, quality of care provided by CHWs, and CHW retention (secondary). Outcomes of interest and study quality were not used as criterion for screening studies.

Search strategy

A comprehensive search strategy was used to identify all relevant studies regardless of language, year, or publication status (published, unpublished, in press and in progress). We searched:

  1. 3ie Impact Evaluation Database

  2. Allied and Complementary Medicine Database

  3. BiblioMap

  4. British Library for Development Studies at IDS

  5. Cumulative Index to Nursing and Allied Health Literature

  6. Central Register of Controlled Trials 

  7. Database of Promoting Health Effectiveness Reviews

  8. Embase

  9. Global Health

  10. IDEAS/RePEc: Economics and Finance Research Database

  11. Innovations for Poverty Action Database

  12. Databases within Institute for Scientific Information Web of Science

  13. JOLIS World Bank-International Monetary Fund Library

  14. Abdul Latif Jameel Poverty Action Lab Evaluations Database

  15. Medline

  16. Medline in-process and other non-indexed citations

  17. Population Information Online

  18. PubMed

  19. World Bank Independent Evaluation Group

  20. WHO Library Database

The following strategy was refined in consultation with an information specialist and used to search Medline. To maximise sensitivity, no randomisation filter was included.33 (Precise dates of coverage, date last searched, search strategies used for the databases listed above, and details of other resources searched, including the grey literature, can be found in online supplementary appendix C).

  1. ((community or village) adj2 (agent$ or aid$ or promot$ or mobili?er$ ordistribut?r$ or worker$)).ti,ot,ab,kf.

  2. ((village or rural or lay or lady or nutrition or frontline or barangay or basic or auxiliary$ or extension) adj2 (worker$ or volunteer$)).ti,ot,ab,kf.

  3. (accompanier$ or accompagnateur$ or activista$ OR animatrice$ ORbrigadista$ or kader$ or monitora$ or promotora$ or sevika$ or fhw$ orchw$ or lhw$ or vhw$ OR chv$ or "shastho shebika" or "shasto karmis" oranganwadi$ or "barefoot doctor" OR "agente comunitario de salud" or "agentecommunitario de saude").ti,ot,ab,kf.

  4. (performance or effective$ or skill$).ti,ot,ab,kf.

  5. 1 or 2 or 3

  6. 5 and 6

Searches were conducted 4 May 2014 and updated ending 12 July 2016.

Data collection and analysis

Two authors independently screened titles, abstracts and full-text articles. Included articles were determined by consensus. The extraction sheet was informed by the Cochrane Effective Practice and Organisation of Care Group data collection checklist,34 the Template for Intervention Description and Replication35 and the Oxford Implementation Index36 (see online supplementary appendix D). Reviewers extracted data on study design, participants, interventions, outcomes and methodological quality.

Risk of bias for all RCTs was assessed using The Cochrane Collaboration’s tool for evaluating the risk of bias.37 The quality of evidence across a body of evidence (ie, multiple studies with similar interventions and outcomes) was assessed using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach.38 These assessments are made with the caveat that—as had been noted elsewhere39–41—there are issues with the applicability, reproducibility and clarity of GRADE in the field of public health and with complex interventions.

Cluster-randomised trials were verified to ensure appropriate analysis had been done (ie, adjustment for clustering); if such an analysis had not been done, the necessary intracluster correlation coefficients (ICCs) were extracted or obtained from the investigators and results reanalysed.39 All comparisons from factorial studies were included.

Results

Characteristics of included studies

Excluding duplicates, a total of 8082 records were screened for inclusion (figure 1). A total of 12 records reporting 14 studies were included.42–53 Complete information for each trial is provided (online supplementary appendix E); study characteristics are described in table 1.35 Information on excluded, ongoing and studies awaiting classification is provided in online supplementary appendix F.

Figure 1

PRISMA study flow diagram. CHW, community health workers; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; RCT, randomised controlled trials.

Table 1

Brief study characteristics

Ten countries were represented: Bangladesh, Ethiopia, Guatemala, India (2), Mali, Pakistan (2), Paraguay, Uganda, Tanzania (3), and Zambia. Three trials evaluated supervision interventions (43ABC), two incentive interventions,46 53 two equipment interventions,42 44 one a recruitment intervention,52 one a training intervention45 and five ‘compound’ interventions altering more than one programme component.47–51 No information about implementation fidelity—that is, whether an intervention is delivered as intended by the developers—was provided.23 36 The reporting of CHW and patient characteristics and contextual factors was poor. Assessments of the risk of bias for included studies are included in online supplementary appendix A and are considered when assessing the findings.

Effects of interventions

Results are presented in a structured summary.36 Where possible, standardised measures of effect (risk ratio (RR), standardised mean (SMD)) have been provided to aid comparison. Due to missing data, multiple outcome measures were not possible to standardise and are reported as in the original trial papers. Although six authors were contacted regarding missing data, none were able to supply it. The protocol for this review (see online supplementary appendix A) specified that a meta-analysis would be conducted if appropriate. Meta-analysis would, however, be uninformative due to heterogeneity and lack of clear outcome data.

Five studies examined the review’s primary outcomes (43BC, 47–49) and nine studies examined secondary outcomes (42, 43A, 44–47, 50–52).

Primary outcomes

The primary outcomes specified in the protocol were objective physical outcomes for patients and subjective health outcomes for patients (table 2). Overall, these studies suggest that CHW performance improvement interventions can improve certain behavioural, but not biological, outcomes for patients. The body of evidence for behavioural outcomes for patients was graded moderate (downgraded for design and implementation as allocation concealment and random sequence generation were unclear in the majority of studies) as was the evidence of no effect for biological outcomes (downgraded for design and consistency as the result is based on only one study that may be underpowered). The data for both outcomes are considered in detail below.

Table 2

Primary outcomes

Only one study reported biological outcomes for patients,48 finding no significant differences in HIV patients’ cumulative risk of virological failure (RR=1.17, 95% CI 0.84 to 1.64, p=0.34) or mortality (RR=0.82, 95% CI 0.55 to 1.22, p=0.33).

Six studies reported behavioural outcomes for patients: Bossuroy53 found no significant difference in patient tuberculosis (TB) default rates (B=−0.04, SE=0.06, p=0.25), though CHWs were incentivised based on treatment adherence. Chang48 found no significant differences in HIV patients’ <95% pill count adherence (RR=1.01, 95% CI 0.97 to 1.06, p=0.59) or loss to follow-up (RR=1.29, 95% CI 0.50 to 13.32, p=0.60). Omer47 found that pregnant women in intervention communities were more likely to attend at least one prenatal check-up (RR=1.94, 95% CI 1.56 to 2.41, p<0.0001), give colostrum to their newborn babies (RR=1.21, 95% CI 1.12 to 1.32, p<0.0001) and maintain exclusive breastfeeding for 4 months but equally likely to stop routine heavy work.i No quantitative data were provided for the latter two outcomes. Winch49 found that the proportion of malarial children treated exactly per IMCI norms was significantly higher in the intervention group than the control group (RR=27.76, 95% CI 0.53 to 1441.23, p<0.0001). DeRenzi (43B) found that the mean number of days patients were overdue at the clinic was lower in the intervention than the control group (U=271.00, p<0.001, r=0.50). In DeRenzi (43C), control CHWs who had been in the short messaging service (SMS)+Supervision group during DeRenzi (43B) performed worse relative to those who continued to receive SMS+Supervision (U=68.00, p=0.023, r=0.340). The performance of CHWs who had been in the control group during DeRenzi (43B) improved; however, no statistically significant difference was found between the SMS+Supervision and SMS-only groups (U=101.00, p=0.880, r=0.043).

Secondary outcomes

Secondary outcomes were use of health services, quality of care provided by CHWs and CHW retention (table 3). Overall, these studies suggest that CHW performance interventions can improve use of services by increasing the absolute number of patients who attend the health centre and, possibly, by better identifying those who would benefit from such services. They also suggest that such interventions can improve CHW quality of care in terms of upstream measures like completion of prescribed activities and downstream measures like adherence to treatment protocols and observed differences in the calibre of care provided. The body of evidence for both outcomes was graded moderate (downgraded for design and implementation as allocation concealment, random sequence generation and blinding of assessors was unclear in the majority of studies; quality of care downgraded for design and implementation as allocation concealment, random sequence generation and blinding of assessors were unclear in the majority of studies).

Table 3

Secondary outcomes

No studies reported on CHW retention or adverse events. Though cost was not prespecified in the review protocol as a variable about which information would be collected, it is important in assessing the relative merits of various combinations of inputs to improve CHW performance and so it is reported in online supplementary appendix H. The data for use and quality of care is considered in detail below.

Four studies reported on use; three examined the effect of CHW performance interventions on closed referrals (43A, 44, 49) and one on use more generally.52 Winch49 found no difference in the rate of compliance with referral to the health centre among intervention or control patients (RR=0.78, 95% 0.57 to 1.07, p=0.13) but that patients in the intervention group were nearly four times more likely to be referred than those in the control group (RR=3.76, 95% CI 2.25 to 6.28, p<0.0001). Ginsburg44 found similar results: while women in intervention arm B (smart phones plus patient navigation) were significantly more likely to attend for care versus women in intervention arm A (smart phones without navigation; 63% vs 43%, p<0.0001), adherence in the two intervention arms combined was the same (53%) as that of the control arm. Control arm CHWs interviewed fewer women than CHWs in either of the two intervention arms, however, and the proportion of study participants found to have an abnormal clinical breast exam was more than three times greater in the intervention arms (IA=3.1%, IB=3.2%) than the control arm (1.0%) (p<0.0001). DeRenzi (43A), by contrast, found a large but statistically insignificant increase in the mean percentage of closed referrals in the intervention group (SMD=0.86, 95% CI −0.30 to 2.03), though a methodological limitation of the trial may explain much of the difference. Ashraf52 found the intervention increased the number of women giving birth at the health centre by 31% (n=1269 patients, B=14.68, SE=6.32, p=0.01), the number of children under five undergoing health checks by 24% (n=1618 patients, B=318.1, SE=98.05, p<0.001), the number of children under five being weighed by 23% (n=1610 patients, B=284.3, SE=110.2, p=0.005) and number of children under one receiving immunisation against polio by 20% (n=1530 patients, B=14.98, SE=4.803, p<0.001). No statistically significant difference was seen in the number of postnatal (0–6 week) visits, children under 1 year receiving bacille Calmette-Guerin (BCG) vaccinations and children under one receiving measles vaccinations.

Eight studies reported on CHW quality of care using a range of measures.42 45 46 49–53 Four trials reported on CHWs completing51–53 or having the knowledge necessary to complete45 prescribed activities. Ayele51 calculated the scores for the 13 CHW government-set activities (eg, home visits, referrals), finding that 10 of 13 activity scores (similar at baseline, maximum score not stated, p<0.05) and composite functional status score (p<0.0001) were significantly higher among intervention group CHWs. Though the composite functional status score was defined as the sum of the 13 activity scores, this is not the case. The authors of the paper were contacted but were unable to supply clarifying data. Ashraf52 found that CHWs recruited with career possibilities salient conduct 29% more household visits (B=93.95, SE=37.19, p=0.006) and organise over twice as many community meetings (43 vs 22, B=17.06, SE=5.220, p<0.001) than those recruited with community benefits salient, while the difference in the number of patients seen at the health post is also positive but not significant (B=31.79, SE=260.4, p=0.45). Bossuroy53 found that, on average, the number of new TB detections increased by 2.18 (33.2%) each month among intervention CHWs during the period they were incentivised based on case detection (B=2.18, SE=0.95, p=0.01). The number of defaults, however, was significantly larger among intervention CHWs during this period (B=0.08, SE=0.04, p=0.02). Bailey45 found that CHWs in the intervention group demonstrated a significantly greater ability to correctly diagnose diarrhoea of varying type and severity (I=77.3%, C=43.1%, p<0.05). Though non-significant differences favouring the intervention group were found in CHWs’ diarrhoea knowledge, referral recommendations and treatment practices.

Two studies reported on treatment protocol compliance.42 49 Winch49 found that intervention CHWs were significantly more likely to appropriately administer drugs (RR=1.45, 95% CI 0.99 to 2.13, p=0.04). The study also reported that more intervention CHWs (58.9%) sold the correct amount of medication than control CHWs (48.1%). Using the ICC provided (0.210), an RR was approximated (RR=1.22, 95% CI 0.69 to 2.18, p=0.47). The p value calculated by the authors (p=0.042) indicates statistical significance; emails attempting to resolve the discrepancy received no response. Gautham42 calculated mean protocol adherence for the intervention and control groups across a variety of stratifications of interest. The intervention group exhibited greater protocol compliance across patient order and across sexes than the control group, though the initial protocol compliance superiority of the intervention group diminished over time. Authors were contacted for the unstratified mean protocol compliance scores but were not able to provide them.

Two trials reported on observed differences in care provided.46 50 Carrón50 found quality of care provided improved in all four groups (p<0.05). The largest quality gain was observed in CHWs who received the decision tree, though differences between groups were not statistically significant. Measures of variability were not reported. Andreoni46 found that, when outliers were excluded, CHWs who receive tailored contracts were one-third closer to the policy objective than their untailored counterparts (SMD=−0.32, 95% CI −0.54 to −0.1) with an even greater effect for day-of allocation (B=0.130, SE=0.037, p<0.001).

Discussion

Summary of main results

This review identified 14 trials evaluating the effects of interventions for improving the performance of CHWs for community-based primary healthcare in LMICs. A structured summary laid out moderate quality evidence of the efficacy of CHW performance interventions in (1) improving certain behavioural outcomes for patients, (2) improving use of services by increasing the absolute number of patients who attend the health centre and, possibly, by better identifying those who would benefit from such services and (3) improving CHW quality of care in terms of upstream measures like completion of prescribed activities and downstream measures like adherence to treatment protocols and observed differences in the calibre of care provided (eg, technical competence). The evidence for biological outcomes was assessed as moderate quality, though the lack of effect on virological failure and mortality may not be indicative of all possible biological outcomes. None of the studies included in this review reported on possible adverse effects of these interventions, either to patients, CHWs or the health system. The heterogeneity and poor reporting of included studies precluded meta-analysis. Evidence is insufficient to draw conclusions regarding the effects of such interventions on retention or to specify which performance improvement intervention strategies are likely to be most effective. Furthermore, the nearly half of studies were compound interventions, making it difficult to isolate the effects of individual performance improvement intervention components.

That said, there is moderate quality evidence that the following practices improve behavioural outcomes for patients, use of services and/or CHW quality of care: (1) when recruiting CHWs, emphasising career possibilities rather than benefits to the community52; (2) when supervising CHWs, providing escalating reminders for tasks that are overdue and following-up with underperforming CHWs (43ABC); (3) when incentivising CHWs, tailoring incentives to measure individual preferences—but only for CHWs performing a single repetitive task, not for CHWs who must perform multiple or more complex tasks46 53 and (4) when equipping CHWs, using mobile phone-based procedural guidance applications.42 44 These four strategies ought to be interpreted with caution, however, for reasons discussed in the following two sections.

Internal validity and implications for research

Methodological quality of the 14  included studies was difficult to assess due to incomplete reporting of key methodological and clinical features; contacting the trialists did not always yield sufficient additional information to make such judgements. Missing data and unit of analysis problems made the size47 and precision49–51 of several outcomes difficult to ascertain.

The selection and validity of outcome measures is also a concern across studies. For example, several measurement instruments were employed to assess ‘quality of care.’ Some were more valid than others: the ‘functional status score’ employed in Ayele,51 for example, measures activity, not quality—the two are not the same and should not be confused. Similarly, while Winch49 and Omer47 relied on patient report to assess the impact of CHWs, more rigorous, direct assessments of performance—like the service tests used by Carrón50 and Gautham42—paired with biological measures would have been preferable. In future, trials should provide information about implementation fidelity. The lack of consensus building efforts on metrics to CHW performance improvement is a hindrance to the accumulation of knowledge in this area.

Additionally, these interventions may have produced a Hawthorne effect. A number of studies documented that existing CHWs were undersupported in their work, and the intervention is likely to have been a motivational factor (42, 43ABC). Moreover, the novelty—and in turn the effects—of such inputs may wear off over time (43ABC). Future studies would do well to adjust for the attention effect and assess the long-term effects of such interventions.

Ultimately, for health tasks where CHW delivery demonstrate benefits, the focus of new research ought to shift from assessing efficacy to optimising public health impact.24 This review found few trials on each of the hypothesised drivers of performance; component selection experiments on a greater range of interventions to improve performance ought to be conducted and used to refine existing theories of CHW performance.54 55

External validity and implications for practice

Several factors limit the applicability of these results.56 Diverse outcomes across studies meant there were few data for each outcome of interest and multiple studies42 43 were underpowered to detect meaningful clinical difference. Because no studies reported adverse effects, it is difficult to draw conclusions regarding the trade-off between benefits and harms.57

Similarly, trials often failed to report relevant information regarding context. This is true both of the cultural context in which CHWs operate and CHW programme components (eg, recruitment, incentivisation, etc) that remained unmodified in the interventions.

The following factors about a potential implementation setting ought to be considered by decision-makers when assessing potential programme-level performance improvement interventions10 57:

  1. Whether there are important differences in health system arrangements that may alter the feasibility and acceptability of the given intervention. For example, in Zambia,52 CHWs are part of the civil service and so eligible for government sponsored ‘in-service training.’ In countries where CHW programme are less well resourced, it would not be possible to emphasise career advancement possibilities during recruitment.

  2. Whether there are important differences in environmental conditions or other on-the-ground realities between where the studies were conducted and the implementation setting. Equipping CHWs with mobile phone-based guidance42 44 would not be possible in remote areas without mobile phone reception. Similarly, a supervision system premised on following-up with underperforming CHWs (43ABC) is impossible without a system to track CHW performance in the first place.

  3. Whether there are important differences in the baseline health conditions between where the studies were done and the implementation setting. For example, tailoring of incentives46 worked well for a programme in which CHWs had a single categorical objective that only required one repetitive behaviour. Where CHWs have more complex objectives that require multiple behaviours performance-based incentives may distort behaviour in unintended and undesirable ways,58 for example, in Bossuroy53 TB defaulting increased for patients of CHWs incentivised for case detection compared with patients of CHWs receiving a fixed salary.

  4. Whether studies from which evidence was drawn were conducted in settings with similar social norms. Information about, for example, whether male CHWs in the Ayele51 study faced cultural barriers working with women in the home, and so on, are examples of norms and attitudes that might have shaped intervention effects and so would be relevant to interpreting trial outcomes or exploring differential effects across settings.

  5. Whether sufficient resources exist to implement the proposed clinical and/or managerial support for CHWs to a high standard and maintain that standard over time. The extent to which these proposed performance improvement interventions depend on the presence of other programmatic or contextual preconditions is not clear from the included studies, for example, one study indicated that equipment may not be as valuable in the absence of adequate training.44

Limitations

First, RCTs on CHWs remain poorly indexed in electronic databases; it may therefore be possible that, despite the very careful and extensive searches and expert consultations, some relevant RCTs were not identified. Second, there is no widely accepted definition for this cadre of health worker. Though we have carefully specified the inclusion criteria in keeping with previous studies, there is a need for a clear taxonomy of CHW supports and activities. Third, poor reporting and non-response from contacted authors meant the reviewers were unable to obtain some relevant missing data on methodological characteristics, clinical characteristics and outcomes for some studies. Finally, though randomised trials have a unique value in intervention optimisation, exclusion of all non-randomised studies without further consideration places a zero weighting on such evidence. Updates of the systematic review should consider including rigorous non-experimental evidence.

Nevertheless, key data were available and rigorous methods have been applied throughout, including risk of bias assessments and evaluation of the quality of the evidence (see the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Checklist in online supplementary appendix I).

Previous reviews

Between the original search and the update of this review, a systematic review on intervention design factors that influence CHW performance in LMICs was published.59 Our more sensitive search strategy and focus on trials from which causal inferences can be made are important differences in approach.

Conclusion

Variations in recruitment, supervision, incentivisation and equipment may improve CHW performance. Practitioners should, however, assess the relevance and feasibility of these strategies in their health setting prior to implementation and researchers should consider conducting component selection experiments on a greater range of interventions to improve performance. Nonetheless, mounting pressure to meet ambitious new international health goals and avoid repeating mistakes of the past underscore the timeliness and relevance of these findings.

Acknowledgments

Sincere thanks to Calla Glavin for her help with study screening and data extraction.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.
  51. 51.
  52. 52.
  53. 53.
  54. 54.
  55. 55.
  56. 56.
  57. 57.
  58. 58.
  59. 59.

Footnotes

  • [1] A woman advised by a CHW to reduce routine heavy work, however, was more likely to adhere to the advice than someone who was not so advised or who was advised by others (RR=1.31, 95% CI 1.20 to 1.422, p<0.0001).

  • Twitter @mballard25

  • Contributors MB developed the study protocol with advice from PM. MB conducted the search and drafted the manuscript. With the help of Calla Glavin, MB checked eligibility criteria and conducted data extraction. All authors commented on the manuscript.

  • Funding None declared.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.