Article Text

Protocol
Vulnerability of populations to malaria after indoor residual spraying is withdrawn from areas where its use has previously been sustained: a protocol for a systematic review
  1. Philip Orishaba,
  2. Edward Kayongo,
  3. Pastan Lusiba,
  4. Caroline Nakalema,
  5. Peter Kasadha,
  6. Perez Kirya,
  7. Ismael Kawooya,
  8. Rhona Mijumbi-Deve
  1. The Centre for Rapid Evidence Synthesis (ACRES), Makerere University College of Health Sciences, Kampala, Uganda
  1. Correspondence to Philip Orishaba; orishabaphilip{at}gmail.com

Abstract

Introduction With its proven effectiveness, indoor residual spraying (IRS) as a malaria vector control strategy forms one of the reliable vector control strategies, especially when at least 80% of the population is covered. However, to date, there is uncertainty regarding the consequences of IRS withdrawal on malaria control when there is no clear exit strategy in place. Therefore, there is a need to comprehensively update literature regarding malaria burden indicators when IRS is withdrawn following sustained use.

Methods and analysis This protocol follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A systematic search of studies published between 2000 and 2022 will be performed in CINAHL, Embase, MEDLINE, ProQuest, PsychInfo, Scopus and OpenGrey. Preset eligibility criteria will be used to identify studies for inclusion by two independent reviewers. Title/abstracts will first be screened and potentially eligible ones screened using their full-text publications. Any conflicts/discrepancies at the two stages will be resolved through regular discussion sessions. Included studies will be extracted to capture study and patient characteristics and relevant outcomes (malaria incidence and malaria vector abundance). Relevant tools will be used to assess the risk of bias in the studies measuring the impact of withdrawal. A meta-analysis will be performed if sufficient homogeneity exists; otherwise, data arising will be presented using tables and by employing narrative synthesis techniques. Heterogeneity will be assessed using a combination of visual inspection of the forest plot along with consideration of the χ2 test and I2 statistic results.

Ethics and dissemination Ethics approval is not applicable for this study since no original data will be collected. The results will be disseminated through peer-reviewed publications and conference presentations. Furthermore, this systematic review will inform the design of exit strategies for IRS-based programmes in malaria-endemic areas.

PROSPERO registration number CRD42022310655.

  • Infection control
  • Epidemiology
  • Public health
  • Entomology
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • To the strength of this study, we hope to produce the first systematic review of the impact of indoor residual spraying withdrawal comprehensively.

  • Such comprehension will be defined by including studies from different settings, among different age groups and studies assessing malaria burden indicators either among human populations or mosquito populations, or both.

  • This review also uses systematic and transparent rigorous procedures guided by the Cochrane handbook and will report results as stated by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.

  • Furthermore, an experienced information specialist designed the search strategy and customised it to the different databases that we intend to search.

  • The certainty of the evidence could be limited by a few numbers of publications and low quality of studies.

Introduction

Until today, a child dies from malaria every 2 min globally.1 Malaria is the leading cause of morbidity and mortality in Uganda, accounting for 30%–50% of outpatient visits and 15%–20% of hospital admissions with more than 10 500 annual deaths.2 Furthermore, it is estimated that 11% of children under 12 months lose their lives to malaria every year.3 The Malaria Control Programme in Uganda combines several strategies, such as indoor residual spraying (IRS), long-lasting insecticide-treated nets (LLINs), and the test and treat strategy.3 Vulnerability to malaria infection has reduced over the years mainly due to these combined strategies, of which IRS is part, given its role in diminishing vector (mosquito) populations.4 The updated Uganda Malaria Reduction and Elimination Strategic Plan of 2021–2025 aims to reduce malaria infections by 50%, morbidity by 50% and mortality by 75% in 2025. IRS thus forms one of the key strategies available for mosquito control as the globe looks towards malaria elimination/eradication.

IRS first proved to be effective for malaria vector control when it was implemented using dichlorodiphenyltrichloroethane (DDT) during the global malaria eradication campaign conducted from 1955 to 1969 whereby the population at risk for malaria infection was reduced by 700 million, and malaria was eliminated from 37 countries.5 6 Having proven to be effective, IRS use was rolled out in Africa too, and the campaigns demonstrated success across a wide diversity of settings.7–10 IRS, therefore, forms one of the most reliable vector control strategies in malaria control. IRS is a highly effective vector control intervention, especially when at least 80% of the population is covered.11

IRS was reintroduced in 2006 after nearly 40 years. The IRS programme started with 10 districts in Northern Uganda known to have the highest burden but later shifted to another 14 districts in May 2014.12 Indeed, there was a substantial reduction in the malaria burden between 2007 and early 2014.13 14 Although the universal LLIN distribution campaign continued in the first 10 districts, malaria epidemics were reported following IRS withdrawal, prompting a single IRS round in response to the upsurge.15–17 However, it is not certain whether the malaria case upsurge was due to other causes or a consequence of IRS withdrawal. For example, first, the Uganda IRS programme can only cover 10% of the total population due to limited financial resources.12 Second, over the years, there has been a shift in insecticide use informed by the reported possibility of resistance to a particular class.

Indeed, not much is known about what happens when a large-scale deployment of IRS in a given area is halted even when insecticide resistance is not an issue of concern. Several formulations of insecticides for IRS have been made and approved by the WHO, and all of these are results of the classes of insecticides, that is, pyrethroids, carbamates, organophosphates, organochlorines and neonicotinoids.18

For areas that have recorded pyrethroid resistance, non-pyrethroids have been taken up to protect the benefits/effectiveness of IRS. For instance, in Northern Uganda, pyrethroids such as lambda-cyhalothrin and organochlorides such as DDT were used for the first time in 2007. However, due to reports of pyrethroids resistance, policymakers shifted to carbamates and/or organophosphates.19 The first case of malaria resurgence was recorded in some areas in 1960 following the discontinuation of the global malaria eradication campaigns, whereby some resurgence case scenarios elicited terrific epidemics that called for repeated rounds of IRS.10 Northern Uganda in particular recorded a malaria epidemic and case upsurges following the withdrawal of IRS from malaria-endemic districts.15 19

No systematic reviews or meta-analyses have aimed to summarise the evidence related to withdrawing IRS from malaria-endemic areas. There is a need to provide a comprehensive synthesis of the literature to enhance the current knowledge on malaria control indices related to IRS withdrawal as relevant studies have been conducted in recent years. Our aim is therefore to conduct a systematic review to identify evidence to demonstrate the impact and challenges in malaria control that arise when IRS is withdrawn from malaria-endemic areas following sustained use.

Methods and analysis

This systematic review will be conducted and reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

Research questions

  1. What is the impact of withdrawing IRS on malaria control from areas of high malaria transmission intensities following sustained use?

  2. What is the duration of protection of populations after IRS is withdrawn following sustained use?

Eligibility criteria

Type of studies

Studies will be included if they include a follow-up aspect. As such, we shall exclude case series, cross-sectional surveys, case reports and case-control studies. There will be no restrictions on data type. As such, studies using primary data, secondary data or administrative data will all be included if they meet other criteria. Studies that assess the residual efficacy of the insecticides may as well be included to establish the duration of protection of populations as well as measure the duration after which mosquito populations increase following the spraying. We anticipate that some studies may report malaria burden indicator measures periodically following IRS withdrawal. For instance, researchers may measure outcome indicators monthly. Duration of protection will thus be defined as the period from the last IRS round to the time the burden indicators shift from being protective (eg, incidence rates <1 to ≥1).

Populations

We seek to include studies conducted in areas known to be endemic to malaria as well as those in areas with high malaria transmission intensities and where IRS has previously been sustained. Sustained use of IRS will be defined as consistent spraying of a household (≥2 IRS rounds which may be 4–6 months or 12 months apart depending on the insecticide used). The review will include both studies assessing malaria burden indicators either in human populations or mosquito populations, or both. There will be no restrictions on the age or group of the human population. As such, studies conducted among children under 5 years of age, school-age children, the general population and pregnant women will all be included. We will include studies from all settings, for example, community and health facilities.

Type of exposure

Eligible studies will be those assessing malaria burden indicators following withdrawal of IRS after any number of consistent spraying rounds which may be 4–6 months or 12 months apart. There are no restrictions on the reasons for withdrawing. Reasons may either be related to cost or achieving some level of malaria vector control.

Comparisons

All eligible studies will be required to have a comparison. The comparison will be estimates of malaria indicators obtained when IRS is being implemented consistently or shortly after the implementation. Such control will be labelled as the baseline, whereas the end line will be estimates obtained to represent the malaria burden when IRS will have been withdrawn. If with a justifiable reason, studies may also be included if their comparison are outcome indicators measured before IRS is ever implemented in an area.

Outcome types

Among human populations, the outcome will be the malaria burden. Malaria burden indicators will be malaria incidence, that is, incidence rates, relative risks, slide positivity rates, entomological inoculation rates (EIRs) and test positivity rates. Among the mosquito populations, the outcome will be malaria vector abundance. Malaria vector abundance indicators will be sporozoite rates and mosquito mortality rates. Studies will be included if they provide at least reasonable/sufficient data on the primary outcomes. As such, studies will be included if they assess the malaria burden indicators both during the period an IRS round is being implemented and after IRS has been withdrawn.

Information sources

A systematic search will be performed in CINAHL, Embase, MEDLINE, ProQuest, PsychInfo, Scopus as well as OpenGrey from onset until 30 April 2022 and will be updated until manuscript submission. The search strategy will be designed using medical subject headings as well as Boolean operators ‘OR’, ‘AND’ or ‘NOT’ appropriately. Customised search strategies will be performed for each database. We will also search in trial registers. In the case that a relevant conference abstract is identified, we will contact the authors to obtain a full-text article. Reference lists of included studies will be reviewed to identify any relevant additional studies.

Search strategy

A search strategy designed with comprehension will be used to locate the relevant studies published between January 2000 and April 2022. The search will be performed by an experienced information specialist. For piloting purposes, a search will be conducted in Medline and precision tested several times to yield the lowest proportion possible of irrelevant studies. The resulting search string will be applied to syntaxes of the rest of the databases where a search was performed. A search for Medline is provided as an example and will be available in online supplemental appendix 1.

The search terms used will be:

  1. Malaria or malaria, vivax or malaria, falciparum or blackwater fever or malaria, avian.

  2. Plasmodium or plasmodium ovale or plasmodium falciparum or plasmodium vivax or plasmodium malariae.

  3. Mosquito.

  4. Culicidae or anopheles or plasmodium or malaria or mosquito or marsh fever or blackwater fever or paludism.

  5. 1 OR 2 OR 3 OR 4.

  6. Control, mosquito.

  7. Control, malaria.

  8. IRS or indoor residual spray or indoor residual spraying.

  9. (6 OR 7) AND 8.

  10. 5 AND 9.

The search strategy will as well be built by an experienced information specialist. We will use 15 potentially relevant test articles to test and build the search. The 15 articles will a priori be identified using the function similar articles in PubMed and by reading references of the selected articles.

Data records and management

Following the search, study references will be exported into EndNote referencing software. A review with the name ‘IRS withdrawal’ will be set up in covidence software, an application for managing systematic literature reviews (https://app.covidence.org/reviews/active). In covidence, the EndNote references’ file will be uploaded. Following the upload, covidence will automatically identify the duplicates and resolve them. Two independent reviewers will screen the titles/abstracts and then at the full-text stage for all the identified records. In case of conflicts/discrepancies at either stage, they will be resolved through discussions in presence of a third reviewer. During the screening, reviewers will be guided by the eligibility criteria (Population, Intervention, Comparators, Outcomes, Publication year and Study design; PICOTS). At the full-text level, reviewers will record reasons for exclusion for all excluded studies.

Included studies at both title and abstract as well as a full text will undergo extraction by two independent reviewers after which a consensus will be reached by a member of the technical team of the review. Information to be extracted from the included studies will include study characteristics such as the study title, first author, year of publication, covidence ID (Identifier), study objective, DOI (Digital Object Identifier), abstract, journal name and URL (Uniform Resource Locator). About geographical information, reviewers will extract the years of sustained IRS use, years when IRS was withdrawn, any other information on IRS use in the area, continent name, country name, country income level, area’s malaria classification (burden category), region name, district name and location name. About methodological information, reviewers will extract data related to the study design, type of effect measure/measure of association used, method of analysis done, unit of analysis, overall sample size and any assumptions made for the analysis. Study participant characteristics to be extracted will include the age group under study (ie, children under 5 years of age, pregnant women, general population and school-age children), gender and any other relevant characteristics. Outcomes to be extracted will include malaria incidence and malaria vector abundance. To measure malaria incidence, incidence rates, relative risks, EIRs, slide positivity rates and test positivity rates may be extracted depending on what the studies will report. Vector abundance on the other hand will be represented by sporozoite rates or mosquito mortality rates. For studies that assess the long-time residual efficacy of insecticides, respective malaria burden indicators both during the implementation phase and after a defined period following the stoppage of the intervention will be extracted. A predefined data extraction template will be designed, piloted and published in covidence to capture all the study aspects.

Effect measures

We will report the withdrawal effects between the baseline and end line measures depending on the study reported measures. The effects may be reported as a rate ratio or a risk ratio and accompanying 95% CIs.

Risk of bias assessment

Appropriate tools will be used to assess the risk of bias for the included studies. Depending on the evidence found, the Cochrane risk of bias 220 and risk of bias in non-randomised studies of intervention tools will be used to assess the risk of bias in the studies measuring the impact of withdrawal. Characteristics will be assessed concerning sampling methods, the sample size, representativeness of the sample, reliability of the outcomes, analysis methodologies and levels of precision of the indicator measures among others. Risk of bias assessment as well will be done by the two independent reviewers. For both tools, the domains have a signalling question aiming to elicit relevant information. Responses to these questions will be scored for each domain, either the low risk of bias, some concerns or high risk of bias. The scores of each domain will then be mapped into overall risk-of-bias judgement including categories of low risk of bias, some concerns and high risk of bias.

Data synthesis and reporting

A meta-analysis will be performed if sufficient homogeneity exists.21 Otherwise, results arising from data extraction and risk of bias assessment will be presented using tables and also in form of a narrative synthesis. The main difficulty in integrating the results from various studies stems from the diverse nature of the studies, in terms of design, methods and outcome measures. In the current study, sufficient homogeneity will mean studies reporting findings from areas sprayed with a similar insecticide, same time periods of outcome assessment, same outcome measures and same study design among others. The results section will among others include a PRISMA flow diagram, a table with summarised study characteristics, a table of risk of bias assessment as well as findings of the study effect measures. Considering the expected heterogeneity, the results will be pooled using a random-effects model. We will try to minimise the heterogeneity by grouping the studies by setting based on age, the level of endemicity and transmission intensities. Investigation of remaining heterogeneity within a pooled group of studies using a combination of visual inspection of the forest plot along with consideration of the χ2 test (with statistical significance set at p<0.10) and Higgin’s statistic results according to the recommendations from the Cochrane handbook. We will perform a sensitivity analysis according to overall study quality, that is, low risk of bias, some concerns and high risk of bias, by comparing random and fixed-effect models and by excluding possible outlier studies if the visual inspection of the forest plot shows poorly overlapping CIs. Regarding publication bias, funnel plots will be constructed and analysis will be done using the Egger’s test for analyses that contain more than 10 studies.

Ethics and dissemination

Since all the studies that we hope to include in this review have probably been published or have got ethical clearance, the nature of this study does not require and has been exempted from Institutional Review Board approval. The current review will be published in a peer-reviewed journal and may be used by the National Malaria Control Programme to rethink coverage of IRS in malaria-endemic areas. This systematic review will help update the knowledge on the impact of IRS withdrawal and the need to design a clear exit strategy.

Patient and public involvement

Patients or the public were not involved in the design, conduct, reporting or dissemination plans of our research.

Ethics statements

Patient consent for publication

Acknowledgments

We would like to acknowledge and thank the ACRES team for their unwavering support throughout the entire process of writing this protocol.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Twitter @orishphilip

  • Contributors PO, EK, IK, PL, PK and Perez Kirya conceptualized the idea. PO wrote the initial protocol. PO, EK and CN developed the search strategy. EK, PL, IK and RM-D have reviewed and approved the protocol for publication. All authors read and approved the final version of the protocol.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, conduct, reporting or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.