Article Text

Protocol
Adverse events associated with endoscopic retrograde cholangiopancreatography: protocol for a systematic review and meta-analysis
  1. Nauzer Forbes1,2,
  2. Grigorios I. Leontiadis3,4,
  3. Marcus Vaska5,
  4. B. Joseph Elmunzer6,
  5. Yuhong Yuan4,
  6. Kirles Bishay1,2,
  7. Zhao Wu Meng1,2,
  8. Jordan Iannuzzi1,
  9. Dylan E O'Sullivan2,7,
  10. Brittany Mah1,7,
  11. Arun C R Partridge1,
  12. Amanda M Henderson1,
  13. Aatif Qureshi1,
  14. Rajesh N Keswani8,
  15. Sachin Wani9,
  16. Ronald J Bridges1,
  17. Steven J Heitman1,2,
  18. Robert J Hilsden1,2,
  19. Yibing Ruan7,10,
  20. Darren R Brenner2,7,10
  1. 1Department of Medicine, Division of Gastroenterology and Hepatology, University of Calgary, Calgary, Alberta, Canada
  2. 2Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
  3. 3Department of Medicine, Division of Gastroenterology, McMaster University, Hamilton, Ontario, Canada
  4. 4Farncombe Family Digestive Health Research Institute, McMaster University, Hamilton, Ontario, Canada
  5. 5Knowledge Resource Service, Alberta Health Services, Calgary, Alberta, Canada
  6. 6Division of Gastroenterology and Hepatology, Medical University of South Carolina, Charleston, South Carolina, USA
  7. 7Department of Oncology, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
  8. 8Division of Gastroenterology, Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA
  9. 9Division of Gastroenterology and Hepatology, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
  10. 10Department of Cancer Epidemiology and Prevention Research, Cancer Control Alberta, Alberta Health Services, Calgary, Alberta, Canada
  1. Correspondence to Dr Nauzer Forbes; nauzer.forbes{at}ucalgary.ca

Abstract

Introduction Endoscopic retrograde cholangiopancreatography (ERCP) is performed to diagnose and manage conditions of the biliary and pancreatic ducts. Though effective, it is associated with common adverse events (AEs). The purpose of this study is to systematically review ERCP AE rates and report up-to-date pooled estimates.

Methods and analysis A comprehensive electronic search will be conducted of relevant medical databases through 10 November 2020. A study team of eight data abstracters will independently determine study eligibility, assess quality and abstract data in parallel, with any two concordant entries constituting agreement and with discrepancies resolved by consensus. The primary outcome will be the pooled incidence of post-ERCP pancreatitis, with secondary outcomes including post-ERCP bleeding, cholangitis, perforation, cholecystitis, death and unplanned healthcare encounters. Secondary outcomes will also include rates of specific and overall AEs within clinically relevant subgroups determined a priori. DerSimonian and Laird random effects models will be used to perform meta-analyses of these outcomes. Sources of heterogeneity will be explored via meta-regression. Subgroup analyses based on median dates of data collection across studies will be performed to determine whether AE rates have changed over time.

Ethics and dissemination Ethics approval is not required for this study as it is a planned meta-analysis of previously published data. Participant consent is similarly not required. Dissemination is planned via presentation at relevant conferences in addition to publication in peer-reviewed journals.

PROSPERO registration number

CRD42020220221.

  • endoscopy
  • hepatobiliary disease
  • pancreatic disease
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • Our meta-analysis will provide to up-to-date estimates of procedural risks associated with the performance of endoscopic retrograde cholangiopancreatography.

  • A comprehensive search strategy will be employed to capture all relevant studies and answer our study question.

  • The strength of the body of evidence will be assessed using the Grading of Recommendations, Assessment, Development and Evaluation framework.

  • A limitation of our approach is the likelihood of pooling outcome estimates using variable definitions of outcomes across studies, which we will partially mitigate by performing sensitivity analyses based on outcome definitions.

  • Though the decision to exclude conference abstracts potentially disposes to publication bias, we feel that the unclear or ambiguous methodology often available from conference abstracts would add to potential study heterogeneity.

Introduction

Endoscopic retrograde cholangiopancreatography (ERCP) is an essential and commonly performed advanced endoscopic procedure used in the diagnosis and treatment of several categories of biliary and pancreatic pathology.1–4 Although the role of standard ERCP has transitioned to that of a primarily therapeutic procedure, ERCP volumes have nevertheless risen over the past 10–15 years in the USA.5 6 ERCP is performed across high-volume and low-volume centres, and by endoscopists of variable experience and specialties.7 A steep learning curve during a specialised period of training results in an advanced skill set required to perform safe and effective ERCP.8 9

Although very effective overall,10 ERCP is widely known to have the highest adverse event (AE) profile among all commonly performed endoscopic procedures, with a collective AE rate of >10%.11 Common AEs include post-ERCP pancreatitis (PEP), bleeding, infection, cholecystitis, perforation and cardiopulmonary events.11 12 PEP is the most common, with estimated rates of 5%–10% in all-comers, approaching or exceeding 20% in higher risk cases.11–13 Despite an emphasis on training and quality, both the incidence of PEP and its associated mortality are rising in the USA.14 Rates of post-ERCP bleeding range between 0.3% and 2%.15–17 Symptomatic post-ERCP infection (cholangitis with or without sepsis) is also a common AE following ERCP, with a reported range between 0.5% and 3%,11 and is of particular interest in recent years given the rise of duodenoscope-related infections.18–21

ERCP AEs are commonly reported in studies of varying designs; however, few systematic reviews have synthesised available incidence rates of specific or overall AEs following ERCPs. A 2015 study synthesised the rates of PEP from randomised trials,13 but their search is now nearly 8 years out of date. Furthermore, other AE rates were not considered, and observational studies were not included. Observational studies are a required element of understanding true population rates of AEs,22 23 given that the patient mixes therein are more representative of the actual patient population in clinical practice compared with the highly selected participants in randomised trials. Given the frequency with which these events occur and their significant burden on the healthcare system,24 25 it is crucial to obtain accurate, up-to-date data on which to base estimates of incidence. Furthermore, AE rates differ depending on clinically relevant patient-related and procedure-related parameters, but pooled estimates of incidences within these subgroups are largely unavailable. These estimates could be important so that patients and endoscopists are aware of specific risks associated with each procedure.

Prior meta-analyses on this topic have focused only on paediatric patients26 or instead on specific AEs or specific patient subgroups.13 27 28 Therefore, we propose an up-to-date, comprehensive and methodologically rigorous systematic review and meta-analysis to determine the incidence of AEs following ERCP in adult patients, both overall and within clinically relevant patient-related and procedure-related subgroups.

Methods

Overview and objectives

Our meta-analysis will be conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses and Meta-analysis Of Observational Studies in Epidemiology recommendations.29 30

The primary objective will be to determine the pooled overall incidence of PEP (the primary outcome) in adult patients undergoing ERCP. The secondary objectives will be to determine the pooled incidences of post-ERCP bleeding, cholangitis, perforation, cholecystitis, death and unplanned healthcare encounters, in addition to determining the rates of specific and overall AEs within clinically relevant subgroups determined a priori and described below.

Eligibility criteria

Given the comprehensive nature of the study question and outcomes of interest, two separate electronic searches will be conducted, with studies captured within either search being eligible for inclusion in the overall systematic review. The first search will focus on randomised trials only, while the second search will also include observational studies. For the first search, a study will be included in the final review if it meets all of the following criteria: (1) it presents original data in the form of a randomised clinical trial (with any primary research question), (2) the interventional arm or control arm represents adult patients receiving ERCP, (3) it makes reference to the determination of overall or specific ERCP-related AE(s) as a primary or secondary outcome; (4) it reports the incidence of at least one post-ERCP AE (including any of PEP, bleeding, symptomatic infection or cholangitis, perforation, cholecystitis, death or unplanned presentation to a healthcare facility within any follow-up period up to 30 days after the index procedure); (5) it is published in English and (6) at least 75% of study patients received their ERCP in the year 2000 or later. The year 2000 was chosen as a cut-off so that only studies representative of the current ‘era’ of ERCP are included. For the first search, a study will be excluded from the review if (1) it is a conference abstract or (2) if it reports data that overlaps with another study’s patient population in part or in whole for the same outcome of interest. In the latter case, the study that includes the largest number of patients that had their ERCP conducted in the year 2000 or later will be included while any others are excluded.

For the second search, a study will be included in the final review if it meets all of the following criteria: (1) it is an observational study of any design; (2) its primary or secondary objective is to assess post-ERCP AE rates or outcomes in adults; (3) it reports the incidence of a specific post-ERCP AE, including any of the following: PEP, bleeding, symptomatic infection or cholangitis, perforation, cholecystitis, death or unplanned presentation to a healthcare facility within 30 days of the index procedure; (4) it is published in English and (5) at least 75% of study patients received their ERCP in the year 2000 or later. For the second search, a study will be excluded from the review if it meets any of the following criteria: (1) it is a case report; (2) it is a smaller study (fewer than 500 total study patients, with this threshold set to mitigate small study effects due to random error and to reduce the likelihood of including zero-event studies, which are problematic to meta-analyse); (3) it represents the experience of a single endoscopist; (4) it is a conference abstract or (5) it reports data that overlaps with another study’s patient population in part or in whole for the same outcome. In the latter case, the study that includes the largest number of patients that had their ERCP conducted in the year 2000 or later will be included while any others are excluded. Eligibility criteria for both aspects of the overall search strategy are summarised in table 1.

Table 1

Eligibility criteria for both aspects of the overall search strategy.

Search strategy and terms

A comprehensive electronic search will be designed by a health research librarian and carried out in the electronic databases MEDLINE (Ovid), PubMed, CINAHL, EMBASE, Scopus, Web of Science and Evidence Based Medicine Reviews based on the eligibility criteria detailed above, from inception of each data source to the search date of 10 November 2020. English language citations from 2000 or later will be included. A combination of Medical Subject Heading and free-text terms will be used along with spelling variations and synonyms to create the two search strategies outlined above. A detailed list of search terms is provided in box 1, with a full search planning document provided in the online supplemental materials.

Box 1

Summary of electronic database search terms.*

Search Aspect 1: Randomised controlled Trials

(ERCP OR “endoscopic retrograde cholangiopancreatography”)→limit to RCTs

(ERCP OR “endoscopic retrograde cholangiopancreatography”) AND (“adverse event**” OR “adverse effect*” OR “adverse reaction*” OR “post-ERCP pancreatitis” OR “post-endoscopic retrograde cholangiopancreatography pancreatitis” OR pancreatitis OR hemorrhagehaemorrhage OR haemorrhage OR cholangitis OR bleeding OR infection* OR cholecystitis OR perforation OR cardiopulmonary OR sepsis OR complication* OR unplanned OR event* OR sedation OR cholecystectomy OR choledocholithiasis OR “risk factor*” OR “postoperative complication*” OR “treatment outcome*” OR inflammation OR rupture)→limit to RCTs

Search Aspect 2: Observational Studies

(ERCP OR “endoscopic retrograde cholangiopancreatography”)→limit to cohort/observational studies

(ERCP OR “endoscopic retrograde cholangiopancreatography”) AND (“adverse event**” OR “adverse effect*” OR “adverse reaction*” OR “post-ERCP pancreatitis” OR “post-endoscopic retrograde cholangiopancreatography pancreatitis” OR pancreatitis OR hemorrhagehaemorrhage OR haemorrhage OR cholangitis OR bleeding OR infection* OR cholecystitis OR perforation OR cardiopulmonary OR sepsis OR complication* OR unplanned OR event* OR sedation OR cholecystectomy OR choledocholithiasis OR “risk factor*” OR “postoperative complication*” OR “treatment outcome*” OR inflammation OR rupture)→limit to cohort/observational studies

Study selection and data abstraction

All citations will be imported into DistillerSR (Evidence Partners, Ottawa, Canada) and any duplicate entries will be removed. Given the large volume of anticipated citations identified in the initial searches, eight reviewers (KB, ZWM, JI, DEO, BM, ACRP, AMH and AQ) will be randomly assigned roughly equal numbers of citations. Assessments by the first two reviewers will be used for titles and abstracts to identify citations for potential full-text review. A vote of ‘both include’ or ‘both exclude’ by any two of the eight reviewers will be considered definitive. Discrepancies will be resolved by consensus of an a priori committee of study investigators (NF, YR and DB). All included citations will then undergo independent duplicate full-text abstraction by two reviewers (of the same pool of eight), with discrepancies again being resolved by consensus. Data will then be extracted into standardised abstraction forms in duplicate, with separate forms for each aspect of the search strategy. Forms will include authors, year of publication, study design and country(ies) in which the research was carried out, study setting, recruitment period, sample sizes, patient sex, age, and comorbidity, procedural indication(s), relevant preprocedural parameters (including imaging studies and bilirubin levels) description of intervention(s), rates of AEs (in absolute numbers and proportions), outcome definitions and follow-up periods. Where possible, the severity of AEs will also be captured, including as an example mild, moderate and severe pancreatitis according to the Atlanta classification,31 so that pooled data can also be reported according to severity. Data will be abstracted both on the patient level as well as the procedure level, as available. Relevant subgroups (table 2) will also be abstracted.

Table 2

Planned subgroup analyses

Outcome definitions

A challenge with pooling rates of ERCP AEs is that non-universal definitions of outcomes are employed across studies. Detailed study-specific outcome definitions will be abstracted to help address this issue. Outcome definitions will be compared against those described in the American Society for Gastrointestinal Endoscopy (ASGE) Lexicon32 and the European Society for Gastrointestinal Endoscopy Guideline.33 Studies not reporting clear outcomes definitions or those employing non-guideline/Lexicon definitions will be flagged for sensitivity analyses. Study-specific mechanisms of outcome capture will also be abstracted so that these can be considered separately.34 For the primary outcome (PEP), the ASGE Lexicon definition requires typical pain with amylase or lipase>3 times the upper limit of normal.32

Risk of bias

Two authors will independently conduct risk of bias assessments for all included studies. Assessment of included randomised studies will be performed using the Cochrane Risk of Bias tool, V.2 (RoB 2),34 while the quality of observational studies will be assessed using the ROBINS-I tool.35 Discrepancies will be resolved by consensus.

Statistical analysis, subgroup and sensitivity analyses

We will perform DerSimonian and Laird random effects meta-analyses to report the pooled incidence rates of individual post-ERCP AEs along with 95% CIs. Study weights will be measured using the inverse variance method. Incidence rates from observational studies and randomised trials will be pooled separately (at no point being combined). Heterogeneity between studies will be assessed with the I2 and χ2 statistics. We will consider p values of <0.10 for the χ2 statistic or an I2 value >50% to indicate substantial heterogeneity, which will be further investigated with subgroup analyses. Subgroup analyses will be performed using relevant study-related, procedure-related and patient-related characteristics selected a priori. These are summarised in table 2. In addition, sources of heterogeneity will also be tested by performing meta-regression on these a priori selected characteristics. We will examine the I2 and adjusted R2 statistics to estimate the fraction of heterogeneity accounted for by these characteristics.

To determine whether AE rates have changed over time, we will perform subgroup analyses based on the median dates of data collection in individual studies for each type of AE. Median data collection will be assigned a single value per study and studies will be separated into three periods: (a) 2000–2009, (b) 2010–2014 and (c) 2015–present. Meta-regression will be performed to determine whether there are any significant differences in specific or overall AE rates between periods. Periods were chosen based on the 2012 publication of the seminal manuscript on rectal non-steroidal anti-inflammatory agents to prevent PEP36 and a 3-year lag period between study dissemination and clinical practice adoption.

We will also conduct a series of sensitivity analyses whereby studies of varying quality as per ROBINS-I and RoB 2 are considered separately and whereby studies employing non-ASGE-Lexicon AE definitions will be considered separately. Inter-study heterogeneity will be assessed using the Cochrane I2 statistic. Publication bias will be assessed by visual inspection of funnel plots in addition to performing Egger’s and Begg’s tests.37 38 The statistical packages Revman 5.1 (Cochrane Collaboration) and Stata 14.0 (StataCorp) will be used for all analyses. The strength of the body of evidence will then be assessed using the Grading of Recommendations, Assessment, Development and Evaluation framework.39

Patient and public involvement

No patients or public were involved in study design.

Ethics and dissemination

Ethics approval is not required for this study as it is a planned meta-analysis of the previously published data. Participant consent is similarly not required. Dissemination is planned via presentation at relevant conferences in addition to publication in peer-reviewed journals.

Discussion

This systematic review and meta-analysis will provide up-to-date estimates of incidences of the most common AEs associated with the performance of ERCP. Though ERCP in 2020 is primarily a therapeutic procedure, with minimal diagnostic indications, it remains one of the most commonly performed endoscopic procedures in the USA and world-wide, with volumes having increased over time.5 6 Even though ERCP is a relatively safe procedure overall, AEs are more prevalent with its performance than any other endoscopic procedure. Thus, it behoves endoscopists performing ERCP to be acutely aware of the most precise and up-to-date estimates of risk possible. If possible, patient-specific and procedure-specific estimates of risk should also be ascertained, which is also a goal of the proposed study. Obtaining these estimates could help set up appropriate patient expectations of risk and could also serve to optimise the peri-procedural management of patients undergoing ERCP.

Specific knowledge gaps are particularly important to bridge regarding ERCP AEs. In particular, accurate estimates of the rate of post-ERCP symptomatic infections (cholangitis or sepsis) are particularly important given the growing concerns around duodenoscope-related infections.18–21 Obtaining accurate estimates of the overall burden of post-ERCP infection is the first step toward describing the relatively smaller infection risk attributable directly to duodenoscope contamination and transmission. Similarly, estimates of postsphincterotomy and/or post-sphincteroplasty bleeding are variable,15–17 and no pooled estimates to date are available. With regards to rarer AEs such as cholecystitis and perforation, evidence is even more scarce. Thus, an urgent but unmet need is present to accurately define the overall and specific AE profile associated with ERCP.

Though this protocol was designed to limit sources of bias through rigorous methodology, there are nevertheless potential limitations that require acknowledgement. As with any meta-analysis, the certainty of pooled estimates is limited by the quality of input studies. With this topic in particular, it is anticipated that study cohorts will be described using variable levels of detail regarding demographics, comorbidities, procedural indications and procedural interventions. To mitigate this, we divided our study into two main analyses; the first, inclusive of randomised controlled trials, is expected to be more granular in terms of these details and is thus expected to yield more robust patient-specific and procedure-specific estimates of risk. The second, inclusive of only large observational studies, is expected to yield more pragmatic ‘real-world’ estimates of risk. For this analysis, a preset cut-off point of 500 patients was chosen to mitigate small-study effects. The ‘delta’, or gap between these two types of estimates, will also be a crucial aspect of our findings that we plan on discussing as it relates to implications on evidence interpretation and on clinical practice.

Another limitation of our approach is the possibility of pooling outcome estimates using variable definitions of outcomes across studies. To mitigate this, we will abstract study-specific outcome definitions and perform sensitivity analyses whereby studies with unclear or absent definitions are separately analysed. Even with this approach, we expect there to be some degree of (acceptable) variability between study definitions, but we will compare study-specific definitions against the ASGE Lexicon’s AE definitions32 to ensure that we only pool studies adhering to minimal thresholds for attribution of AEs. For instance, for post-ERCP bleeding, we will ensure that at minimum, studies require a haemoglobin drop of >2 g as part of their definition, to prevent inclusion of patients with intraprocedural or non-clinically significant post-procedural bleeding, which has been demonstrated to be of limited consequence.12 Another limitation includes missing studies due to our decision to restrict our inclusions to English studies with the majority of data collected after the year 2000. Although this is a valid concern, we felt it was more important to capture evidence most representative of current practices, techniques and technologies. Therefore, studies with a significant volume of study procedures performed prior to the year 2000 were deemed to be at risk of not representing current ERCP practice. Finally, we have made the decision to exclude conference abstracts from our study. Though this potentially disposes to publication bias, we feel that the unclear or ambiguous methodology often available from conference abstracts would add to potential study heterogeneity.

Overall, despite these limitations, we anticipate that our study will bridge important knowledge gaps pertaining to ERCP-associated AEs. Our results could potentially improve patient care and satisfaction by providing more detailed and up-to-date estimates of ERCP-related risk. Accurate AE estimates will also facilitate the design of future prospective ERCP studies including randomised trials and could potentially have meaningful implications on training and practice standards.

Ethics statements

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors NFand GIL: Conception and design. NF, GIL, MV, YY, DEOS, BJE and DB: analysis plan. NF: drafting of the article. NF, GIL, MV, BJE, YY, KB, ZWM, JI, DEOS, BM, ACRP, AMH, AQ, RNK, SW, RJB, SJH, RJH, YR and DB:

    critical revision of the article for important intellectual content. NF, GIL, MV, BJE, YY, KB, ZWM, JI, DEOS, BM, ACRP, AMH, AQ, RNK, SW, RJB, SJH, RJH, YR and DB: final approval of the article.

  • Funding This study was funded by the N.B. Hershfield Chair in Therapeutic Endoscopy, University of Calgary.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.