Article Text

Protocol
Level of sedation in critically ill adult patients: a protocol for a systematic review with meta-analysis and trial sequential analysis
  1. Ameldina Ceric1,
  2. Johan Holgersson1,
  3. Teresa May2,
  4. Markus B Skrifvars3,
  5. Johanna Hästbacka4,
  6. Manoj Saxena5,
  7. Anders Aneman6,
  8. Anthony Delaney7,8,
  9. Michael C Reade9,
  10. Candice Delcourt10,
  11. Janus Jakobsen9,
  12. Niklas Nielsen1
  1. 1Department of Clinical Sciences Lund, Anesthesia and Intensive Care, Lund University, Helsingborg Hospital, Helsingborg, Sweden
  2. 2Department of Critical Care, Maine Medical Center, Portland, Maine, USA
  3. 3Department of Emergency Care and Services, Helsinki University, Helsinki University Hospital, Helsinki, Finland
  4. 4Department of Anesthesiology, Intensive Care and Pain Medicine, Helsinki University Hospital and University of Helsinki, Helsinki, Finland
  5. 5Senior Lecturer, Critical Care Division, The George Institute for Global Health, University of New South Wales, Sydney, New South Wales, Australia
  6. 6Intensive Care Unit, South Western Sydney Local Health District, Liverpool Hospital, South Western Sydney Local Health District, South Western Sydney Clinical School, University of New South Wales, and Faculty of Medicine, Health and Human Sciences, Macquarie University, Liverpool, New South Wales, Australia
  7. 7The George Institute for Global Health and the University of New South Wales, Sydney, New South Wales, Australia
  8. 8Malcolm Fisher Department of Intensive Care, Royal North Shore Hospital, St Leonards, New South Wales, Australia
  9. 9Department of Regional Health Research, The Faculty of Health Sciences, University of Southern Denmark, Denmark, Denmark
  10. 10Department of Clinical Medicine, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, New South Wales, Australia
  1. Correspondence to Dr Ameldina Ceric; ameldina.ceric{at}med.lu.se

Abstract

Introduction It is standard of care to provide sedation to critically ill patients to reduce anxiety, discomfort and promote tolerance of mechanical ventilation. Given that sedatives can have differing effects based on a variety of patient and pharmacological characteristics, treatment approaches are largely based on targeting the level of sedation. The benefits of differing levels of sedation must be balanced against potential adverse effects including haemodynamic instability, causing delirium, delaying awakening and prolonging the time of mechanical ventilation and intensive care stay. This systematic review with meta-analysis aims to investigate the current evidence and compare the effects of differing sedation levels in adult critically ill patients.

Methods and analyses We will conduct a systematic review based on searches of preidentified major medical databases (eg, MEDLINE, EMBASE, CENTRAL) and clinical trial registries from their inception onwards to identify trials meeting inclusion criteria. We will include randomised clinical trials comparing any degree of sedation with no sedation and lighter sedation with deeper sedation for critically ill patients admitted to the intensive care unit. We will include aggregate data meta-analyses and trial sequential analyses. Risk of bias will be assessed with domains based on the Cochrane risk of bias tool. An eight-step procedure will be used to assess if the thresholds for clinical significance are crossed, and the certainty of the evidence will be assessed using Grades of Recommendations, Assessment, Development and Evaluation.

Ethics and dissemination No formal approval or review of ethics is required as individual patient data will not be included. This systematic review has the potential to highlight (1) whether one should believe sedation to be beneficial, harmful or neither in critically ill adults; (2) the existing knowledge gaps and (3) whether the recommendations from guidelines and daily clinical practice are supported by current evidence. These results will be disseminated through publication in a peer-reviewed journal.

  • Adult anaesthesia
  • Adult intensive & critical care
  • Anaesthesia in neurology
  • Anaesthesia in cardiology
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • Methodology based on the Cochrane Handbook, Grades of Recommendations, Assessment, Development and Evaluation and trial sequential analyses.

  • Broad inclusion criteria including all randomised clinical trials comparing any degree of sedation with no sedation and lighter sedation with deeper sedation in critically ill adults regardless of underlying conditions.

  • Broad search strategy including 10 databases and two clinical trial registries.

  • Risk of statistical and clinical heterogeneity due to various types of sedative drugs and participants included regardless of underlying condition.

  • Risk of type 1 error due to large number of comparisons, which will be considered when interpreting the review results.

Introduction

Description of the patient population

Critically ill patients by virtue of their disease are at risk of significant morbidity and mortality. More than 4 million patients in the USA are admitted to the intensive care units (ICUs) with critical illness each year and require specialised staff and technical equipment, with high cost for society.1 Moreover, patients surviving critical illness face a range of physical and functional deficits that may prevail after intensive care discharge.2–4

Description of the intervention

It has been standard of care for many decades to provide sedation to patients in need of mechanical ventilation to provide comfort during therapy.5 6 Approximately 85% of all critically ill patients are sedated during an intensive care stay.7 8 General indications for sedation are to reduce anxiety, discomfort, ventilatory intolerance and to promote patient-ventilator synchrony. Patients with more advanced respiratory compromise may require deeper sedation and neuromuscular blockade to allow for better compliance with the ventilator. However, sedation may also compromise haemodynamics, cause delirium, prolong the duration of mechanical ventilation and intensive care stay, cause long-term cognitive impairment and increase the risk of death.6 9–15 These outcomes are more likely to be affected by the level of sedation rather than the dose of sedatives administered, because the required dose of sedatives needed to reach the target sedation level varies between patients according to patient and disease characteristics and the pharmacological properties of different medications.

Critically ill patients may experience pain due to procedures, tests, prolonged immobilisation and daily care associated with intensive care. It is important to treat pain for patient comfort but also to minimise the risk of delirium and agitation during intensive care stay and post-traumatic stress disorder after intensive care discharge.1 15–17

Excess sedation in critically ill patients may lead to adverse events, such as unstable haemodynamics, ventilator associated pneumonia, delayed awakening, prolonged duration of mechanical ventilation, intensive care stay and postintensive care syndrome.7 To minimise potential harms, protocolised assessment and monitoring of sedation depth is recommended by guidelines.18 Sedation depth is most effectively monitored using clinical sedation assessment. Richmond Agitation and Sedation Scale (RASS) and Sedation-Agitation Scale are two well-established, validated and reliable sedation scales.19 20

Sedation with daily interruption of sedatives is one method used to target lighter sedation to allow for patient awakening and neurological assessment.10 21 22 Guidelines prefer propofol or dexmedetomidine over benzodiazepines to facilitate titration to lighter sedation and to reduce delirium.21 Volatile agents, such as sevoflurane and isoflurane, are an alternative route to the intravenous infusion and have shown less accumulation, reduced time of mechanical ventilation and intensive care stay and may have cardioprotective effects.23–25 Acquisition of equipment required to deliver volatile agents, lack of familiarity, and perceived comparative cost, have limited widespread uptake. Optimal sedation and analgesia treatment regimens are crucial to avoid oversedation and undersedation in critically ill patients.26 27 The level of sedation is anticipated to affect clinically important outcomes and the use of different sedative drugs do not alter this effect.14 28 29 Additionally, patients’ underlying illness may drive the sedation approach, with differing trade-offs of risks and benefits.

Haemodynamically unstable patients

Haemodynamic instabilities are common in critically ill patients. Sedation using either benzodiazepines and propofol impacts in a dose-dependent fashion haemodynamics causing systemic vasodilation resulting in hypotension.10 Dexmedetomidine is a selective alpha-2 receptor agonist with sedative and anxiolytic effects, with minimal effect on respiration. Dexmedetomidine also alters haemodynamics causing transient hypertension, hypotension and bradycardia.30 31

Neurocritical care patients

Patients suffering from acute brain injury due to severe haemorrhagic or ischaemic stroke, global ischaemia, subarachnoid bleeding, trauma or seizures might differ from general critically ill patients in their requirement for, and adverse effects from, sedation.32 Sedation is considered part of the treatment of elevated intracranial pressure for example in patients with brain injury.33 34 Sedation reduces metabolism and thus reduces oxygen consumption and carbon dioxide production, thereby theoretically protecting patients with brain injury from development of oedema or ischaemia that could cause increased intracranial pressure and secondary brain injury. Clinical studies have not yet been demonstrated these improved outcomes.35–38 Nonetheless, many clinicians consider sedation has specific indications for patients with acute brain injury caused by ischaemic or haemorrhagic stroke, subarachnoid haemorrhage, cardiac arrest, trauma and in treatment of seizures in patients with status epilepticus.32 After acute brain injury, cerebral autoregulation of blood flow and oxygen supply may be impaired, and patients may be more susceptible to hyperperfusion or hypoperfusion based on blood pressure or metabolic demand.36 Seizures are common after acute brain injury and increase cerebral metabolic demand and could result in secondary neurological injury. Some sedatives, including benzodiazepines and propofol, suppress clinical seizures and have been proposed as seizure prophylactics. It remains unknown if they affect mortality.39 40

Cardiac arrest patients

Patients resuscitated from cardiac arrest may have varying extent of brain injury, seizures, organ failure and haemodynamic instability.41 42 Haemodynamical instability is common after return of spontaneous circulation, potentially causing inadequate circulation of blood to vital organs, most importantly the heart and brain. Patients remaining comatose after resuscitation are recommended to be treated with targeted temperature management (TTM) to mitigate brain injury.41 42 The implementation of TTM in early 2000’ has led to routine provision of sedation in these patients. However, this may change in future practice since recent trials have shown no improvement in outcome in patients treated with hypothermia compared with normothermia.43 Regardless of temperature chosen, shivering, a response to external interventions that decrease body temperature, increases metabolism and oxygen consumption, is an important complication of induced hypothermia.44 One specific sedation indication in patients treated with TTM is to reduce shivering either without or in conjunction with neuromuscular blockade. Other benefits of sedation in this population are a potential reduction in the risk of seizures, which can occur after cardiac arrest, and treatment in patients with increased intracranial pressure caused by cerebral oedema.33 34 39 40 45 TTM alters the pharmacodynamics of sedative and analgesic drugs and may impact drug metabolism, both need to be considered when administering sedation to these patients.46–50 Possible drug accumulation is of great importance in cardiac arrest patients since it may confound neurological prognostication, resulting in either the devastating consequence of premature withdrawal of life-sustaining therapies,46 49–51 or (likely more common) persistence with treatment that is ultimately futile. Short-acting sedatives and analgesics are recommended to minimise these risks, although these recommendations are difficult to apply to this patient population due the complexity of haemodynamic instability and severity of brain injury.

Why is this review important?

The benefits of sedatives in critical care patients must be balanced against the potential harms of affecting haemodynamics, causing delirium and prolonging the time of mechanical ventilation and intensive care stay, which may affect outcome. It is important to consider intensive care that preserves the function of the brain and neuromuscular system, from the perspective of life altering disabilities and impairments after intensive care. Additional understanding of optimal sedation is warranted.52 Moreover, treating patients at an optimal sedation level may not only improve outcome but may also optimise resource utilisation.53 Previous systematic reviews and meta-analyses have assessed the effects of different sedation depths in critically ill adult patients:

  • Long et al compared the effects of lighter sedation versus deeper sedation. The primary outcome was occurrence of delirium and secondary outcomes were agitation-related adverse events and mortality in mechanically ventilated adult patients.54 Ten randomised clinical trials, four before-and-after controlled trials, two prospective and two retrospective studies were assessed. Meta-analyses showed that the deeper sedation group, as compared with the lighter sedation group, had a significantly higher risk of death (OR 1.82, 95% CI 1.23 to 2.69, p=0.003). Meta-analysis showed no significant difference in the occurrence of delirium in deeper sedation compared with patients with lighter sedation (OR 1.00, 95% CI 0.64 to 1.58, p=0.993). Long et al assessed the risk of bias in the included trials using the Cochrane handbook and the Newcastle-Ottawa Scale, a systematic search was conducted, and Grades of Recommendations, Assessment, Development and Evaluation (GRADE) was used to assess the certainty of the evidence.55 56 The groups were defined based on sedation scales defined by the individual study. The major limitation of this review was that patients with brain injury, alcohol withdrawal syndrome and speech disorder were excluded.

  • Aitken et al also compared the effect of lighter sedation versus deeper sedation on the duration of mechanical ventilation and intensive care mortality in adult patients receiving mechanical ventilation in the ICU.57 Eight randomised controlled trials and 12 cohort studies, with a total of 7865 patients, were analysed. Meta-analysis of the included randomised trials showed no evidence of a difference in intensive care mortality (risk ratio, RR 0.82 (95% CI 0.58 to 1.17)) or in duration of mechanical ventilation but found a significantly shorter time of mechanical ventilation in patients treated with lighter sedation in the cohort studies (MD: −1.52 days (95% CI −2.71 to −0.34)). Aitken et al57 assessed the risk of bias in the included trials using the Cochrane handbook and ROBINS-I, a systematic search was conducted and GRADE was used to assess the certainty of the evidence.58 59

  • Stephens et al compared the effects of lighter sedation vs deeper sedation within the first 48 hours of initiating mechanical ventilation in adult patients.60 To be included, studies had to report some objective measurement of sedation depth like RASS or GCS. Studies of patients mechanically ventilated in the operating room and then admitted to an ICU were included, and studies mainly focusing on perioperative outcomes were excluded. Two randomised clinical trials and seven observational studies, totally comprising 4521 patients, were included, but no separate analyses including only randomised trials were presented. The review authors found significantly lower mortality rate in patients treated with lighter sedation compared with deeper sedation (OR 0.34 (95% CI 0.21 to0.54), p<0.001). Stephens et al60 assessed the risk of bias in the included trials using the Cochrane Collaboration tools and Newcastle-Ottawa Scale handbook, a systematic search was conducted but the GRADE was not used to assess the certainty of the evidence.55 61 Another limitation of this review was that the studies enrolling patients after 48 hours of initiation of mechanical ventilation were excluded, and thus, 15 relevant studies were not included.

The previously conducted meta-analyses because of the findings of above-described analyses are inconclusive and have several limitations. None of the trials have taken into account both risks of random errors and systematic errors.62 Consequently, there is no clear consensus on the impact of sedation on mortality and other clinically important outcomes in critically ill patients.

This systematic review and meta-analysis aim to compare the effects of the level of sedation in adult critically ill patients, to investigate the current evidence. We plan to compare (1) no sedation vs any degree of sedation and (2) lighter sedation versus deeper sedation. Moreover, because of the clinical heterogeneity of critically ill, we want to investigate the effect of the level of sedation in patients with acute brain injury, postcardiac arrest and haemodynamically unstable patients in subgroup analyses, where sedation might have specific effects.

Methods

Methods and analysis

This systematic review protocol has been developed based on Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) guidelines for reporting systematic reviews evaluating healthcare interventions.63 This study will be registered on International Prospective Register of Systematic Reviews. The planned start date of this study is September 2022 and planned end date is February 2023.

Criteria for considering studies for this review

Types of studies

We will include randomised clinical trials irrespectively of design, setting, blinding, publication status, language, publication year and reporting of outcomes.

Types of participants

We will include adult patients admitted to an ICU (as defined by trialists), irrespectively of sex and comorbidities. Trials that only include a subset of eligible participants will be included if: (1) separate data on the eligible participants are available or (2) more than 90% are eligible.

Types of interventions

We will assess two types of comparisons:

  • Any degree of sedation (as defined by trialists) compared with no sedation.

  • Light sedation (as defined by trialists) compared with deep sedation (as defined by trialists). Studies comparing any intervention with one group receiving lighter sedation than the other group, were eligible for inclusion. Studies not eligible if no separation of sedation depth could be identified.

The results of these two comparisons will be presented separately.

We will accept any type of cointerventions when such cointerventions are intended to be delivered similarly to the experimental and control group.

Outcome measures

Primary outcomes

  • All-cause mortality at longest follow-up (dichotomous outcome).

Secondary outcomes

  • Serious adverse event at any time point (dichotomous outcome).

  • Poor neurological outcome at longest follow-up (dichotomous outcome) (as defined by trialists).

  • Delirium at any point in the ICU admission (dichotomous outcome) (as defined by trialists).

We will define a serious adverse event as any untoward medical occurrence that resulted in death, was life-threatening, required hospitalisation or prolongation of existing hospitalisation, or resulted in persistent or significant disability. As we expect the reporting of serious adverse events to be very heterogeneous and not strictly according to the ‘International Council for Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use-Good Clinical Practice’ (ICH-GCP) recommendations in many trials, we will include the event as a serious adverse event if the trialists either: (1) use the term ‘serious adverse event’ but not refer to ICH-GCP or (2) report the proportion of participants with an event we consider fulfil the ICH-GCP definition. If several of such events are reported, we will choose the highest proportion reported in each trial. We will second analyse each component of serious adverse events separately.

Exploratory outcomes

  • Duration of mechanical ventilation (continuous scale) (as defined by trialists).

  • Quality of life (any valid continuous scale).

  • Post-traumatic stress disorder (dichotomous outcome).

  • Mean arterial blood pressure (continuous scale).

  • Body core temperature (continuous scale).

  • Intracranial pressure (continuous scale).

  • Duration of delirium/proportion of time spent in delirium (continuous scale).

Search methods for identification of studies

Electronic searches

  • Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library.

  • MEDLINE (Ovid, from 1946 and onwards).

  • Embase (Ovid, from 1980 and onwards).

  • LILACS (Bireme, 1982 and onwards).

  • BIOSIS (Thomson Reuters, 1926 and onwards).

  • CINAHL.

  • Scopus.

  • Web of Science Core Collection.

A preliminary search strategy for MEDLINE (Ovid) is given in online supplemental material 1. We will adapt the preliminary search strategy for MEDLINE (Ovid) for use in these databases. We will apply the Cochrane sensitivity-maximising randomised clinical trial filter to MEDLINE (Ovid) and adaptations of it to all the other databases, except CENTRAL. A medical librarian will conduct the electronic search.

Searching other resources

We will search the reference lists of included randomised clinical trials, previous systematic reviews and other types of reviews for any unidentified randomised clinical trials. We will also contact authors of included randomised clinical trials for further information by email. Further, we will search for ongoing and unidentified randomised clinical trials on:

We will also include unpublished and grey literature trials if we identify these and assess relevant retraction statements and errata for included studies.

Data collection and analyses

We will perform the review following the recommendations of Cochrane. The analyses will be performed using the R statistical software (V.4.0.3, R Foundation for Statistical Computing, Vienna, Austria).

Selection of studies

Two review authors AC and JHo will independently screen titles and abstracts for inclusion of all potentially eligible trials. We will code the studies ‘retrieve’, defined as (eligible or potentially eligible/unclear) or ‘do not retrieve’. If there are any disagreements, a third author will be asked to arbitrate (JJ or NN). We will retrieve all relevant full-text study reports/publications and two review authors AC and JHä will independently screen the full-text and identify trials for inclusion. We will report reasons for exclusion of the ineligible studies. We will identify and exclude duplicated and collated multiple reports of the same trial so that each trial rather than each report is the unit of interest in the review. We will record the selection process in sufficient detail to complete a PRISMA flow diagram.

Data extraction and management

We will use a data collection tool for study characteristics and outcome data, which has been piloted on at least one study in the review. Two authors will extract and validate data independently from the included trials. Any disagreement concerning the extracted data will be discussed between the two authors. If no agreement can be reached, a third author (NN or JJ) will resolve the issue. We will assess duplicate publications and companion papers of a trial together to evaluate all available data simultaneously (maximise data extraction, correct bias assessment). We will contact the trial authors by email to specify any additional data, which may not have been reported sufficiently or at all in the publication. We will extract data on trial, participants’, and intervention characteristics and outcomes (see online supplemental table 1).

Assessment of risk of bias in the included studies

Our bias risk assessment will be based on the Cochrane Risk of Bias tool—version 2 as recommended in The Cochrane Handbook of Systematic Reviews of Interventions (see online supplemental material 2).

Measures of treatment effect

Dichotomous outcomes

We will calculate RRs with 95% CI for dichotomous outcomes, as well as the TSA-adjusted CIs (see paragraph Trial sequential analysis below). We will calculate the absolute risk reduction or absolute risk increase and number needed to treat, or number needed to harm if the outcome result shows a beneficial or harmful effect, respectively. If we observe problems with single zero events when meta-analysing data, we will use reciprocal zero cell correction. If we observe problems with double zero events, we will analyse data using beta-binominal regression.

Continuous outcomes

We will calculate the mean differences and if necessary, as a hypothesis generating analysis, the standardised mean difference with 95% CI for continuous outcomes, as well as the TSA-adjusted CIs (see paragraph Trial sequential analysis below).

Unit of analysis issues

We will only include randomised clinical trials. For trials using cross-over design, only data from the first period will be included. For trials where multiple trial intervention groups are reported, we will only include the relevant groups. If two comparisons from the same trial are combined in the same meta-analysis, we will halve the control group to avoid double counting. We will not include cluster randomised trials, as these have a high risk of biased results due to confounding.

Dealing with missing data

We will, as first option, contact all trial authors to obtain any relevant missing information and data.

Dichotomous outcomes

We will not use intention-to-treat data if the original report did not contain such data. We will not impute missing values for any outcomes in our primary analysis. In two of our sensitivity analyses (see paragraph Sensitivty analysis below), we will impute data.

Continuous outcomes

We will primarily analyse scores assessed at single time points. If only change from baseline scores are reported, we will analyse the results together with follow-up scores.58 If SDs are not reported, we will calculate the SDs using trial data for example, calculate SD based on CIs or SE, if possible.58 We will not use intention-to-treat data if the original report did not contain such data. We will not impute missing values for any outcomes in our primary analysis, but we will impute in two of our sensitivity analyses (see paragraph Sensitivity analysis below).

Assessment of heterogeneity

We will primarily investigate forest plots to visually assess for signs of heterogeneity. We will second assess the presence of statistical heterogeneity by the χ2 test (threshold p<0.10) and measure the quantities of heterogeneity by the I2 statistic. We will investigate possible heterogeneity through subgroup analyses. Ultimately, we may decide that a meta-analysis should be avoided.

Assessment of reporting biases

We will use a funnel plot to assess reporting bias in the meta-analyses including 10 or more trials. We will visually inspect funnel plots to assess the risk of bias. We are aware of the limitations of a funnel plot (ie, a funnel plot assesses bias due to small sample size, and asymmetry of a funnel plot is not necessarily caused by reporting bias. From this information, we assess possible reporting bias). For dichotomous outcomes, we will test asymmetry with the Harbord test if τ2 is less than 0.1 and with the Rücker test if τ2 is more than 0.1. For continuous outcomes, we will use the regression asymmetry test and the adjusted rank correlation.

Data synthesis

Meta-analysis and assessment of significance

We will undertake this meta-analysis according to the recommendations stated in the Cochrane Handbook for Systematic Reviews of Interventions, Keus et al and the eight-step assessment suggested by Jakobsen et al for better validation of meta-analytical results in systematic reviews. We will use the statistical software Review Manager V.5.338 provided by Cochrane and R statistical software (V.4.0.3) to analyse data. We will assess our intervention effects with both random-effects meta-analyses and fixed-effect meta-analyses and report the more conservative result as (highest p value) as our primary result and the less conservative results as a sensitivity analysis. If there is substantial discrepancy between the results of the two methods, we will report both results and discuss what caused the difference. We will adjust our thresholds for statistical significance due to problems with multiplicity (family-wise error rate), by dividing the prespecified p value threshold with the value halfway between 1 (no adjustment) and the number of primary and secondary outcome comparisons (Bonferroni adjustment). We will assess a total of two primary and three secondary outcomes and we will, therefore, consider a p value of 0.02 or less as the threshold for statistical significance.62 If quantitative synthesis is not appropriate, we will report the results in a narrative way.

Trial sequential analysis

Cumulative meta-analyses are at risk of producing random errors due to sparse data and multiple testing of accumulating data. Therefore, TSA can be applied to control these risks (http://www.ctu.dk/tsa/).62 Similar to a sample size calculation in a randomised clinical trial, TSA estimates the diversity-adjusted required information size (DARIS) (ie, the number of participants needed in a meta-analysis to detect or reject a certain intervention effect) in order to minimise random errors. The DARIS considers the anticipated intervention effect, the variance of the anticipated difference in intervention effects, the acceptable risk of falsely rejecting the null hypothesis (alpha), the acceptable risk of falsely confirming the null hypothesis (beta). We searched for suitable empirical data to determine and predefine the anticipated intervention effects. However, no suitable data could be found. Instead, we pragmatically hypothesised the anticipated intervention effects:

  • When analysing dichotomous outcomes, we will pragmatically anticipate an intervention effect equal to aRR reduction (RRR) of 25%, as recommended by the GRADE guidelines when previous evidence do not provide other preliminary estimations.58 Additionally, we will use trial sequential analyses to define the lowest intervention effects threshold we can confirm or reject.

  • When analysing quality of life, we will pragmatically anticipate an intervention effect equal to the mean difference of the observed SD/2.

TSA enables testing for significance to be conducted each time a new trial is included in the meta-analysis. Based on the DARIS, trial sequential monitoring boundaries are constructed. This enables one to determine the statistical inference concerning cumulative meta-analysis that has not yet reached the DARIS. Firm evidence for benefit or harm may be established if a trial sequential monitoring boundary (ie, upper boundary of benefit or lower boundary of harm) is crossed before reaching the DARIS, in which case further trials may turn out to be superfluous. In contrast, if a boundary is not surpassed, one may conclude that it is necessary to continue with further trials before a certain intervention effect can be detected or rejected. Firm evidence for lack of the postulated intervention effect can also be assessed with TSA. This occurs when the cumulative Z-score crosses the trial sequential boundaries for futility. The TSA programme is also able to calculate TSA-adjusted CIs, which we will report in addition to the unadjusted naïve 95% CI. TSA-adjusted CI compared with unadjusted naive 95% CI gives a more correct estimation of the true CI, as it is adjusted for lack of information. If the TSA cannot be conducted because of too little information, we will conduct a more lenient analysis by increasing the anticipated intervention effect (in these cases, the TSA-adjusted CI is overly optimistic). For dichotomous outcomes, we will estimate the DARIS based on an anticipated intervention effect (our anticipated intervention effect for each dichotomous outcome is stated above), the observed proportion of participants with an outcome in the control group, an alpha of 2.0% for our primary and secondary outcomes and 5.0% for our exploratory outcomes (see the ‘Meta-analysis and assessment of significance’ section), a beta of 10% and a diversity as suggested by the trials in the meta-analysis. For continuous outcomes, we will estimate the DARIS based on a minimal clinically important difference of SD/2, the SD observed in the control group, an alpha of 2.0% for our primary and secondary outcomes and 5.0% for our exploratory outcomes (see the ‘Meta-analysis and assessment of significance’ section), a beta of 10% and a diversity as suggested by the trials in the meta-analysis. We will document difficult decisions in the review and sensitivity analyses will assess the impact of these decisions on the findings of the review.

Subgroup analysis and investigation of heterogeneity

We will perform subgroup analyses on all our outcomes (see online supplemental table 2). We will use the formal test for subgroup differences in Review Manager. Other post hoc subgroup analyses might be warranted if unexpected clinical or statistical heterogeneity is identified during the analysis of the review results.

Sensitivity analysis

To assess the potential impact of bias, we will perform a sensitivity analysis in which we exclude trials with overall ‘high risk of bias’. To assess the potential impact of the missing data for dichotomous outcomes, we will perform two sensitivity analyses, ‘best-worst- case’ scenario and ‘worst-best- case’ scenario, when assessing each dichotomous outcome (all-cause mortality, serious adverse events and non-serious adverse events) (see online supplemental table 3).

To assess the potential impact of the missing data for continuous outcomes, we will perform two sensitivity analyses, ‘best-worst-case’ scenario and ‘worst-best-case’ scenario, when assessing each continuous outcome (quality of life and time of mechanical ventilation) (see online supplemental table 3).

To assess the potential impact of missing SDs for continuous outcomes, we will perform sensitivity analysis. Where SDs are missing and it is not possible to calculate them, we will impute SDs from trials with similar populations and low risk of bias. If we find no such trials, we will impute SDs from trials with a similar population. We will present results of this scenario in our review.

Other post hoc sensitivity analyses might be warranted if unexpected clinical or statistical heterogeneity is identified during the analysis of the review results.

Summary of findings

We will use the GRADE system to assess the certainty of the body of evidence associated with each of our outcomes constructing ‘Summary of Findings’ (SoF) tables using the GRADEpro software.58 The GRADE approach appraises the certainty of the body of evidence based on the extent to which one can be confident that an estimate of effect or association reflects the item being assessed. We will assess the GRADE levels of evidence as high, moderate, low and very low and downgrade the evidence by one or two levels depending on the following certainty measures: within-study risk of bias, the directness of the evidence, heterogeneity of the data, precision of effect estimates and risk of publication bias. We will use TSA to assess ‘imprecision’. We will use methods and recommendations described in chapter 8 (section 8.5) and chapter 12 of the Cochrane Handbook for Systematic Reviews of Interventions.58 We will justify all decisions to downgrade the certainty of studies using footnotes and we will make comments to aid the reader’s understanding of the review where necessary. We will include all trials in our analyses and conduct a sensitivity analysis excluding trials at high risk of bias. If the results are similar, we will base our SoF table and conclusions on the overall analysis. If they differ, we will base our SoF table and conclusions on trials at low risk of bias.

Differences between the protocol and the review

We will conduct the review according to this protocol and report any deviations from it in the ‘differences between protocol and review’ section of the systematic review.

Patient and public involvement

We conducted this protocol for a systematic review without patient involvement. Patients were not invited to comment on the study design and were not consulted to develop patient relevant outcomes. Patients were not invited to contribute to the writing or editing of this protocol for readability or accuracy.

Discussion

This protocol aims to assess the effects of the level of sedation on critically ill patients regardless of underlying condition to assess the beneficial and harmful effects of sedation. The primary outcomes will be all-cause mortality and secondary outcomes will be serious adverse events, poor neurological outcome and delirium.

This protocol has number of strengths. The predefined methodology is based on the PRISMA-P guidelines for reporting systematic reviews evaluating healthcare interventions, GRADE, TSA and the eight-step assessment suggested by Jakobsen et al for better validation of meta-analytical results in systematic reviews.58 62 63 Hence, this protocol considers both risks of random errors and risks of systematic errors.

Our protocol also has several limitations. The primary limitation is that we will include various types of sedative drugs, and it is possible that different sedatives have different effects on the outcomes. Another limitation is that we will include various types of participants regardless of their underlying condition, and it is possible that sedation affect participants differently depending on their condition. To minimise these limitations, we have planned to assess carefully clinical and statistical heterogeneity including several subgroup analyses, but it must be recognised that these subgroup analyses presumably will be underpowered. We will carefully take this into account when interpreting our results. Another limitation is the large number of comparisons, which increases the risk of family-wise error. To minimise this limitation, we have adjusted our thresholds for significance according to the total number of our primary and secondary outcomes. Nevertheless, we have not adjusted our thresholds for significance according to the large number of subgroup analyses. The substantial risks of type I errors will also be considered when interpreting our result

Ethics and dissemination

No formal approval or review of ethics is required for this systematic review as individual patient data will not be included. The results of this systematic review will be disseminated through publication in a leading peer-reviewed journal.

Ethics statements

Patient consent for publication

References

Supplementary materials

Footnotes

  • Contributors AC designed the study and wrote the protocol. JHo, MSk, JHä, TM, NN and JJ contributed to the overall study design and edited the protocol. MSa, AA, MR, AD and CD contributed to editing the protocol.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: MR declare that his institution received grant support from National Health and Medical Research Council, Australia, Medical Research Future Fund, and Royal Brisbane and Women’s Hospital Research Foundation the past 36 months. MR also received payment for expert testimony from government of the Northern Territory High Court of New Zealand, payment (<NZ$3000) for being a member of DSMB for clod stored platelet trial, and his wife has stock investment in ETF that includes biomedical shares. JHä declares that a consultation fee contract with Paion will be signed in near future, payments for consulting from Paion fees will be made to the institution, and support for attending board meetings at Paion. JHä also has a role in Edcational Committee of Scandinavian Society of Anaesthesiology and Intensive Care and minor stocks in Orion Pharma. MSk received research grant from Academy of Finland research grant and received payment for lecture honoraria for BARD Medical (Ireland). All other authors declare no conflict of interest.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.