You are here

  • Home
  • Archive
  • Volume 9, Issue 3
  • Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management

Article Text

Article menu

Download PDFPDF

XML
Mental health
Protocol
Rationale and design of a systematic review: effectiveness and acceptance of technology-based psychological interventions in different clinical phases of depression management
  1. Moritz Köhnen,
  2. Levente Kriston,
  3. Martin Härter,
  4. Jörg Dirmaier,
  5. Sarah Liebherz
  1. Departement of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
  1. Correspondence to Moritz Köhnen; m.koehnen{at}uke.de

Abstract

Introduction Although many effective treatment options exist, depression is still undertreated indicating gaps in the healthcare system. The complementary provision of mental healthcare through technologies (eg, computer, smartphone) has the potential to fill treatment gaps and to overcome access barriers to mental healthcare. Until now, no systematic review integrates the evidence on different technology-based psychological interventions (TBIs) concerning their effectiveness and acceptance in different clinical phases of depression management (bridging waiting periods, acute treatment and aftercare). The aim of this project is to structure evidence on TBIs regarding different phases of depression management, and to determine effectiveness and acceptance for each clinical phase considering both active (eg, face-to-face treatment) and inactive (eg, waitlist) controls as comparators.

Methods and analysis We will include studies on adults with a formal diagnosis of unipolar depression. Treatments delivered by technologies based on scientific psychological theories will be considered as experimental interventions. The primary effectiveness outcome will be depressive symptoms at study endpoint measured by symptom severity rating scales, and the primary acceptance outcome will be dropping out of the study due to any reason. We will consider only randomised controlled trials, which will be identified by key database searches (including Cochrane Central Register of Controlled Trials, Medline, PsycINFO, PSYNDEX, CINAHL) complemented through searches in clinical trial registries (eg, clinicaltrials.gov) and grey literature searches (eg, Open Grey). Two review authors will independently conduct study selection, data extraction and quality assessment of included studies (using the Cochrane Collaboration’s tool for assessing risk of bias). Meta-analyses applying random-effect models as well as subgroup, meta-regression and sensitivity analyses will be performed.

Ethics and dissemination Ethics approval is not required for this study, as we conduct research on secondary data. We will disseminate results via peer-reviewed journal publications, presentations on conferences and via plain language summaries.

PROSPERO registration number CRD42016050413; Pre-results.

  • mental health
  • computer-based
  • technology-based interventions

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

https://doi.org/10.1136/bmjopen-2018-028042

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of the study

    • The design of this systematic review is methodologically sound (eg, applying a comprehensive literature search for primary and grey literature, and for ongoing trials; including primary studies of all languages; assessing the body of evidence by using the GRADE approach).

    • Patient and public involvement will be present in different stages (defining patient relevant outcomes, dissemination of results) of the systematic review.

    • Generally, the strict inclusion and exclusion criteria enables transparency, comparability and a focus on high-quality research but disregards studies not meeting these strict criteria (eg, trials applying quasi-randomisation of participants).

    • Despite the strict inclusion criteria, the focus of the review is still broad, since it aims to structure available evidence on technology-based intervention in this field. This may result in a large heterogeneity that can only be explained if sufficient evidence is available.

    Introduction  

    Depression is a highly prevalent mental disorder, affecting 16%–20% of the general population during their lifetime.1 Depression is associated with psychosocial difficulties,2 social withdrawal,3 increased mortality,4 stigmatisation,5 as well as high direct societal costs.6 According to the WHO,7 with more than 300 million affected individuals unipolar depression makes a large contribution to the burden of disease. Considering the high prevalence and the substantial burden of unipolar depression, optimal treatment strategies are essential. Over the past few decades numerous treatments have been developed and proven their effectiveness for unipolar depression, for instance psychological treatments like cognitive behaviour therapy (CBT),8 9 interpersonal therapy (IPT),8 10 pharmacological treatments,1 8 as well as combined psychological and pharmacological treatments.1 8 However, depression is only detected in nearly half of all cases when general practitioners diagnose affected individuals.11 Additionally, mental disorders are often not treated as only 54% (major depressive disorder) to 62% (dysthymia) of people with a lifetime diagnosis of depression report lifetime service use12 indicating access barriers to the healthcare system. Access to mental health services for affected individuals is impeded by both structural (eg, lack of availability) and attitudinal (eg, fear of stigma) barriers.13

    Technology-based psychological interventions (TBIs) are widely seen as an effective complementary source for addressing the issues of accessibility.14 TBIs hold the opportunity to reach people who live in remote areas or those with disabilities and without easy access to healthcare services.15–17 Furthermore, people who refuse to seek out traditional services, especially those who wish to remain anonymous, may use technology-based mental health services.18 These services are also considered as acceptable by healthcare professionals,19 by lay people19 and by users (eg, affected individuals using TBIs).20 21 Additionally, it has been shown that computerised CBT (cCBT) is cost effective when compared with usual care,22 no treatment23 or conventional CBT.23 However broad economic evaluations in this research context are still scarce.24 In summary, TBIs hold the chance to enhance geographic and time-related flexibility, reduce waiting times, stigmatisation and costs.22

    TBIs constitute a heterogeneous group of treatments, ranging from unsupported (without a therapist) self-help computer programs to comprehensive psychotherapeutic treatments delivered by a technical medium like telephone or video. Given the great heterogeneity between TBIs we will apply the framework used by Ebert et al to characterise internet and mobile-based psychological interventions by adopting them to a narrower definition of interventions, which, for example, only includes interventions tailored to particular needs of patients with depression. On the basis of this framework, TBIs can be distinguished by application areas (eg, prevention, blended therapy—ie, the combination of face-to-face therapy and technical elements), the technical aspects (eg, via email, short message service [SMS], online chat), the amount of human support (with or without therapeutic support, synchronous or asynchronous feedback), and their theoretical background (eg, evidence-based treatments like CBT).25

    Many randomised controlled trials (RCTs) were conducted to address the efficacy and effectiveness of TBIs in the treatment of depression.26–28 Additionally, there are several systematic reviews examining the efficacy of web-based respectively computerised interventions for depression.24 29–31

    For instance, a review by Andersson and Cuijpers31 found that guided cCBT yielded larger effect sizes (d=0.61) than unguided cCBT (d=0.25) when administered interventions were tested against control groups (eg, waitlist, care as usual). Richards and Richardson29 found a moderate (d=0.56) overall effect size of computer-based interventions. At the end of treatment, interventions with therapist support were superior to unsupported interventions when measures of depression outcome were considered. Unsupported interventions yielded considerable dropout rates in comparison with supported interventions. In both reviews, studies applying waitlist controls yielded greater effects than studies using usual care as control groups.29 31

    However, until now no systematic review integrates the evidence on different TBIs concerning their effectiveness and acceptance in different clinical phases of depression management for bridging waiting periods, for acute treatment and for aftercare. Therefore, current guideline recommendations are limited to the general effectiveness of cCBT.1 8

    Objectives

    The aim of our project is:

    1. to structure the available evidence of TBIs according to Ebert et al.25;

    2. to provide data syntheses on the effectiveness of TBIs in different clinical phases of depression management (waiting periods, acute treatment, aftercare);

    3. to identify treatment effect modifiers (eg, symptom severity, type of applied intervention);

    4. to explore acceptance (eg, dropout rate) and adverse events (eg, symptom aggravation);

    5. to provide an evidence base for (guideline) recommendations addressing clinicians, researchers and the general population.

    Methods

    The review will be conducted according to the standards of the Cochrane Collaboration32 and will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA statement).33

    Inclusion and exclusion criteria

    Types of studies

    RCTs, including cross-over and cluster RCTs, will be included in the systematic review. We will exclude uncontrolled and non-randomised controlled studies from this review. No restrictions regarding other design characteristics will be applied.

    Types of participants

    Participant characteristics

    Studies with participants of any gender and ethnicity, aged 18 years or above will be considered for inclusion. We will consider trials including participants aged under 18 if the mean age of included participants is ≥18 years.

    Diagnosis

    We will consider studies whose participants have a diagnosis of unipolar depression relying on a formal classification system, such as the International Classification of Diseases (ICD)34 or the Diagnostic and Statistical Manual of Mental Disorders (DSM)35—including all versions of these classification systems or standardised diagnostic interviews based on these systems (eg, Composite International Diagnostic Interview Short-Form).36 According to the ICD-10, F32.x, F33.x and F34.1 will be considered as unipolar depression. Studies reporting to investigate depressed patients without fulfilling these respective criteria (eg, studies reporting diagnoses on the basis of cut-off values) will be excluded. Studies on participants with a depressive episode in the context of a bipolar disorder will be excluded. Studies including unipolar as well as bipolar depressive participants will be included if data for the unipolar depressive subsample are reported separately. Mixed samples will be included if the proportion of patients with unipolar depression in the sample is 80% or more. Regarding to the evaluation of TBIs in aftercare, studies whose participants have been diagnosed with depression according to formal diagnostic criteria at the beginning of the acute treatment will be accepted even if the symptoms are currently remitted.

    Comorbidities

    Studies involving participants with comorbid mental or somatic conditions will be included if the concurrent condition is not the main focus of the intervention studied (eg, if the concurrent condition serves as an additional inclusion criterion in primary studies, the trial will be excluded).

    Setting

    We will consider different clinical phases of depression management as categories supporting to structure available evidence in order to determine effectiveness and acceptance specifically (see also table 1):

    View this table:
    Table 1

    Detailed description of relevant comparisons

    • waiting period (before acute treatment begins)

    • acute treatment

    • aftercare

    Within different clinical phases of depression management, TBIs can be distinguished concerning their format of implementation in care models. They can be delivered as stand-alone treatments (eg, TBIs substituting face-to-face treatments), as blended treatments (eg, combining TBIs and face-to-face therapy) or as part of stepped care treatments (eg, TBIs as a low intensity intervention targeting either subsyndromal or mild to moderate forms of depression).25 Studies conducted in community, primary, secondary or tertiary services will be included in the systematic review regardless of whether they were conducted in in- or outpatient facilities.

    Types of interventions

    Experimental intervention

    TBIs, defined as interventions conducted through technical devices based on an explicit psychotherapeutic theory and conducted with or without therapist guidance, will be considered. TBIs have to fulfil the following criteria:

    • They must be conducted through technical devices like telephone, smartphone, tablet or computer (online or offline). This includes: telephone- or video-based psychotherapy with regular telephone or video calls between health care provider (eg, psychotherapist) and patient, online chat, emails, SMS, apps, as well as computer-, web- or mobile-based programmes.

    • They may be carried out independently by the participant (eg, self-help; unguided TBI) or therapist-supported (guided TBI). If therapist-support will be present, the (therapeutic) guidance may be either synchronous (eg, communication in real-time via teleconferencing or Skype) or asynchronous (eg, delayed communication pathways like texting or emails).

    • They must be based on a scientific psychological theory (described in detail and/or manualised and/or referenced).

    • They must be (at least partly) tailored to particular needs of patients with depressive symptoms (eg, the interventions aim to reduce negative beliefs, tries to enhance the mood of the participants or includes behavioural activation).

    The intervention may comprise self-help programmes, so-called ‘prompts’ (reinforcement or feedback automatisms), interactive elements (eg, apps to monitor behavioural activation and its influence on mood), serious games or even complex psychotherapeutic programmes (like cCBT). Trials providing only psychoeducational content, patient decision aids, depression management tools (eg, online platforms managing appointments with general practitioners/psychiatrists) as well as tools supporting adherence to drugs will not be considered in our analysis.

    Comparator intervention

    Both controlled and comparative effectiveness studies will be included. The comparators may be:

    Active control intervention:

    • another TBI

    • face-to-face psychotherapy

    • psychopharmacological treatment

    • combined treatment (psychological and pharmacological treatment)

    • other active treatments (eg, exercise, relaxation, acupuncture)

    Inactive control intervention:

    • waitlist

    • no-treatment control (only assessments administered to participants)

    • attention-placebo/non-specific control (participants receive a treatment that involves non-specific psychosocial factors, for example, social attention, group cohesion)

    • usual care

    Types of outcome measures

    Primary outcomes

    Primary effectiveness outcome

    1. Symptoms severity of depression (metric outcome on depression scales: depression at the end of the intervention)

      1. the Montgomery-Åsberg Depression Rating Scale (MADRS)37;

      2. the Hamilton Depression Rating Scale (HDRS)38;

      3. the Quick Inventory of Depressive Symptomatology (QIDS)39;

      4. the Patient Health Questionnaire—depression scale (PHQ-9)40;

      5. the Centre of Epidemiologic Studies Depression Scale Revised (CES-D)41;

      6. the Beck-Depression-Inventory version I or II (BDI I; BDI II)42 43;

      7. the Hospital Anxiety and Depression Scale—depression subscale (HADS-D)44;

      8. the Hospital Anxiety and Depression Scale—fullscale (HADS)44;

      9. any other reliable and valid depression symptom scale.

    Due to the long tradition of depression research, most instruments used in clinical trials are usually psychometrically sound. Such measures will be preferred throughout the review (either referenced and/or sufficient psychometric quality reported).

    Primary acceptance/safety outcome

    1. Dropout due to any reason.

    Secondary outcomes

    1. Remission rate of depression, preferentially defined as

      1. no longer fulfilling the formal diagnostic criteria for depression (DSM, ICD);

      2. scoring below the threshold of clinical relevance on a depression symptom rating scale used by the authors (see above: primary outcomes).

    2. Response rate of depression, defined as 50% or greater symptom reduction in any depression rating scale used by the authors.

    3. Concerning aftercare studies: Relapse rate of depression (defined as the return of depressive symptoms before full remission has been achieved) or recurrence rate (defined as the (re)appearance of another new episode after full remission has been achieved), preferentially/formally defined/described as:

      1. fulfilment of formal diagnostic criteria for depression (DSM, ICD), or as

      2. exceeding a cut-off on a depression symptom rating scale.

    4. Metric outcomes on global scales of mental health, for example, Symptom-Checklist-90-Revised (SCL-90-R)45.

    5. (Health related) quality of life, for example, WHO Quality of Life46.

    6. Measures of social functioning, for example, Work and Social Adjustment Scale (WSAS)47.

    7. Measures of treatment satisfaction, for example, Client Satisfaction Questionnaire (CSQ-8)48.

    8. Dropout due to adverse events.

    9. Experiencing any adverse events.

    10. Serious adverse events (eg, suicidal behaviour).

    Timing of outcome assessment

    The primary outcome time point will be the ‘end of intervention’ (regardless of the duration of the intervention). Additionally, outcome will be evaluated at the time point ‘1 year after the end of intervention’ providing that enough data are available. If 1-year data are not available, we will use data that range between 6 and 18 months after the end of intervention with a preference for the time that was closest to 1 year after the end of intervention.

    Hierarchy of outcome measures

    If more than one diagnostic definition and/or depression symptom rating scale will be available, the presented hierarchy according to the UK National Institute for Health and Clinical excellence49 will be applied to select measures, starting with: (i) MADRS, (ii) HDRS, (iii) QIDS and so on (see primary effectiveness outcomes).

    When considering the secondary outcomes 6–12, we will not predefine a hierarchy, as we expect that these outcomes will not be assessed by different tools. If authors of included studies used more than one tool (eg, different rating scales evaluating quality of life) to assess the same secondary outcome, we will choose the tool providing the best psychometrically features (regarding reliability, internal consistency, etc).

    Search methods for identification of studies

    Electronic searches

    The following databases will be searched by using relevant subject headings (standard vocabulary; for example, Medical Subject headings), free text terms and search syntax (eg, Boolean logic), tailored to each database (see online supplementary file 1):

    • Cochrane Central Register of Controlled Trials (CENTRAL)

    • OVID Medline

    • OVID PsycINFO

    • OVID PSYNDEX

    • EBSCOhost CINAHL (Complete)

    Supplementary file 1

    Reviews conducting research in related fields were used to identify appropriate search terms (eg, standard/controlled vocabulary and keywords).24 50–52 PICOS categories (population; intervention; comparator; outcome; study design)32 53 served as a framework structuring our systematic search.

    We have screened records from CENTRAL roughly and optimised our search strategies prior to running further databases in order to prevent too many irrelevant references. Our search will not be restricted by date, language or publication status.

    Complementary searches in clinical trial registers will be conducted to identify ongoing or non-published studies; the databases are as follows:

    • Clinicaltrials.gov

    • International Clinical Trials Registry Platform

    • German Clinical Trial Register (Deutsches Register Klinischer Studien)

    Searching other resources

    Grey literature

    We will conduct electronic searches in sources of grey literature presented below:

    Our search syntax for electronic searches was adopted for electronic searches of grey literature (eg, standardised vocabulary will not be considered in each database).

    Reference lists (forward and backward reference search)

    Reference lists of all relevant publications (included studies and relevant systematic reviews) will be searched. Cited reference search on the ISI Web of Science will be performed for all included publications.

    Expert contacts/Correspondence

    The first author of all included publications will be contacted for further information regarding published and unpublished trials.

    Data collection and analysis

    Selection of studies

    Two review authors will independently screen titles and abstracts of 100 records and code them as’ retrieve’ (eligible or potentially eligible/unclear) or’ do not retrieve’ (ineligible). We will calculate inter-rater reliability for these (probe) records. If reliability between review authors is sufficiently high (r ≥. 90), one review author will screen the remaining records. Records that are labelled as ‘unclear’ will be reviewed by a second review author. In the case of insufficient reliability between review authors, all records will be seen by two review authors. The selected full text publications will be screened for inclusion by two independent review authors. We will record the specific reason for exclusion according to PICOS criteria for each study. Discrepancies will be resolved by discussion with a third review author. Duplicates will be excluded and multiple reports focusing on the same study will be collated so that each study rather than each report is the unit of interest in the review. The selection process will be displayed by a PRISMA flow diagram.33

    Data extraction and management

    We will develop a data collection sheet, operationalising all characteristics to be extracted. We will pilot the data collection sheet regarding completeness and applicability on at least one study in this review. Study characteristics and outcome data from included studies will be extracted independently by two review authors. We aim to extract the following characteristics:

    • general information (eg, year of publication);

    • methodological characteristics (eg, information concerning risk of bias assessment according to the Cochrane Collaboration’s tool32);

    • demographic and clinical sample characteristics (eg, age distribution, psychiatric and/or somatic comorbidities);

    • clinical phases of depression management (eg, acute treatment) and formats of implementation in care models (eg, stand-alone treatment);

    • treatment characteristics (eg, applied technologies to deliver the intervention, intensity of human support, theoretical foundation of applied treatments [eg, based on CBT, IPT]);

    • sample size and study flow (eg, number of randomised participants, number of dropouts per treatment arm);

    • primary and secondary outcome data.

    Any discrepancies will be resolved by discussion or by consulting a third review author.

    Main comparisons

    The main comparisons depend on the clinical phases of depression management and formats of implementation in care models (see table 1). The chosen comparisons were selected on the basis of clinical importance and expected frequency.

    Assessment of risk of bias in included studies

    Two review authors will independently assess risk of bias for the included studies—as described in the guidelines of the Cochrane Handbook for Systematic Reviews of Interventions32:

    • Random sequence generation

    • Allocation concealment

    • Blinding of participants and personnel

    • Blinding of outcome assessment

    • Incomplete outcome data

    • Selective outcome reporting

    • Other bias

    We will assess the risk of bias for each domain as low, high or unclear. In addition, we will justify each risk of bias judgement by providing a quotation from the study combined with a justification for our judgement in the ‘Risk of Bias’ table. We will resolve any discrepancies by consensus or if necessary by consulting a third review author.

    Statistical analysis

    Measures of treatment effect

    Continuous data

    Mean differences (MD) will be calculated to analyse continuous data, if the included studies use the same outcome measures. If primary studies use different measures to evaluate the outcome, standardised mean differences (SMD) will be computed.

    Dichotomous data

    In order to support clinicians and patients to make informed decisions in the clinical context, we will report remission/response rates, overall dropout rates as well as relapse/recurrence rates as relative risks. We will estimate odds ratios for rare outcomes (eg, occurring of adverse events) or endpoints with highly varying baseline rates. In case of time-to event data in the included studies, we will calculate pooled hazard ratios. The number needed to treat will be computed for each of our outcomes to increase interpretability of our findings and support informed decision-making of clinicians. We will enter data presented as a scale with a consistent direction of effect.

    Dealing with missing data

    In case of missing or unclear data, we will contact corresponding authors or study sponsors in order to obtain key study characteristics and missing numerical outcome data when possible (eg, when a study is identified as abstract only). We will document all requests and correspondences. If certain outcomes (eg, response rates) are not reported as expected in included studies, we will estimate dichotomous from appropriate metric variables (and vice versa when necessary).32 54

    Intention-to-treat (ITT) analysis will be used when reported. We will consider whether ITT analysis was computed in the ‘Risk of bias’ table. When studies will not provide ITT analysis, we will ask corresponding authors for further information. If no further information on ITT data will be available we will impute data if possible (using appropriate methods for calculating imputations55) or we will use reported data of included studies if imputation is not possible.

    Assessment of heterogeneity

    We will investigate statistical heterogeneity in primary studies by using Cochran’s Q-test and will quantify it using the I² statistic.56 We will display our results visually as forest plots. The ranges for the interpretation of the I² statistics will follow the Cochrane Handbook32:

    • 0% to 40%: might not be important,

    • 30% to 60%: may represent moderate heterogeneity,

    • 50% to 90%: may display substantial heterogeneity,

    • 75% to 100%: considerable heterogeneity.

    All I² values ranging from 50% to 100% display a relevant statistical heterogeneity, which should be explored in subsequent analysis. Nevertheless, we will decide on a case-by-case basis if the quantified statistical heterogeneity needs to be explored further as the individual meaning of the detected heterogeneity depends on various factors, not only on the defined thresholds.32 57

    Assessment of reporting biases

    Possible publication biases and small-study effects will be tested using visual examination of funnel plots for the primary outcomes. When considering continuous outcomes measuring intervention effects as mean differences, we will use Egger’s test to test for funnel plot asymmetry.58 Intervention effects displayed as risk ratios, risk differences and standardised mean differences will be examined only visually as there are no (current) well-established tests for asymmetry available.32 59 We will analyse funnel plot asymmetry for dichotomous outcomes measured as odds ratios by applying the test which was proposed by Harbord et al 60.

    Data synthesis

    We will run meta-analyses by applying random effects models.61 We assume that the primary studies will vary considerably regarding sample, treatment, and methodological characteristics. In addition, we aim to draw conclusions which allow us to generalise beyond the studies included in our meta-analysis.62 If clinical and/or methodological heterogeneity of the included studies proves to be extremely high, a qualitative rather than a quantitative synthesis of the evidence will be performed.

    Subgroup analyses

    To identify effect modifiers, we will calculate a priori defined subgroup analyses (in case of categorical variables) or meta-regression analyses (in case of continuous variables), provided that enough studies are available.32 We will formally test differences between before-specified subgroups.63–65 All meta-regression analyses will be performed using the restricted maximum likelihood method, a recommended random effects approach that accounts for residual between-trial heterogeneity.66 We will run analyses on the following variables grouped into clinical patient characteristics (depression severity, comorbidity) and treatment characteristics (type of applied intervention, intensity of therapist guidance in the intervention group, type of comparator).

    Sensitivity analysis

    We will perform sensitivity analyses to explore the robustness of our findings. The sensitivity analyses will focus on primary outcomes. We will carry out the sensitivity analyses on characteristics suspected to bias our findings, as follows:

    • Study quality: studies rated with a high or unclear risk of bias (separately for each of the seven assessed domains according to the risk of bias tool of the Cochrane Handbook) will be excluded. Results will be contrasted to those acquired with data from all studies in order to control for possible effects of study quality on pooled effects.

    Further relevant sensitivity analyses identified during the review process will be performed, where applicable.

    Assessment of the quality of the body of evidence

    We will use the Grading of Recommendations, Assessments, Development and Evaluation (GRADE) approach to assess the quality of the body of evidence67 for the primary outcomes. The quality of the body of evidence according to GRADE distinguishes four different categories: high, moderate, low, very low. GRADE allows to assess whether there is confidence in estimated effects of our review68 by judging factors like indirectness of evidence, imprecision of results, unexplained heterogeneity and possible publication bias.32 68 Results will be displayed in ‘Summary of findings tables’ following the Cochrane Handbook.32

    Study status

    Screening for eligibility is anticipated to be completed at the end of January 2019. We expect to finish data extraction at the end of June 2019 and data analyses will start in the middle of July 2019. Additionally, status information is available following the PROSPERO registration (CRD42016050413).

    Patient and public involvement

    We will offer workshops targeting people suffering from depression and their relatives to enhance relevance and acceptance of the presented review. A first workshop took place in December 2017, aiming to provide information on systematic reviews and TBIs in general and to discuss, which outcomes were most important from a patient or relative perspective.69 By collecting these outcomes (eg, sleep quality, measures of quality of life, daily life functioning), our review may show to which extent patient-relevant outcomes will be reported in included studies. Infrequent consideration of the patient perspective could stimulate future research efforts by expanding research foci on the patient perspective. The second workshop will be conducted at the end of the project in order to discuss the results, the plain language summary, as well as dissemination strategies addressing the general population.

    Dissemination

    First, our review will provide a comprehensive summary structuring the empirical evidence on TBIs.25 Second, meta-analytical comparisons focusing on clinical phases of depression management will be presented. Third, possible treatment effect modifiers will be identified. Fourth, we will explore acceptance and safety of TBIs.

    We will disseminate findings of the review as publications in peer-reviewed journals and in plain language on the e-mental health portal psychenet.de.70 Additionally, we will present findings on both national and international conferences, for instance the German Society for Psychiatry, Psychotherapy and Neuropsychiatry (in German: Deutsche Gesellschaft für Psychiatrie und Psychotherapie, Psychosomatik und Nervenheilkunde) and the International Society for Research on Internet Interventions. The first author (MK) will make extracted data available on request after publishing the results, as we aim to foster the traceability of our results and to enable other researches to reanalyse our data. Any changes or deviations from this study protocol will be reported.

    Acknowledgments

    We thank Norbert Sunderbrink from the Medical Library of the University Medical Center Hamburg-Eppendorf for his support in developing search strategies for primary literature and grey literature. We thank Mareike Dreier for her support in the process of full-text screening and data extraction.

    References

    1. 1.↵
      DGPPN, BÄK, KBV, et al. Version 5 [S3-Guideline/National Disease Management Guidline Unipolar Depression – Long Version, 2nd edition. 2015. Version 5]. In: DGPPN, BÄK, KBV, et al. eds, S3-Leitlinie/Nationale VersorgungsLeitlinie Unipolare Depression - Langfassung, 2. Auflage. 2nd edition, 2015.
    2. 2.↵
      2. Cabello M ,
      3. Mellor-Marsá B ,
      4. Sabariego C , et al
      . Psychosocial features of depression: a systematic literature review. J Affect Disord 2012;141:22–33.doi:10.1016/j.jad.2011.12.009
      OpenUrlPubMed
    3. 3.↵
      2. Frei A ,
      3. Ajdacic-Gross V ,
      4. Rössler W , et al
      . Auswirkungen von depressiven Störungen auf objektive Lebensqualitätsbereiche [Effects of Depressive Disorders on Objective Life Quality Criteria]. Psychiatr Prax 2004;31:298–303.
      OpenUrlPubMed
    4. 4.↵
      2. Chesney E ,
      3. Goodwin GM ,
      4. Fazel S
      . Risks of all-cause and suicide mortality in mental disorders: a meta-review. World Psychiatry 2014;13:153–60.doi:10.1002/wps.20128
      OpenUrlCrossRefPubMedWeb of Science
    5. 5.↵
      2. Sartorius N
      . The economic and social burden of depression. J Clin Psychiatry 2001;62(Suppl.15):8–11.
      OpenUrlCrossRefPubMedWeb of Science
    6. 6.↵
      Statistisches Bundesamt. Gesundheit. Krankheitskosten [Health. Sickness costs]. Fachserie 12. Reihe 7.2. Wiesbaden: Statistisches Bundesamt, 2010.
    7. 7.↵
      World Health Organization, editor. The Global Burden of Disease: 2004 Update. Geneva: WHO Press, 2008.
    8. 8.↵
      National Collaborating Centre for Mental Health. Depression: the treatment and management of depression in adults (updated edition): The British Psychological Society and The Royal College of Psychiatrists. 2010 http://www.nice.org.uk/nicemedia/live/12329/45896/45896.pdf (Accessed 05 Jul 2018).
    9. 9.↵
      2. Cuijpers P ,
      3. Berking M ,
      4. Andersson G , et al
      . A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatry 2013;58:376–85.doi:10.1177/070674371305800702
      OpenUrlCrossRefPubMed
    10. 10.↵
      2. de Mello MF ,
      3. de Jesus Mari J ,
      4. Bacaltchuk J , et al
      . A systematic review of research findings on the efficacy of interpersonal therapy for depressive disorders. Eur Arch Psychiatry Clin Neurosci 2005;255:75–82.doi:10.1007/s00406-004-0542-x
      OpenUrlCrossRefPubMedWeb of Science
    11. 11.↵
      2. Mitchell AJ ,
      3. Vaze A ,
      4. Rao S
      . Clinical diagnosis of depression in primary care: a meta-analysis. Lancet 2009;374:609–19.doi:10.1016/S0140-6736(09)60879-5
      OpenUrlCrossRefPubMedWeb of Science
    12. 12.↵
      2. Mack S ,
      3. Jacobi F ,
      4. Gerschler A , et al
      . Self-reported utilization of mental health services in the adult German population-evidence for unmet needs? Results of the DEGS1-Mental Health Module (DEGS1-MH). Int J Methods Psychiatr Res 2014;23:289–303.doi:10.1002/mpr.1438
      OpenUrl
    13. 13.↵
      2. Andrade LH ,
      3. Alonso J ,
      4. Mneimneh Z , et al
      . Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2014;44:1303–17.doi:10.1017/S0033291713001943
      OpenUrlCrossRefPubMed
    14. 14.↵
      2. Christensen H ,
      3. Hickie IB
      . E-mental health: a new era in delivery of mental health services. Med J Aust 2010;192:2–3.
      OpenUrl
    15. 15.↵
      2. Anderson C ,
      3. Henner T ,
      4. Burkey J
      . Tablet computers in support of rural and frontier clinical practice. Int J Med Inform 2013;82:1046–58.doi:10.1016/j.ijmedinf.2013.08.006
      OpenUrlCrossRefPubMed
    16. 16.↵
      2. Benavides-Vaello S ,
      3. Strode A ,
      4. Sheeran BC
      . Using technology in the delivery of mental health and substance abuse treatment in rural communities: a review. J Behav Health Serv Res 2013;40:111–20.doi:10.1007/s11414-012-9299-6
      OpenUrlCrossRefPubMed
    17. 17.↵
      2. Carrard I ,
      3. Rouget P ,
      4. Fernández-Aranda F , et al
      . Evaluation and deployment of evidence based patient self-management support program for Bulimia Nervosa. Int J Med Inform 2006;75:101–9.doi:10.1016/j.ijmedinf.2005.07.031
      OpenUrlPubMed
    18. 18.↵
      2. Townsend L ,
      3. Gearing RE ,
      4. Polyanskaya O
      . Influence of health beliefs and stigma on choosing internet support groups over formal mental health services. Psychiatr Serv 2012;63:370–6.doi:10.1176/appi.ps.201100196
      OpenUrlCrossRefPubMed
    19. 19.↵
      2. Gun SY ,
      3. Titov N ,
      4. Andrews G
      . Acceptability of Internet treatment of anxiety and depression. Australas Psychiatry 2011;19:259–64.doi:10.3109/10398562.2011.562295
      OpenUrlCrossRefPubMedWeb of Science
    20. 20.↵
      2. Andrews G ,
      3. Cuijpers P ,
      4. Craske MG , et al
      . Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5:e13196.doi:10.1371/journal.pone.0013196
    21. 21.↵
      2. Rost T ,
      3. Stein J ,
      4. Löbner M , et al
      . User Acceptance of Computerized Cognitive Behavioral Therapy for Depression: Systematic Review. J Med Internet Res 2017;19:e309.doi:10.2196/jmir.7662
      OpenUrl
    22. 22.↵
      2. Musiat P ,
      3. Tarrier N
      . Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med 2014;44:3137–50.doi:10.1017/S0033291714000245
      OpenUrlCrossRefPubMed
    23. 23.↵
      2. Hedman E ,
      3. Ljótsson B ,
      4. Lindefors N
      . Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012;12:745–64.doi:10.1586/erp.12.67
      OpenUrlCrossRefPubMed
    24. 24.↵
      2. Arnberg FK ,
      3. Linton SJ ,
      4. Hultcrantz M , et al
      . Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLoS One 2014;9:e98118.doi:10.1371/journal.pone.0098118
    25. 25.↵
      2. Ebert DD ,
      3. Van Daele T ,
      4. Nordgreen T , et al
      . Internet- and Mobile-Based Psychological Interventions: Applications, Efficacy, and Potential for Improving Mental Health. Eur Psychol 2018;23:167–87.doi:10.1027/1016-9040/a000318
      OpenUrl
    26. 26.↵
      2. Holländare F ,
      3. Johnsson S ,
      4. Randestad M , et al
      . Randomized trial of Internet-based relapse prevention for partially remitted depression. Acta Psychiatr Scand 2011;124:285–94.doi:10.1111/j.1600-0447.2011.01698.x
      OpenUrlPubMedWeb of Science
    27. 27.↵
      2. Perini S ,
      3. Titov N ,
      4. Andrews G
      . Clinician-assisted Internet-based treatment is effective for depression: randomized controlled trial. Aust N Z J Psychiatry 2009;43:571–8.doi:10.1080/00048670902873722
      OpenUrlCrossRefPubMedWeb of Science
    28. 28.↵
      2. Wright JH ,
      3. Wright AS ,
      4. Albano AM , et al
      . Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. Am J Psychiatry 2005;162:1158–64.doi:10.1176/appi.ajp.162.6.1158
      OpenUrlCrossRefPubMedWeb of Science
    29. 29.↵
      2. Richards D ,
      3. Richardson T
      . Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012;32:329–42.doi:10.1016/j.cpr.2012.02.004
      OpenUrlCrossRefPubMed
    30. 30.↵
      2. Kaltenthaler E ,
      3. Parry G ,
      4. Beverley C , et al
      . Computerised cognitive-behavioural therapy for depression: systematic review. Br J Psychiatry 2008;193:181–4.doi:10.1192/bjp.bp.106.025981
      OpenUrlAbstract/FREE Full Text
    31. 31.↵
      2. Andersson G ,
      3. Cuijpers P
      . Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 2009;38:196–205.doi:10.1080/16506070903318960
      OpenUrlCrossRefPubMed
    32. 32.↵
      2. Higgins JPT ,
      3. Green S
      , eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011] : The Cochrane Collaboration . 2011. Available from www.handbook.cochrane.org
    33. 33.↵
      2. Moher D ,
      3. Liberati A ,
      4. Tetzlaff J , et al
      . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009;151:264–9.doi:10.7326/0003-4819-151-4-200908180-00135
      OpenUrlCrossRefPubMedWeb of Science
    34. 34.↵
      World Health Organization. International Statistical Classification of Diseases, 10th Revision (ICD-10). Geneva: World Health Organization, 1992.
    35. 35.↵
      American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th Edition (DSM-5). Arlington: American Psychiatric Publishing, 2013.
    36. 36.↵
      2. Kessler RC ,
      3. Andrews G ,
      4. Mroczek D , et al
      . The World Health Organization Composite International Diagnostic Interview short-form (CIDI-SF). Int J Methods Psychiatr Res 1998;7:171–85.doi:10.1002/mpr.47
      OpenUrlCrossRef
    37. 37.↵
      2. Montgomery SA ,
      3. Asberg M
      . A new depression scale designed to be sensitive to change. Br J Psychiatry 1979;134:382–9.doi:10.1192/bjp.134.4.382
      OpenUrlAbstract/FREE Full Text
    38. 38.↵
      2. Hamilton M
      . A rating scale for depression. J Neurol Neurosurg Psychiatry 1960;23:56–62.doi:10.1136/jnnp.23.1.56
      OpenUrlFREE Full Text
    39. 39.↵
      2. Rush AJ ,
      3. Trivedi MH ,
      4. Ibrahim HM , et al
      . The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry 2003;54:573–83.doi:10.1016/S0006-3223(02)01866-8
      OpenUrlCrossRefPubMedWeb of Science
    40. 40.↵
      2. Kroenke K ,
      3. Spitzer RL ,
      4. Williams JB
      . The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001;16:606–13.
      OpenUrlCrossRefPubMedWeb of Science
    41. 41.↵
      2. Radloff LS
      . The CES-D scale: A self-report depression scale for research in the general population. Appl Psychol Meas 1977;1:385–401.
      OpenUrlCrossRef
    42. 42.↵
      2. Beck A ,
      3. Ward C ,
      4. Mendelson M , et al
      . An Inventory for Measuring Depression. Arch Gen Psychiatry 1961;4 :561–71.
      OpenUrlCrossRefPubMedWeb of Science
    43. 43.↵
      2. Beck A ,
      3. Steer R ,
      4. Brown G
      . BDI-II, Beck depression inventory: manual. San Antonio, TX: The Psychological Corporation, 1996.
    44. 44.↵
      2. Zigmond AS ,
      3. Snaith RP
      . The hospital anxiety and depression scale. Acta Psychiatr Scand 1983;67:361–70.doi:10.1111/j.1600-0447.1983.tb09716.x
      OpenUrlCrossRefPubMedWeb of Science
    45. 45.↵
      2. Derogatis LR
      . SCL-90-R: Administration, Scoring & procedures manual for the Revised Version. Townson: Clin Psychomet Res 1983.
    46. 46.↵
      2. Skevington SM ,
      3. Lotfy M ,
      4. O’Connell KA
      . The World Health Organization’s WHOQOL-BREF quality of life assessment: Psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res 2004;13:299–310.doi:10.1023/B:QURE.0000018486.91360.00
      OpenUrlCrossRefPubMedWeb of Science
    47. 47.↵
      2. Mundt JC ,
      3. Marks IM ,
      4. Shear MK , et al
      . The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatry 2002;180:461–4.doi:10.1192/bjp.180.5.461
      OpenUrlAbstract/FREE Full Text
    48. 48.↵
      2. Attkisson CC ,
      3. Zwick R
      . The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Program Plann 1982;5:233–7.
      OpenUrlCrossRefPubMed
    49. 49.↵
      National Collaborating Centre for Mental Health. Depression: the treatment and management of depression in adults: Full guideline(draft for consultation) 2017 [(draft for consultation)]. 2017 https://www.nice.org.uk/guidance/gid-cgwave0725/documents/draft-guideline (Accessed 02 May 2018).
    50. 50.↵
      2. Bee PE ,
      3. Bower P ,
      4. Lovell K , et al
      . Psychotherapy mediated by remote communication technologies: a meta-analytic review. BMC Psychiatry 2008;8:60.doi:10.1186/1471-244X-8-60
    51. 51.↵
      2. Thabrew H ,
      3. Stasiak K ,
      4. Hetrick SE , et al
      . Psychological therapies for anxiety and depression in children and adolescents with long‐term physical conditions. Cochrane Database Syst Rev 2017;Issue 1.doi:10.1002/14651858.CD012488
    52. 52.↵
      2. Eccleston C ,
      3. Fisher E ,
      4. Craig L , et al
      . Psychological therapies (Internet-delivered) for the management of chronic pain in adults. Cochrane Database Syst Rev 2014;Issue 2:CD010152.doi:10.1002/14651858.CD010152.pub2
      OpenUrlPubMed
    53. 53.↵
      2. Counsell C
      . Formulating questions and locating primary studies for inclusion in systematic reviews. Ann Intern Med 1997;127:380–7.doi:10.7326/0003-4819-127-5-199709010-00008
      OpenUrlCrossRefPubMedWeb of Science
    54. 54.↵
      2. Meister R ,
      3. von Wolff A ,
      4. Kriston L
      . Odds ratios of treatment response were well approximated from continuous rating scale scores for meta-analysis. J Clin Epidemiol 2015;68:740–51.doi:10.1016/j.jclinepi.2015.02.006
      OpenUrl
    55. 55.↵
      2. Mavridis D ,
      3. Chaimani A ,
      4. Efthimiou O , et al
      . Addressing missing outcome data in meta-analysis. Evid Based Ment Health 2014;17:85–9.doi:10.1136/eb-2014-101900
      OpenUrlAbstract/FREE Full Text
    56. 56.↵
      2. Higgins JP ,
      3. Thompson SG ,
      4. Deeks JJ , et al
      . Measuring inconsistency in meta-analyses. BMJ 2003;327:557–60.doi:10.1136/bmj.327.7414.557
      OpenUrlFREE Full Text
    57. 57.↵
      2. Kriston L
      . Dealing with clinical heterogeneity in meta-analysis. Assumptions, methods, interpretation. Int J Methods Psychiatr Res 2013;22:1–15.doi:10.1002/mpr.1377
      OpenUrlCrossRefPubMed
    58. 58.↵
      2. Sterne JA ,
      3. Egger M ,
      4. Smith GD
      . Investigating and dealing with publication and other biases. In: Egger M , Smith GD , Altman DG , eds. Systematic reviews in health care: meta‐analysis in context.  London: BMJ Publishing Group, 2003:248–82.
    59. 59.↵
      2. Sterne JA ,
      3. Sutton AJ ,
      4. Ioannidis JP , et al
      . Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011;343:d4002.doi:10.1136/bmj.d4002
      OpenUrlFREE Full Text
    60. 60.↵
      2. Harbord RM ,
      3. Egger M ,
      4. Sterne JA
      . A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med 2006;25:3443–57.doi:10.1002/sim.2380
      OpenUrlCrossRefPubMedWeb of Science
    61. 61.↵
      2. DerSimonian R ,
      3. Laird N
      . Meta-analysis in clinical trials. Control Clin Trials 1986;7:177–88.doi:10.1016/0197-2456(86)90046-2
      OpenUrlCrossRefPubMedWeb of Science
    62. 62.↵
      2. Field AP ,
      3. Gillett R
      . How to do a meta-analysis. Br J Math Stat Psychol 2010;63:665–94.doi:10.1348/000711010X502733
      OpenUrlCrossRefPubMed
    63. 63.↵
      2. Bucher HC ,
      3. Guyatt GH ,
      4. Griffith LE , et al
      . The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol 1997;50:683–91.doi:10.1016/S0895-4356(97)00049-8
      OpenUrlCrossRefPubMedWeb of Science
    64. 64.↵
      2. Deeks JJ ,
      3. Altman DG ,
      4. Bradburn MJ
      . Statistical methods for examining heterogeneity and combining results from several studies in meta‐analysis. In: Egger M , Smith GD , Altman DG , eds. Systematic Reviews in Health Care: Meta-Analysis in Context: BMJ Publishing Group, 2008:285–312.
    65. 65.↵
      2. Song F ,
      3. Altman DG ,
      4. Glenny AM , et al
      . Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ 2003;326:472.doi:10.1136/bmj.326.7387.472
      OpenUrlAbstract/FREE Full Text
    66. 66.↵
      2. Thompson SG ,
      3. Sharp SJ
      . Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med 1999;18:2693–708.doi:10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V
      OpenUrlCrossRefPubMedWeb of Science
    67. 67.↵
      2. Guyatt G ,
      3. Oxman AD ,
      4. Akl EA , et al
      . GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011;64:383–94.doi:10.1016/j.jclinepi.2010.04.026
      OpenUrlCrossRefPubMed
    68. 68.↵
      2. Balshem H ,
      3. Helfand M ,
      4. Schünemann HJ , et al
      . GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol 2011;64:401–6.doi:10.1016/j.jclinepi.2010.07.015
      OpenUrlCrossRefPubMedWeb of Science
    69. 69.↵
      2. Brütt AL ,
      3. Meister R ,
      4. Bernges T , et al
      . Patient involvement in a systematic review: Development and pilot evaluation of a patient workshop. Z Evid Fortbild Qual Gesundhwes 2017;127-128:56–61.doi:10.1016/j.zefq.2017.07.005
      OpenUrl
    70. 70.↵
      2. Dirmaier J ,
      3. Liebherz S ,
      4. Sänger S , et al
      . Psychenet.de: Development and process evaluation of an e-mental health portal. Inform Health Soc Care 2016;41:267–85.doi:10.3109/17538157.2015.1008486
      OpenUrl

    Footnotes

    • Contributors SL, LK, JD and MH designed the study and applied for funding. SL, MK and LK prepared the detailed study protocol. SL and MK are responsible for data collection and data management. SL, MK and LK will be responsible for data analyses and all authors will contribute to interpretation of the results. MK and SL drafted the manuscript, with important intellectual contributions from LK, MH and JD. All authors read and approved the final manuscript.

    • Funding The Federal Ministry of Education and Research (in German: Bundesministerium für Bildung und Forschung; BMBF) is funding this study (funding code: 01KG1705, funding period: 08/2017 to 02/2019). The funding institution had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data, or the decision to submit results.

    • Competing interests LK and MH have participated in the 2015 revision of the German S3 national clinical practice guideline on the treatment of adults with unipolar depression. MH, SL and JD are licensed psychotherapists. SL is additionally employed at the institute for psychotherapy at the UKE which provides psychotherapist training in behavior therapy. MK declares that he has no competing interests.

    • Provenance and peer review Not commissioned; peer reviewed for ethical and funding approval prior to submission.

    • Patient consent for publication Not required.