Article Text


A clinical audit of changes in suicide ideas with internet treatment for depression
  1. Sarah Watts,
  2. Jill M Newby,
  3. Louise Mewton,
  4. Gavin Andrews
  1. Clinical Research Unit for Anxiety and Depression, School of Psychiatry, University of New South Wales at St Vincent's Hospital, Darlinghurst,  New South Wales, Australia
  1. Correspondence to Dr Louise Mewton; louisem{at}

Statistics from

Article summary

Article focus

  • The reduction of suicidal ideation among patients treated for depression using internet cognitive behaviour therapy (iCBT) in clinical practice.

Key messages

  • Suicidal ideation is common among primary care patients prescribed iCBT for depression.

  • After treatment with iCBT, suicidal ideation decreased significantly.

  • The continued exclusion of these patients from research studies and iCBT is no longer justified.

Strengths and limitations of this study

  • Evidence is needed to see if the changes in suicidal ideation are sustained over time.

Patients who say they feel they would be ‘better off dead’ worry clinicians and, for that matter, research ethics committees approving depression trials, especially trials over the internet. As a consequence, patients reporting suicidal ideas are often excluded from internet treatment trials.1–3 Given that suicidal thoughts are an integral part of depression we sought data to provide a rational basis for inclusion/exclusion of people with suicidal ideas.

Rates of suicide can be reduced through treatment of depression or reduction in access to the means for suicide.4–6 The efficacy of cognitive behavioural therapy (CBT) in treating depression has been established. Suicidal ideas and attempts decrease, commensurate with reductions in depressive symptomatology.7–15 These studies have all been conducted within a clinical trial framework among depressed patients selected for their high suicide risk. To our knowledge, there is currently no evidence regarding the effectiveness of CBT or internet CBT (iCBT) in reducing suicidal ideation in the depressed patient seeking treatment in primary care, and no data to inform inclusion/exclusion criteria in clinical trials.

We have previously reported from two randomised controlled trials that the progress of patients receiving the iCBT course used in this study was significantly better than the progress of a waitlist control group.1 ,2 We have also reported from quality assurance studies that when these courses were used routinely by primary care clinicians that effectiveness was comparable to the efficacy and that adherence rates of 60% could be achieved.16 ,17 The aim of the current quality assurance study is to examine reductions in suicidal ideation among a sample of patients who were prescribed an iCBT course for depression by primary care clinicians.



Primary care physicians prescribed the internet depression course for patients they deemed suitable.1 They were advised to exclude people who were ‘actively suicidal’. As part of a routine quality assurance exercise we analysed the progress of the 299 primary care patients who completed the six-lesson iCBT depression course between April 2009 and May 2011.1 Data gathered were confined to measures used as a routine to inform practitioners about the progress of their patients. All patients agreed that their pooled data could be used for quality assurance purposes. This paper was written as part of the Quality Assurance activities of St Vincent's Hospital with whom the draft of the paper was lodged prior to submission.


The iCBT depression course consists of six lessons covering psycho-education, behavioural activation, cognitive restructuring, problem-solving, graded exposure and relapse prevention.1 ,2 Content is presented in the form of an illustrated story in which the character gains mastery over their depressive symptoms. At the end of each illustrated lesson the patient downloads ‘homework,’ comprising a summary of the lesson content, and activities to be completed that translate the skills learnt in the lesson to their own lives. Automatic emails are also sent congratulating patients when they complete lessons. Clinicians are advised to contact patients at least twice during the course.

Outcome measures

The Patient Health Questionnaire (PHQ-9) is a brief nine-item measure of depression severity.18 The nine-items assess Diagnostic and Statistical Manual-IV Criterion A for major depressive disorder (MDD). Patients rate each item in terms of the frequency of symptoms over the past 2 weeks, on a four-point scale (0=not at all, 1=several days, 2=more than half of the days and 3=nearly everyday). Scores can range from 0 to 27, with higher levels representing higher symptom severity. Cut points for MDD have been established as follows: 0–9=well or subthreshold, 10–14=mild, 15–19=moderate and 20–27=severe depression.19. Suicidal ideation was measured by question 9 from the PHQ-9 which asks about the frequency of suicidal ideation (‘thoughts that you would be better off dead, or of hurting yourself in some way’) in the previous 2 weeks using the above four-point scale. The PHQ-9 has been shown to demonstrate adequate reliability, convergent/discriminant validity and responsiveness to change in previous studies of iCBT,20 with a Cronbach's α of 0.89 in the current sample.

Statistical analysis

Changes in participants' PHQ-9 scores from pre-treatment to post-treatment were analysed using a paired samples t test. Multivariate linear regression controlling for baseline PHQ-9 scores was used to investigate the effect of sex and age on post-treatment PHQ-9 scores. A Wilcoxon signed-rank test was used to analyse differences in suicidal ideation in response to treatment. Multinomial logistic regression controlling for baseline suicidality investigated the effect of sex and age on post-treatment suicidal ideation. An α of 0.05 was used to test statistical significance.


Baseline characteristics

The mean age of the 299 patients who completed the six lesson course was 43 years, 56% female. The mean baseline PHQ-9 score was 14.3 with 83 patients scoring 0–9 (well or subthreshold MDD), and 216 scoring 10–27 and likely to meet criteria for MDD (n=72 mild, n=70 moderate and n=74 severe MDD). Prior to the start of lesson 1, 54% of the patients (162/299) reported some level of suicidal ideation on question 9 of the PHQ-9: 30% (91/299) had thought about it for several days in the past 2 weeks, 15% (45/299) thought about it more than half the days and 9% (26/299) indicated that they thought about suicide nearly everyday.

Post-treatment outcomes

From pre-treatment to post-treatment there was a significant reduction in PHQ-9 scores (t(298)=18.1, p<0.001), with PHQ-9 scores reducing by 6.2 points on average (SD=5.9; d=0.98 (95% CI)). A multivariate linear regression controlling for baseline PHQ-9 scores indicated that age and gender were not statistically significant predictors of post-treatment PHQ-9 scores. The reduction in suicidal ideation was considerable and evident at all frequencies, with only 30% (90/299) reporting suicidal ideation at lesson six (see figure 1). A Wilcoxin signed-rank test showed a statistically significant change in suicidal ideation (Z=−7.9, p<0.001, r=0.5) as measured by question 9 on the PHQ-9 (table 1), with median scores of 1 (‘several days’) preintervention and 0 (‘not at all’) postintervention. A multinomial logistic regression controlling for baseline suicidal ideation scores indicated that age and gender were not statistically significant predictors of postintervention suicidal ideation scores. Patient reported a median of 1 (range 0–2) clinician contacts during the course (table 1).

Table 1

Frequency of suicidal thoughts as measured by Question 9 of the PHQ-9

Figure 1

Frequency of suicidal thoughts (number of patients) before and after treatment for depression.


Suicidal ideation was common (54%) among primary care patients prescribed treatment for depression but dropped to 30% post-treatment despite minimal clinician contact and the absence of an intervention focused on suicidal ideation. This reduction in suicidal ideation was evident regardless of sex and age. To our knowledge, this is the first study to document an association between iCBT for depression and reductions in suicidal ideation.

The benefits in reducing suicidal ideas are clear. Suicidal behaviour lies on a continuum from thoughts, through intent and planning, to attempt. In the general population it has been shown that 34% of people with ideas develop suicidal plans, and that these plans lead to suicide attempts in 72% of cases.15 ,21 That is, one in four people who report suicidal ideation will transition to a suicide attempt, most within the first year of ideation onset.21 Suicide attempts are significant predictors of subsequent completed suicide. Suicidal ideas are distressing and dangerous, and therefore an important target for treatment.

We have conducted two randomised controlled trials of our iCBT programme for depression.1 ,2 In the first trial, 33% of applicants were excluded due to suicidal ideation. In the second, 23% were excluded due to suicidal ideation. On the basis of the current results it is now difficult to justify excluding patients from clinical trials on the basis of their high suicidal ideation scores when iCBT can reduce them quickly and effectively.


Although the item from the PHQ-9 assessed the presence and frequency of suicidal ideation, it did not assess the intensity of the ideation, controllability, intention to act on thoughts, nor suicide plans or means. Evidence is also needed to understand whether the changes in suicidal ideation observed in this study are sustained over time. In addition, there was no control sample, meaning that treatment effects could be attributable to regression to the mean, spontaneous remission or placebo effects, rather than the intervention per se. The fact that benefits were observed among patients at different levels of baseline risk indicates that regression to the mean may not underlie treatment effects. However, it is not possible to fully examine the influence of these alternative factors on the outcomes of interest. It was also not possible to establish whether treatment effects were sustained over time due to the lack of follow-up data. Finally, the lack of formal exclusion criteria means that patients may have been using adjunctive treatments which contributed to the magnitude of treatment effects. While the limitations outlined above may be critical within the context of an efficacy trial, they are endemic to effectiveness research.


Both suicidal ideation and depressive symptomatology were reduced considerably following completion of a six-lesson iCBT course for depression. This is the first study to demonstrate this association in primary care. At present, it is routine to exclude patients with frequent suicidal ideation from participating in iCBT. This study provides evidence for change.


View Abstract


  • Contributors SW drafted the initial manuscript, prepared and cleaned the data, and conducted initial data analysis. LM and JN conducted further statistical analysis. GA supervised and took responsibility for the data. All four authors contributed to revised drafts.

  • Funding SW and JN were supported by the Australian Government Department of Health and Ageing. LM was supported by an Australian National Health and Medical Research Council Capacity Building Grant.

  • Competing interests None.

  • Ethics approval Data gathered was confined to measures used as a routine to inform practitioners about the progress of their patients. All patients agreed that their pooled data could be used for quality assurance purposes. This paper was written as part of the Quality Assurance activities of St Vincent's Hospital with whom the draft of the paper was lodged prior to submission.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.