Objective To examine the evidence for the use of psychological and psychosocial interventions offered to forensic mental health inpatients.
Design CINAHL, MEDLINE, PsycINFO, ScienceDirect and Web of Science databases were searched for research published in English between 1 January 1990 and 31 May 2018.
Outcome measures Disturbance, mental well-being, quality of life, recovery, violence/risk, satisfaction, seclusion, symptoms, therapeutic relationship and ward environment. There were no limits on the length of follow-up.
Eligibility criteria We included randomised controlled trial (RCT) studies of any psychological or psychosocial intervention in an inpatient forensic setting. Pilot or feasibility studies were included if an RCT design was used.
We restricted our search criteria to inpatients in low, medium and high secure units aged over 18. We focused on interventions considered applicable to most patients residing in forensic mental health settings.
Data extraction and synthesis Two independent reviewers extracted data and assessed risk of bias.
Results 17 232 citations were identified with 195 full manuscripts examined in detail. Nine papers were included in the review. The heterogeneity of the identified studies meant that meta-analysis was inappropriate. The results were presented in table form together with a narrative synthesis. Only 7 out of 91 comparisons revealed statistically significant results with no consistent significant findings. The most frequently reported outcomes were violence/risk and symptoms. 61% of the violence/risk comparisons and 79% of the symptom comparisons reported improvements in the intervention groups compared with the control groups.
Conclusions Current practice is based on limited evidence with no consistent significant findings. This review suggests psychoeducational and psychosocial interventions did not reduce violence/risk, but there is tentative support they may improve symptoms. More RCTs are required with: larger sample sizes, representative populations, standardised outcomes and control group interventions similar in treatment intensity to the intervention.
PROSPERO registration number CRD42017067099.
- mental health
- systematic review
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
This is the first published review examining psychological or psychosocial interventions that could be accessed by the majority of forensic mental health inpatients.
Good quality randomised controlled trials are able to be undertaken in forensic settings to examine psychological and psychosocial interventions.
Current practice is based on limited evidence with no consistent findings.
Future large-scale trials are necessary to evaluate these interventions.
Forensic mental healthcare is distinct from other psychiatric services.1 Patients in forensic mental health inpatient services are a complex group with a strong likelihood of presenting with multiple problems and a range of offending behaviours. These patients are generally subject to mental health or criminal justice legislation. Forensic mental health services tasked with the rehabilitation of this group of patients have additional roles to those of generic adult mental health services2 with a dual rehabilitative role, providing interventions to restore mental well-being while reducing the risk posed by individuals in preparation for discharge to conditions of lower security.3
The therapies used with forensic mental health patients are generally based on research with non-offending patients in general mental health settings. The majority of these are not empirically tested in forensic populations. Reviewers have questioned the appropriateness of transposing these treatments4 with interventions viewed as effective in non-forensic settings having little or no effect in forensic settings.5 This raises doubts about the efficacy of interventions used in a forensic mental health context.
Previous reviews of interventions in forensic units have focused on specific populations such as patients with personality disorder6 7 or sex offenders.8 9 However, there have been no published reviews examining psychological or psychosocial interventions that could be accessed by the majority of forensic mental health inpatients. Determining whether forensic interventions are effective is imperative to support the principle of evidence-based practice in forensic services. Randomised controlled trials are the preferred option for generating this evidence, and though acknowledging a controlled trial design is hard to achieve in a secure inpatient setting, other specialities have overcome these challenges.10 This review examines psychological and psychosocial interventions offered to forensic mental health inpatients. We focused on those interventions not specific to one offending type and so considered applicable to most patients residing in forensic mental health settings.
This systematic review followed a prespecified protocol and is reported according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.
Intervention and outcomes
We included all studies reporting the results of a psychological or psychosocial intervention. These were defined broadly. Psychological interventions refer to treatments based on a theory of psychological functioning while psychosocial interventions represent less specific interventions designed to improve mental health through general support, advice and encouragement.11 This includes psychoeducational strategies, cognitive–behavioural therapy, interpersonal psychotherapy, non-directive counselling, supportive interactions and tangible assistance, through individual or group sessions.12 We were interested in 10 outcomes: disturbance, mental well-being, quality of life, recovery, violence/risk, satisfaction, seclusion, symptoms, therapeutic relationship and ward environment. The outcomes were based on the rated importance of outcome domains for forensic mental health research13 and the suitability of assessing these outcomes in forensic inpatient settings. There were no limits on the length of follow-up.
We only included randomised controlled trial studies. Pilot or feasibility studies were included if a randomised controlled trial design was used.
The title and abstracts of studies identified through the search strategy were screened for eligibility by one reviewer using the inclusion criteria. The second reviewer independently screened a 20% random selection of the studies. Any disagreements were resolved through discussions between the two reviewers. Full-text articles were obtained for all studies meeting the initial eligibility criteria. All full-text articles were then examined independently by both reviewers to determine their eligibility for inclusion in the review. Reference lists of all relevant articles were also searched. A data extraction sheet was developed to enable assessment and synthesis of the included studies.
We registered the protocol of our systematic review on 21 May 2017 on the PROSPERO database available at http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42017067099.
The focus of the review was to examine psychological and psychological interventions in forensic mental health settings. CINAHL, MEDLINE, PsycINFO, ScienceDirect and Web of Science databases were searched. We searched for peer-reviewed articles, working papers and policy reports, published in English between 1 January 1990 and 31 May 2018. The following search terms were used:
psychiatr* OR mental*
forensic OR secure OR disordered OR offender*
psycholog* OR psychosocial* OR therap*
quality OR wellbeing OR satisfaction OR recovery OR behavio* OR disturb* OR violen* OR seclusion OR abscond* OR symptom* OR environment OR atmosphere
RCT OR random* OR control* OR placebo OR TAU.
Inclusion and exclusion criteria
We included any psychological or psychosocial intervention given as an individual or group treatment in an inpatient forensic setting. We excluded interventions focusing specifically on a specific cohort (ie, sex offenders) as we were interested in examining approaches appropriate for the vast majority of inpatients in secure units.
We restricted our search criteria to forensic inpatients in low, medium and high secure units aged over 18 years. Our exclusion criteria included community settings where patients received treatment outside of the forensic unit or resided outside of the forensic unit when they were not receiving treatment. However, as detailed in the results section, we decided to include one study where a minority of the participants were residing in the community. We also excluded prison settings that are not deemed places of treatment under the Mental Health Act.
Risk of bias summary
We used the Cochrane Risk of Bias tool14 to evaluate six domains of bias: selection bias (random sequence of generation and allocation concealment), performance bias (blinding of participants and personnel), detection bias (blinding of outcome assessment), attrition bias (incomplete outcome data), reporting bias (selective outcome reporting) and other bias. The risk of bias for each domain was rated as high (seriously weakens confidence in the results), low (unlikely to seriously alter the results) or unclear. The risk of bias assessment was conducted by the authors separately. There was an average of 1–2 domain ratings per study where there was an initial disagreement. In all cases, the reviewers discussed and agreed the ratings without involving a third party reviewer.
Meta-analysis was initially planned but was considered inappropriate because of the heterogeneity of the identified studies due to: the different characteristics of the participant inpatient populations, the different types of approach used by the intervention and control groups and the different outcome measures being used. We therefore present the results in table form together with a narrative synthesis.
Patient and public involvement
Patients and the public were not involved in the design or analysis of this review.
Our search of the five databases yielded 33 321 hits with 17 232 hits recorded once duplicates were removed. A flow chart detailing the screening process is shown in figure 1.
The number of hits recorded for each database was:
MEDLINE: 11 951.
Web of Science: 18 228.
From this number, a total of 195 papers were selected to be examined in more detail for eligibility for inclusion in the review. Of these, 13 full-text papers were considered.15–27 The other 182 studies retrieved did not meet the inclusion criteria due to: the study not being a RCT, the study population not based in forensic inpatient settings, the intervention not psychological or psychosocially focused or a sex-offending intervention. From the 13 papers we considered in full, four were eventually excluded leaving nine papers chosen for inclusion in the review. Three papers were excluded because a quasiexperimental design was used.17 20 24 The fourth study was excluded as schema modes were the only outcomes reported.26
Study setting and characteristics
The trials’ characteristics are shown in table 1. The trials involved 523 participants with a median sample size of 63, ranging from 14 to 112. Five studies included women with a total of 37 participants accounting for 7.1% of the overall sample. All participants were individually randomised except for one study23 where cluster randomisation was used. Eight studies were conducted in the UK, two in the Netherlands, one in Finland and one in Canada. Four studies were conducted in high secure settings and three studies in medium secure settings. The other two studies were conducted in a combination of high, medium and low secure settings including one study where a minority of the participants were living in the community.21 Four of the studies included participants diagnosed with schizophrenia or a psychotic disorder, three studies included participants with a diagnosis of personality disorder and two studies included participants from both diagnostic groups.
Types of intervention
Five broad types of intervention were undertaken (cognitive–behavioural therapy (CBT), dialectical behaviour therapy (DBT), psychoeducation, schema-focused therapy (SFT) and solution-focused brief therapy (SFBT)).
Three studies used this approach. The aim of cognitive/behavioural treatment programmes in forensic mental health settings is to change the criminogenic thinking of offenders.28
Haddock et al 21 used a manualised CBT programme including motivational strategies to aid engagement, strategies to reduce the severity and distress of psychotic symptoms and the severity of anger linked to aggression and violence.
Hakvoort et al 22 focused on cognitive–behavioural music therapy and focused on minimising risk and addressing the treatment needs of forensic psychiatric patients.
Dialectical behaviour therapy
This was the intervention in two studies. Education is offered to individuals with psychological disorders with interventions varying from the delivery of simple information through leaflets, emails or information websites to active multisession group intervention with therapist guidance and practice exercises.31
Aho-Mustonen et al 15 used a manualised psychoeducational programme.
Two studies employed SFT. This integrated therapy was specifically developed for people with personality disorder combining CBT with attachment, gestalt, object relations, constructivist and psychoanalytic approaches.33
Bernstein et al 16 focused on the emotional states (‘schema modes’) most common in forensic patients with personality disorders that were hypothesised to play a role in violence and criminality. The goal of the intervention was to reduce the patient’s reliance on maladaptive coping modes.
Solution-focused brief therapy
This was used by one study. MacInnes et al 23 used a computer-assisted approach using SFBT. The therapy promotes movement towards positive change in individuals and is characterised by a focus on the future exploring what will be different when things are better.34
All studies detailed the baseline assessments with the scores for the intervention and control group comparable at baseline. The studies also reported assessment scores immediately post treatment (except ref 22), at 3-month post-treatment,15 6-month post-treatment21–23 27 and 1-year post-treatment.18 Doyle et al 19 recorded scores at 6, 12 and 24 months and Bernstein et al 16 at 3, 6, 12, 18, 24, 30 and 36 months.
Nine of the 10 outcomes of interest were reported in the studies. Eight studies reported violence/risk outcomes, four reported symptoms outcomes, three reported quality of life outcomes, three studies reported recovery outcome and two studies reported disturbance with one study reporting on therapeutic relationship/engagement, satisfaction, ward environment/atmosphere and seclusion. There were no reported outcomes for well-being.
Two of studies did not report any raw scores. Doyle et al 19 reported the outcomes at the three different follow-up times (6, 12 and 24 months) with these analysed simultaneously in a repeated measures analysis using all available data and recording the estimated treatment effects (group differences) and p values. Bernstein et al 16 used repeated measures analysis of variance to analyse the effect of SFT versus TAU on Historical Clinical Risk Management- 20 (HCR-20) scores over the course of treatment. They did not analyse other outcome variables because of the low statistical power in the sample.
Overall, there were few significant findings with only 7 reported out of 91 statistical comparisons.
Seventeen violence/risk outcomes were recorded by eight studies.16 18 19 21–23 25 27 Four significant findings were reported, which was more than for any other outcome. Two significant outcomes reported an improvement for the intervention group and two for the control group with significant findings only recorded at one time point. Rates of verbal aggression reported by Cullen et al 18 were higher in the intervention group during the treatment period with an incident rate ratio (IRR) of 0.48 (95% CI 0.28 to 0.85) though higher in the control group in the 12-month post treatment with an IRR of 0.56 (95% CI 0.34 to 0.91). Haddock et al 21 recorded the CBT group had a significantly lower number of incidents of violence or aggression during the treatment period, while Doyle et al 19 reported that the intervention scores were significantly lower in the control group with an effect size of −3.43. No other statistically significant findings were found by these two studies using the seven other violence/risk measures. The majority of the studies examining violence/risk outcomes used a CBT or SFT intervention. The information in table 3 suggests an approximately 61% (25 out of 41) improvements were recorded in the intervention groups using these approaches. Tomlinson and Hoaken25 reported reduced levels of violence self-reported aggressive behaviour using DBT as an intervention but was undertaken with a small sample with several potential risks of bias present. Overall, there does not appear to be any consistency between the significant scores recorded and little difference in the number of improvements reported.
Ten outcomes were recorded by four studies15 19 21 27 with a wide variety of different symptoms measured. Only one significant finding was reported; the intevention group reported higher levels of self-esteem post-treatment.15 This difference was not maintained at the 3 months post treatment assessment. The main interventions reporting symptoms as outcomes used a psychoeducational or CBT approach. In table 3, 79% of the outcomes (19 out of 24) show an improvement for those patients in receipt of an intervention. It gives some support to the view that interventions are able to improve symptoms though how much improvement is achieved or whether certain symptoms are more amenable to certain interventions is unclear.
Quality of life
There was little difference in scores between the intervention and control groups recorded in the five outcomes reported by three studies.15 23 27 The psychoeducational approach was used as an intervention in two studies. All three outcomes reported a slightly lower non-significant quality of life in the intervention. The SFBT study reported improved quality of life scores post-treatment and 6-month post-treatment giving cautious support to the view this approach may be effective.
Three studies recorded three recovery outcomes.15 23 27 This outcome was reported for psychoeducational and SFBT interventions with no significant differences noted. The psychoeducational outcomes reported better scores for those in the intervention group tentatively suggesting the psychoeducational approach may help recovery. The SFBT results were more equivocal.
Two studies recorded three different types of disturbance outcome.18 23 A CBT intervention18 reported less leave violations during the treatment period and remained lower (though non-significant) in the year following the end of treatment. The SFBT study23 reported lower levels of absconsions and less physical restraints for the intervention group. These findings give initial indications these approaches may reduce levels of disturbance
Four further outcomes (satisfaction, seclusion, therapeutic relationship and ward environment/atmosphere) were assessed by one study.23 Better therapeutic relationships were reported for the intervention group at both time points suggesting a potential improvement using this approach. There were also reduced numbers of seclusions for the intervention group during the 6-month follow-up period. No differences were reported in the satisfaction scores between the intervention and control groups, while the ward environment scores suggest a better atmosphere in the control group including one statistically significant result (patient cohesion) post treatment.
Risk of bias of evidence
The majority of domains had a low risk of bias (figure 2). In relation to the potential of performance bias, we determined that participants and staff would be aware of which arm of the trial they have been allocated but any performance bias would be minimal. We, therefore rated these studies as having a low risk. There were difficulties with recruitment and attrition adding to the limitations of the small sample sizes of the studies. Five of the studies reported problems with recruitment with between 23% and 29.4% of patients deemed as eligible refusing to participate. Three studies were rated as high risk of attrition bias due to incomplete outcome data18 19 27 with two studies reporting over 50% of their intervention group not completing the sessions.18 19
Six studies were able to limit detection bias through ensuring the blinding of the raters of the outcome assessments. One study where blinding was not performed acknowledged the participants may have shown social desirability bias,25 while another used raters who were blind to patients’ treatment condition status double-scored a subset of these assessments with good levels of inter-rater agreement recorded.13
This systematic review found a total of nine published RCTs examining psychological and psychosocial interventions in forensic mental health inpatient settings deliverable to any patient residing in a forensic mental health inpatient setting. The studies were heterogeneous resulting in a narrative review of the main findings. There were few statistically significant findings reported; only 7 out of the 91 comparisons analysed, and none of these significant findings revealed a consistent result. This indicates the current evidence base for supporting any psychological or psychosocial intervention is limited. Table 3 gives some indication of areas where particular interventions may have a positive benefit, though with the lack of significant differences recorded, these findings need to be treated with caution. In general, psychoeducational approaches reported improvements in recovery and symptom outcomes and poorer findings for quality of life outcomes. The CBT interventions noted improved findings for absconding and symptoms outcomes, though the impact on violence/risk was more equivocal. A similar finding is noted in relation to the SFT intervention with an equal amount of better and worse outcomes recorded for measures of violence/risk. The DBT intervention show promising results for reducing violence/risk, while the SFBT approach reported improved quality of life, therapeutic relationships and reduced disturbed behaviour. However, the results of both interventions are based on single small-scale studies indicating more extensive studies are required to produce clearer evidence. This review suggests that psychological and psychosocial interventions do not reduce violence/risk in this group of patients, though there is some tentative support that the interventions may improve mental health symptoms.
A number of other factors may have contributed to these findings: individual study designs were quite different, a variety of different secure settings were included with two studies recruiting from different levels of security21 27 and most studies were recruited from multiple sites. The interventions may have had different impacts due to differences in the therapeutic uses of security and related legal governance systems.2 The study sample sizes were small ranging from 14 to 112 participants. This lack of statistical power limited the ability of the study to detect treatment differences.21 The representativeness of the findings was reduced through most studies only including participants with either a diagnosis of psychosis or personality disorder and by the small number of women participating. The paucity of women participants in forensic research has been viewed as indicative of the realities of research undertaken in this area where basic services to women were often poor or lacking.35 One study noted the significant number of women withdrawing from the study when compared with men and suggested examining reasons for higher dropout rates and whether specific support was required during the intervention.23 The time line of the intervention varied considerably from eight weekly sessions of psychoeducation15 to twice weekly sessions of schema therapy for 3 years.16 The recording of the control group intervention varied greatly and consisted of widely differing approaches. There were also differences between the number of treatment sessions offered to the intervention and control groups. Only one study offered both groups the same number of therapy sessions.21 It is possible that the different treatment intensity may have influenced the outcomes.16 The lack of standardised outcomes was also problematic. Thirty-one outcomes measures were used, with only five measures used more than once, making it difficult to draw conclusions across studies.13
Other reviews of research in forensic mental health settings have reported similar difficulties preventing a homogenous dataset36–39 with few studies with enough similarities to each other to draw firm conclusions regarding the impact of interventions.36 Continuing with small-scale research with mentally disordered offenders (MDOs) is questionable due to these studies being underpowered and unlikely to detect differences.37 Future studies would benefit from larger sample sizes that include representative groups of the forensic inpatient population. It is likely that multisite studies will need to be undertaken with the impact of different environments reviewed as part of the study. To increase the homogeneity of studies, future studies also need similar participants, interventions and outcome measures.36 Using measures that are familiar in practice might be a productive way of developing standardised outcomes.13
The majority of studies included in the review had a low risk of bias, indicating it is possible to conduct well-designed RCTs in forensic mental health inpatient settings.10 RCTs remain the gold standard for investigating the effectiveness of treatments and are needed to determine beneficial interventions for this group of patients.16 The randomisation procedures worked well in the majority of the studies. Seven studies reported on the fidelity of the intervention approach with staff trained in the specific procedures. The intervention approaches were competently performed with only one study19 noting that therapists providing the intervention may not have met relevant standards. Most studies were also able to blind researchers to allocation status when assessing outcomes.
The review excluded non-English language publications that may have led to some relevant research not being included in the review. Some limitations were noted with recruitment and attrition. Five studies reported that approximately 25% or more of the patients approached declined to participate. It was likely the patients who declined to participate were more unwell and/or antisocial, and these factors might have influenced treatment outcomes.40 Attrition was also a problem, which is not surprising considering the high levels of anti-social behaviour and non-compliance prevalent in this cohort.41 Overall, 25% of participants withdrew or dropped out of the studies. Those limitations that took longer to complete or that required a high level of weekly committment were more likely to record a greater number of dropouts and withdrawals.
This is the first review to specifically examine psychological or psychosocial interventions (A) accessible to the majority of patients in forensic mental health inpatient settings and (B) focusing only on RCTs to evaluate the effectiveness of the interventions. Nine RCTs were found. The current evidence from these studies suggests current practice is based on limited evidence with no consistent significant findings. These interventions may have the potential to improve some outcomes, particularly symptoms, using CBT or psychoeducational approaches. The individual DBT and SFBT studies also report promising results. However, the limitations in the conduct of the studies mean specific psychological or psychosocial interventions cannot be supported at present. The studies’ low risk of bias assessments supports the view that good quality RCTs are able to be undertaken to evaluate the effectiveness of these interventions. If more RCTs are undertaken, the evidence base will become clearer. As highlighted in our analysis, the existing evidence base is too diverse for it to be reliable. A key priority for the future is that efforts are placed in devising a standardised framework of reference for study protocols. More specifically, future trials would benefit from: a larger sample size, ensuring participants are representative of the overall forensic inpatient population, using standardised outcomes and clearly detailing control group interventions that are similar in treatment intensity to the intervention. Further work would also be helpful to look at ways of addressing problems concerning rates of recruitment and attrition.
We would like to acknowledge the support received from Dr Dan Bressington, Associate Professor, School of Nursing, The Hong Kong Polytechnic University.
Contributors The review was designed by DM. SM undertook the literature search. The risk of bias assessment, data extraction, analysis of the data and data interpretation were undertaken by SM and DM. DM wrote the first draft of the paper. Both authors reviewed successive drafts and approved the revised manuscript.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
Patient consent for publication Not required.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.