You are here

  • Home
  • Archive
  • Volume 7, Issue 8
  • Protocol for a mixed studies systematic review on the implementation of the recovery approach in adult mental health services

Article Text

Article menu

Download PDFPDF

XML
Mental health
Protocol
Protocol for a mixed studies systematic review on the implementation of the recovery approach in adult mental health services
  1. Myra Piat1,2,3,
  2. Eleni Sofouli3,
  3. Judith Sabetti2,3,
  4. Angella Lambrou4,
  5. Howard Chodos5,
  6. Catherine Briand6,
  7. Brigitte Vachon6,
  8. Janet Curran7
  1. 1 Department of Psychiatry, McGill University, Montreal, Quebec, Canada
  2. 2 School of Social Work, McGill University, Montreal, Quebec, Canada
  3. 3 Douglas Mental Health University Institute, Research Centre, Montreal, Quebec, Canada
  4. 4 Schulich Library of Physical Sciences, Life Sciences and Engineering, McGill University, Montreal, Quebec, Canada
  5. 5 Mental Health Commission of Canada-Ottawa, Ottawa, Ontario, Canada
  6. 6 Faculty of Medicine, University of Montreal, Montréal, Quebec, Canada
  7. 7 School of Nursing, Faculty of Health Professions, Dalhousie University, Halifax, Nova Scotia, Canada
  1. Correspondence to Dr Myra Piat; myra.piat{at}douglas.mcgill.ca

Abstract

Introduction Recovery is integral to mental health planning in G-8 countries including Canada. A recovery-oriented approach to care aims to promote personal empowerment, illness self-management and a life beyond services for people with serious mental illness (SMI), while reducing the financial burden associated with mental illness. Although there is a growing body of literature on recovery, no synthesis of research on the implementation of recovery into mental health services exists.

Objectives The objective is to conduct a mixed studies systematic review on the operationalisation of recovery into mental health services for adults with SMI. It will inform the transformation of Canadian services to a recovery orientation, but may be applicable to other countries.

Methods and analysis Seven databases including PubMed, Ovid Medline, Ovid Embase, Ovid PsycInfo, CINAHL, the Cochrane Library and Scopus will be searched for peer-reviewed empirical studies published from 1998 to December 2016. Systematic reviews and studies using quantitative, qualitative and mixed methodologies will be included. Secondary searches will be conducted in reference lists of all selected full text articles. Handsearches will also be performed in the tables of contents of three recovery-focused journals for the last 5 years. International experts in the field will be contacted for comments and advice. Data extraction will include identification and methodological synthesis of each study; definition of recovery; information on recovery implementation; facilitators and barriers and study outcomes. A quality assessment will be conducted on each study. The data will be synthesised and a stepwise thematic analysis performed.

Ethics and dissemination Ethics approval is not required for this knowledge synthesis. Findings will be disseminated through knowledge translation activities including: (1) a 1-day symposium; (2) presentations in national and international conferences and to local stakeholders; (3) publications in peer-reviewed journals; (4) posts on the organisational websites.

  • mental health
  • adult psychiatry
  • recovery
  • health services

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/

https://doi.org/10.1136/bmjopen-2017-017080

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • Studies included in this knowledge synthesis will have been conducted in inpatient, outpatient and community-based mental health settings and will cover a broad range of research methodologies. The synthesis will reveal how recovery is understood; challenges involved in implementation and, overall, to what extent transformation to recovery oriented services and systems is occurring.

    • The selection of recovery-oriented studies with an implementation focus is unique and will allow us to draw on a powerful conceptual model from implementation science that provides theory-informed elements to guide data analysis and synthesis as well as the reporting of results.

    • Knowledge from the synthesis will be compiled into comprehensive and usable formats for organisational and governmental stakeholders, providing practical guidelines for recovery-based service reform and future evaluation.

    • Limiting the search to published, peer-reviewed studies, while important for considerations of quality and methodological rigour, may overlook possible research on recovery-oriented services reported elsewhere.

    Introduction

    Rationale

    Recovery is the focus of national mental health plans in G-8 countries1–3 including Canada’s first mental health strategy, Changing Directions, Changing Lives4 and several provincial strategies.5–8 The rationale for transformation to recovery-oriented services in mental health is compelling. While traditional mental health services have underlined professional control,9–13 reinforcing patient dependency, self-stigma and hopelessness,14–17 recovery approaches focus on individual empowerment, strong collaborative relationships between mental health service providers and service users and community integration.18–24 In promoting a life beyond services, recovery also meets a key ethical obligation to honour the personhood and citizenship of people with mental illness.25

    Recovery knowledge and evidence have burgeoned over the past two decades. Research exists on personal recovery,26–32 recovery-oriented services33–40 and provider competencies.41–45 Conceptual frameworks and standardised measures have been produced.35 46–49 Other studies have linked the recovery approach to recognised theories, such as empowerment theory,50 51 the strengths model,52 capabilities theory,53–55 positive psychology,56–58 person-centred practice59 60 and coproduction.61 62 Practice guidelines for recovery-oriented service provision are available,63–69 as well. In terms of the empirical literature, studies on particular agencies and programmes have identified potential determinants of recovery orientation in services, for example, a flexible and innovative organisational culture, results-oriented leadership and larger budgets70 were found to be associated with recovery-oriented services, as were provider socioprofessional characteristics such as greater age, higher educational levels and more professional experience.71 72 Another recent study found that increasing the recovery orientation of teamwork on mental health teams73 was associated with provider and consumer perceptions that services were recovery  oriented.

    While two recent systematic reviews have been conducted on the recovery-oriented practices of mental health service providers,74 75 no known review has been published, to date, on the implementation of the recovery approaches into mental health services. Our review synthesizes research on the nature of recovery-oriented services, implementation challenges and overall system transformation. Work on the project was initiated in August 2016 and should come to completion in spring 2018.

    This project is important and timely, as mental illness affects millions of people worldwide. According to recent WHO statistics,76 350 million people are impacted by depression; 60 million people by bipolar disorder and 21 million affected by schizophrenia. A recovery-oriented approach to healthcare is expected to reduce dependency and reduce the cost of mental healthcare, which in Canada has risen to more than $50 billion per year.4 77 78 The project responds to a critical knowledge gap identified by knowledge users across Canada, who are responsible for implementing provincial level policy as well as shifting mental health organisations and services to a recovery orientation.

    Objectives

    The overall goal of this review is to systematically search, assess and synthesise implementation studies on mental health recovery from the international mental health literature in order to inform and facilitate the transformation of Canadian mental health systems and adult services to a recovery orientation. The following six research questions, guided by the Consolidated Framework for Advancing Implementation Science (CFIR)79 will be applied to each selected study: (1) How was recovery defined in this study?; (2) How was the recovery approach implemented in this study (Intervention)?; (3) What elements from the external environment (outer setting) or internal environment (inner setting), influenced implementation in this study?; (4) What were the characteristics of participants in this study? (characteristics of individuals); (5) What processes were involved in effecting the implementation? and (6) What was the extent and effectiveness of implementation in this study?

    Methods

    Eligibility criteria

    The design and methodology for the present review are reported following the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols guidelines80 (online supplementary appendix 1).

    Supplementary file 1

    Population

    The review concerns studies of services for adults (≥18 years) with a primary diagnosis of schizophrenia, bipolar disorder or major depression, following the DSM-V (Diagnostic and Statistical Manual of Mental Disorders, 5th Edition) classification for mental disorders.

    Intervention

    Studies will be included if they describe and evaluate the implementation of any intervention based on recovery principles that aims at transforming the orientation of mental health services or organisations to a recovery approach.

    Comparators

    Studies will be eligible for inclusion whether or not they include comparison groups.

    Outcomes

    Selected studies should report outcomes related to the transformation of a mental health service or organisation to a recovery orientation. Outcomes might include change in organisational culture; more integrated service networks and partnerships; increased knowledge, skills and/or attitudinal change among mental health providers; more use of evidence-based recovery-oriented best practices; greater consumer/provider collaboration, consumer self-management and evaluation.

    Study design

    This will be a mixed studies review (MSR).81 82 The MSR integrates qualitative, quantitative and mixed methods studies, providing a rich, detailed understanding of complex health interventions and programmes.83 Studies representing a full range of methodologies will be included: systematic reviews and meta-analyses, randomised controlled trials (RCTs) and clinical trials, observational, mixed method and qualitative studies.

    Time period

    We would expect to find very few pertinent studies prior to 1998, when recovery was first defined in an international policy document.84 Thus, the precise time frame for the review is from 1998 to December 2016.

    Setting

    Research settings may include inpatient, outpatient or community-based mental health services.

    Exclusion criteria

    Non-research studies (eg, editorials, letters, conference abstracts), as well as unpublished (grey) literature, dissertations and book or book-length studies, will be excluded, as well as conceptual papers and review articles. Studies on services for addiction populations will also be excluded, as recovery is conceptualised differently in the addictions field. Language restrictions will not apply.

    Information sources

    Our final search strategy will be developed in consultation with an experienced research librarian on the project and will combine a broad, systematic search of the literature. Electronic search will be conducted on the following databases: PubMed, Ovid Medline, Ovid Embase, Ovid PsycInfo, CINAHL (Current Index to Nursing and Allied Health Literature), the Cochrane Library and Scopus. We will supplement our results by conducting the following secondary searches: (1) Reference lists of all selected full text articles will be scanned for additional relevant studies; (2) Citation tracking will be performed on included articles; (3) Handsearches of tables of contents for the past 5 years will be conducted in the following key journals: Psychiatric Rehabilitation Journal; Psychiatric Services and Community Mental Health Journal. Additional journals will be added if warranted and (4) Known experts in the field will be contacted for comments and advice. We will also stay alert to serendipitous discovery that may increase results.

    Pilot search strategy

    Using the Ovid Medline database, a research librarian and coinvestigator on the project conducted a pilot search (online supplementary appendix 2) which generated 5164 records. For this preliminary scoping phase, the search strategy was designed to focus on three main components: mental health, recovery and services. Medical Subject Heading and synonyms (keywords) were combined for each of the components. Terms related to recovery were chosen to reflect the consumer–survivor understanding of recovery.48 85 86 While keywords will remain consistent throughout the searches, subject headings will be revised to reflect database-specific preferences. Search strategies will be further revised as new subject headings and keywords are revealed.

    Supplementary file 2

    Study records

    Data management

    Electronic search results will be downloaded into EndNote reference manager software, duplicates will be removed where possible and the remaining references will be uploaded to the Distiller Systematic Review software for the screening and data extraction stages. Distiller software stores references, manages and monitors the screening and data extraction process with customised forms and automated flowcharts and provides an audit trail for the review.

    Screening and selection process

    For the first selection, two team members working independently will read titles and abstracts of each paper identified in the electronic search and assess them for relevance based on the inclusion and exclusion criteria. Second, the team members will read the full text of each selected article in order to confirm its inclusion in the study. Disagreements related to the inclusion of any paper will be discussed and resolved, involving a third team member if necessary. To ensure high inter-rater reliability, training exercises will be conducted prior to initiating the screening process. Team members will meet on a weekly basis to follow-up on the screening process and discuss unanticipated problems.

    Data items and data extraction process

    In order to minimise bias, two research team members will independently extract the data. Sample elements for data extraction appear below in table 1. The categories on the extraction grid include methodological elements based on the PICO mnemonic (PICO=population, intervention, comparison, outcome).87 Also elements corresponding to the six research questions will be extracted and organised using the CFIR,79 a multilevel five-dimension determinant framework88 that constitutes a highly useful tool for identifying barriers and facilitators influencing implementation outcomes. Study limitations and gaps in knowledge will also be recorded.89 The data extraction form will be pretested by the two reviewers and revised as needed. Distiller SR software will be used to manage the data extraction process.

    View this table:
    Table 1

    Sample elements for data extraction

    Quality assessment

    Systematic reviews require that selected studies are assessed for quality.90 We will use the Assessing Methodological Quality of Systematic Reviews tool (AMSTAR) protocol for the assessment of systematic reviews. The AMSTAR is an 11-item questionnaire that assesses study design, literature searched and scientific quality of reviews; a rating system is included. For primary research studies, quality assessment will be determined using criteria developed by Kmet et al.91 This tool includes a 14-item checklist for quality criteria in quantitative studies and a 10-item checklist for qualitative studies. A rating system (yes-2; partial-1 and no-0) is provided, as well as a calculation for summary scores. While some controversy exists on whether qualitative research should be assessed using standard quality criteria,92 we will include a quality appraisal for qualitative, as well as quantitative, studies in order to better assess the strengths and weaknesses of the evidence.93 The Cochrane Collaboration tool will be used for assessing the risk of bias in RCTs.94 The selected studies will be independently assessed for quality by two reviewers. Discrepancies will be solved in consultation with the principal investigator.

    Data

    Data synthesis

    No single unifying framework exists for synthesising quantitative and qualitative evidence for healthcare policy-makers and managers.95 Our experience with recovery research suggests that much of the pertinent literature for review will be qualitative. Thus, our overall approach will be to convert all the evidence into qualitative form. The quantitative data will be transformed into qualitative form by extracting key concepts and findings within the elements geared to our research questions, as described above. Analytic procedures and synthesis will follow a three-stage process: (1) organisation of studies into logical categories according to their design, and methodology and coding using NVivo 11 software; (2) within-study analysis, according to the study questions; (3) cross-study synthesis of the data using an adaptation of the stepwise thematic analysis developed by Lucas et al,93 according to the following procedures: (1) two reviewers will independently review data collated under each of the research questions; (2) codes produced by each researcher will be compared and a consolidated list of themes produced for each research question; (3) themes occurring under each question will be clustered around common dimensions; (4) results of the thematic analysis will be presented to the research team at a consensus meeting.

    Specific measures will be taken to enhance the trustworthiness of the data. As suggested by Lucas et al, directly reported participant data (eg, verbatim quotations or scores on attitudinal scales) and author interpretations will be reported separately in order to retain the richness or ‘thickness’ of the data. Detailed descriptions, contextual material and the quality assessment of each paper will also help readers make judgements about the reliability and validity of the data. Summary tables will include counts of the papers contributing data on each theme.92

    Dissemination

    Knowledge translation will involve collaboration with our international consultants and knowledge users, who include decision makers and managers, service providers, people with lived experience and families. Four output documents will be developed, including: (1) a critical appraisal of findings from the synthesis on recovery implementation; (2) a compendium of case studies on successful recovery implementation initiatives (sensitive to gender, race, culture); (3) a recovery implementation manual for decision makers and managers and (4) a toolkit of recovery-enhancing approaches, that is, strategies for individual behavioural change targeted at service providers and service users. Each document will be submitted to the entire team for revision and editing.

    The results of the synthesis project will be widely disseminated. Knowledge translation activities will include: (1) creation of an Advisory Committee composed of the research team, knowledge users and international expert advisors. Quarterly telephone meetings with the Advisory to review emerging findings and provide feedback; (2) ongoing consultation/feedback between knowledge users and the research team during preparation of the four project outputs; (3) posting of information and updates on the websites of the organisations of knowledge users on the project, including those for people with lived experience and families; (4) organisation of a 1 day end-of-project symposium for dissemination of project outputs, including workshops for recording feedback and recommendations; (5) dissemination of project outputs through organisational websites and through national and international networks (free access); (6) submission of articles to peer-reviewed, open access journals; (7) presentations at national/international conferences.

    Conclusion

    The recovery approach emerged through the lived experiences of people with enduring mental health problems as they used the formal mental healthcare system. Recovery-oriented services are viewed as a more person-centred and promising approach for treating mental illness. Until now, there has been little access to knowledge concerning how mainstream mental health services are being transformed to a recovery orientation and with what results. Our synthesis will establish the state of knowledge and evidence on implementing recovery and will make this knowledge available to a wide range of mental health stakeholders through dissemination activities and the publication of concrete recovery implementation tools. Results may also support the development of new recovery interventions, on which future outcome research should be considered.

    Acknowledgments

    This study was funded by the Canadian Institutes of Health Research Grant # KRS 144043

    References

    1. 1.↵
      2. Adams N ,
      3. Daniels A ,
      4. Compagni A
      . International Pathways to Mental Health Transformation. Int J Ment Health 2009;38:30–45.doi:10.2753/IMH0020-7411380103
      OpenUrl
    2. 2.↵
      2. Kirby M ,
      3. Keon WJ
      . Out of the shadows at last. Transforming mental health, mental illness and addiction services in Canada. Ottawa: Sénat du Canada, 2006.
    3. 3.↵
      2. Slade M ,
      3. Williams J ,
      4. Bird V , et al
      . Recovery grows up. J Ment Health 2012;21:99–103.doi:10.3109/09638237.2012.670888
      OpenUrlCrossRefPubMedWeb of Science
    4. 4.↵
      Mental Health Commission of Canada. Changing directions, changing lives. Calgary, AB: The mental health strategy for Canada, 2012.
    5. 5.↵
      Department of Health. The action plan for mental health in new brunswick 2011-18. 2011;19.
    6. 6.↵
      Government of Manitoba. Rising to the challenge. a strategic plan for the mental health and well-being of Manitobans. 2011.
    7. 7.↵
      Ministère de la Santé et des Services sociaux (MSSS). Plan d'action en santé mentale 2005-2010: La force des liens. Québec: MSSS, 2005.
    8. 8.↵
      2. Piat M ,
      3. Sabetti J
      . Recovery in Canada: toward social equality. Int Rev Psychiatry 2012;24:19–28.doi:10.3109/09540261.2012.655712
      OpenUrlCrossRefPubMedWeb of Science
    9. 9.↵
      2. Adnøy Eriksen K ,
      3. Arman M ,
      4. Davidson L , et al
      . Challenges in relating to mental health professionals: Perspectives of persons with severe mental illness. Int J Ment Health Nurs 2014;23:110–7.doi:10.1111/inm.12024
      OpenUrlCrossRefPubMed
    10. 10.↵
      2. Deegan PE
      . Recovery: the lived experience of rehabilitation. Psychosocial Rehabilitation Journal 1988;11:11–19.doi:10.1037/h0099565
      OpenUrlCrossRef
    11. 11.↵
      2. Gravel K ,
      3. Légaré F ,
      4. Graham ID
      . Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals' perceptions. Implement Sci 2006;1:16.doi:10.1186/1748-5908-1-16
      OpenUrlCrossRefPubMed
    12. 12.↵
      2. Légaré F ,
      3. Ratté S ,
      4. Gravel K , et al
      . Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals' perceptions. Patient Educ Couns 2008;73:526–35.doi:10.1016/j.pec.2008.07.018
      OpenUrlCrossRefPubMedWeb of Science
    13. 13.↵
      2. Nordt C ,
      3. Rössler W ,
      4. Lauber C
      . Attitudes of mental health professionals toward people with schizophrenia and major depression. Schizophr Bull 2006;32:709–14.doi:10.1093/schbul/sbj065
      OpenUrlCrossRefPubMedWeb of Science
    14. 14.↵
      2. Brohan E ,
      3. Elgie R ,
      4. Sartorius N , et al
      . Self-stigma, empowerment and perceived discrimination among people with schizophrenia in 14 European countries: the GAMIAN-Europe study. Schizophr Res 2010;122:232–8.doi:10.1016/j.schres.2010.02.1065
      OpenUrlCrossRefPubMed
    15. 15.↵
      2. Corrigan PW ,
      3. Watson AC ,
      4. Barr L
      . The self-stigma of mental illness: Implications for self-esteem and self-efficacy. J Soc Clin Psychol 2006;25:875–84.doi:10.1521/jscp.2006.25.8.875
      OpenUrlCrossRefWeb of Science
    16. 16.↵
      2. Shahar G ,
      3. Trower P ,
      4. Iqbal Z , et al
      . The person in recovery from acute and severe psychosis: the role of dependency, self-criticism, and efficacy. Am J Orthopsychiatry 2004;74:480–8.doi:10.1037/0002-9432.74.4.480
      OpenUrlCrossRefPubMedWeb of Science
    17. 17.↵
      2. Watson AC ,
      3. Corrigan P ,
      4. Larson JE , et al
      . Self-stigma in people with mental illness. Schizophr Bull 2007;33:1312–8.doi:10.1093/schbul/sbl076
      OpenUrlCrossRefPubMedWeb of Science
    18. 18.↵
      2. Davidson L ,
      3. Chan KK
      . Common factors: evidence-based practice and recovery. Psychiatr Serv 2014;65:675–7.doi:10.1176/appi.ps.201300274
      OpenUrl
    19. 19.↵
      2. Joosten EA ,
      3. DeFuentes-Merillas L ,
      4. de Weert GH , et al
      . Systematic review of the effects of shared decision-making on patient satisfaction, treatment adherence and health status. Psychother Psychosom 2008;77:219–26.doi:10.1159/000126073
      OpenUrlCrossRefPubMedWeb of Science
    20. 20.↵
      2. Klockmo C ,
      3. Marnetoft SU ,
      4. Selander J , et al
      . Important components to create personal working alliances with clients in the mental health sector to support the recovery process. Int J Rehabil Res 2014;37:40–7.doi:10.1097/MRR.0000000000000033
      OpenUrl
    21. 21.↵
      2. Sweeney A ,
      3. Fahmy S ,
      4. Nolan F , et al
      . The relationship between therapeutic alliance and service user satisfaction in mental health inpatient wards and crisis house alternatives: a cross-sectional study. PLoS One 2014;9:e100153.doi:10.1371/journal.pone.0100153
      OpenUrl
    22. 22.↵
      2. Borg M ,
      3. Kristiansen K
      . Recovery-oriented professionals: helping relationships in mental health services. J Ment Health 2004;13:493–505.doi:10.1080/09638230400006809
      OpenUrlCrossRef
    23. 23.↵
      2. Crowe TP ,
      3. Deane FP ,
      4. Oades LG , et al
      . Effectiveness of a collaborative recovery training program in Australia in promoting positive views about recovery. Psychiatr Serv 2006;57:1497–500.doi:10.1176/ps.2006.57.10.1497
      OpenUrlCrossRefPubMedWeb of Science
    24. 24.↵
      2. Green CA ,
      3. Janoff SL ,
      4. Yarborough BJ , et al
      . The recovery group project: development of an intervention led jointly by peer and professional counselors. Psychiatr Serv 2013;64:1211–7.doi:10.1176/appi.ps.201200546
      OpenUrlCrossRefPubMed
    25. 25.↵
      2. Atterbury K
      . Preserving the person: The ethical imperative of recovery-oriented practices. Am J Orthopsychiatry 2014;84:182–9.doi:10.1037/h0099362
      OpenUrl
    26. 26.↵
      2. Andresen R ,
      3. Caputi P ,
      4. Oades L
      . Stages of recovery instrument: development of a measure of recovery from serious mental illness. Aust N Z J Psychiatry 2006;40:972–80.doi:10.1080/j.1440-1614.2006.01921.x
      OpenUrlCrossRefPubMedWeb of Science
    27. 27.↵
      2. Giffort D ,
      3. Schmook A ,
      4. Woody C , et al
      . Recovery assessment scale. Chicago: Illinois Department of Mental Health, 1995.
    28. 28.↵
      2. Khanam D ,
      3. McDonald K ,
      4. Williams Neils C
      . Measuring recovery: a toolkit for mental health providers in New York City. New York: The Bureau of Mental Health, NYC Department of Health and Mental Hygiene, 2013.
    29. 29.↵
      2. Mueser KT ,
      3. Gingerich S ,
      4. Salyers MP , et al
      . The illness management and recovery (IMR) scales (client and clinician versions). Concord, N.H: New Hampshire-Dartmouth Psychiatric Research Center, 2004.
    30. 30.↵
      2. Neil ST ,
      3. Kilbride M ,
      4. Pitt L , et al
      . The questionnaire about the process of recovery (QPR): a measurement tool developed in collaboration with service users. Psychosis 2009;1:145–55.doi:10.1080/17522430902913450
      OpenUrlCrossRef
    31. 31.↵
      2. MacKeith J ,
      3. Burns S
      . Mental Health Recovery Star. London: Mental health providers forum and triangle consulting, 2008.
    32. 32.↵
      2. Gordon SE ,
      3. Ellis PM ,
      4. Siegert RJ , et al
      . Core dimensions of recovery: a psychometric analysis. Adm Policy Ment Health 2014;41:535–42.doi:10.1007/s10488-013-0489-1
      OpenUrl
    33. 33.↵
      2. Armstrong NP ,
      3. Steffen JJ
      . The recovery promotion fidelity scale: assessing the organizational promotion of recovery. Community Ment Health J 2009;45:163–70.doi:10.1007/s10597-008-9176-1
      OpenUrlCrossRefPubMedWeb of Science
    34. 34.↵
      2. Bedregal LE ,
      3. O'Connell M ,
      4. Davidson L
      . The recovery knowledge inventory: assessment of mental health staff knowledge and attitudes about recovery. Psychiatr Rehabil J 2006;30:96–103.doi:10.2975/30.2006.96.103
      OpenUrlCrossRefPubMed
    35. 35.↵
      2. Burgess P ,
      3. Pirkis J ,
      4. Coombs T , et al
      . Assessing the value of existing recovery measures for routine use in Australian mental health services. Aust N Z J Psychiatry 2011;45:267–80.doi:10.3109/00048674.2010.549996
      OpenUrlCrossRefPubMed
    36. 36.↵
      2. O'Connell M ,
      3. Tondora J ,
      4. Croog G , et al
      . From rhetoric to routine: assessing perceptions of recovery-oriented practices in a state mental health and addiction system. Psychiatr Rehabil J 2005;28:378–86.doi:10.2975/28.2005.378.386
      OpenUrlCrossRefPubMed
    37. 37.↵
      2. Onken SJ ,
      3. Dumont JM ,
      4. Ridgway P , et al
      . Mental health recovery: what helps and what hinders? a national research project for the development of recovery facilitating system performance indicators. Piloting the Recovery Oriented System Indicators, 2006. http://www.familymentalhealthrecovery.org/conference/handouts/Workshop%208/Onken-ROSIPilotMeasuresV6.pdf (accessed 1 Nov 2007).
    38. 38.↵
      2. Ridgway P ,
      3. Press A
      . Assessing the recovery-orientation of your mental health program. a user's guide for the recovery-enhancing environment scale (REE). Kansas: University of Kansas, 2004.
    39. 39.↵
      2. Leamy M ,
      3. Clarke E ,
      4. Le Boutillier C , et al
      . Implementing a complex intervention to support personal recovery: a qualitative study nested within a cluster randomised controlled trial. PLoS One 2014;9:e97091.doi:10.1371/journal.pone.0097091
      OpenUrl
    40. 40.↵
      2. Lloyd-Evans B ,
      3. Mayo-Wilson E ,
      4. Harrison B , et al
      . A systematic review and meta-analysis of randomised controlled trials of peer support for people with severe mental illness. BMC Psychiatry 2014;14:39.doi:10.1186/1471-244X-14-39
      OpenUrlCrossRefPubMed
    41. 41.↵
      2. Russinova Z ,
      3. Rogers ES ,
      4. Ellison ML , et al
      . Recovery-promoting professional competencies: perspectives of mental health consumers, consumer-providers and providers. Psychiatr Rehabil J 2011;34:177–85.doi:10.2975/34.3.2011.177.185
      OpenUrlCrossRefPubMed
    42. 42.↵
      National Institute for Mental Health in England. Support, time and recovery (STR) workers. A competence framework. London: Department of Health, 2008.
    43. 43.↵
      National Social Inclusion Programme. Capabilities for inclusive practice. London: Department of Health, 2007.
    44. 44.↵
      National Institute for Mental Health in England. The ten essential shared capabilities. A framework for the whole of the mental health workforce. London: Department of Health, 2004:40339.
    45. 45.↵
      New Zealand Ministry of Health. Let's get real: Real skills for people working in mental health and addiction. Wellington, 2008.
    46. 46.↵
      2. Leamy M ,
      3. Bird V ,
      4. Le Boutillier C , et al
      . Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry 2011;199:445–52.doi:10.1192/bjp.bp.110.083733
      OpenUrlAbstract/FREE Full Text
    47. 47.↵
      2. Williams J ,
      3. Leamy M ,
      4. Bird V , et al
      . Measures of the recovery orientation of mental health services: systematic review. Soc Psychiatry Psychiatr Epidemiol 2012;47:1827–35.doi:10.1007/s00127-012-0484-y
      OpenUrlCrossRefPubMed
    48. 48.↵
      2. Slade M ,
      3. Leamy M ,
      4. Bacon F , et al
      . International differences in understanding recovery: systematic review. Epidemiol Psychiatr Sci 2012;21:353–64.doi:10.1017/S2045796012000133
      OpenUrlPubMed
    49. 49.↵
      2. Bird V ,
      3. Leamy M ,
      4. Tew J , et al
      . Fit for purpose? Validation of a conceptual framework for personal recovery with current mental health consumers. Aust N Z J Psychiatry 2014;48:644–53.doi:10.1177/0004867413520046
      OpenUrlCrossRefPubMed
    50. 50.↵
      2. Rappaport J
      . Terms of empowerment/exemplars of prevention: toward a theory for community psychology. Am J Community Psychol 1987;15:121–48.doi:10.1007/BF00919275
      OpenUrlCrossRefPubMedWeb of Science
    51. 51.↵
      2. Zimmerman MA
      . Empowerment theory: psychological, organizational and community levels of analysis. In: Rappaport J , Seidman E , eds. Handbook of community psychology. New York: Kluwer Academic/Plenum Publishers, 2000:43–63.
    52. 52.↵
      2. Rapp CA ,
      3. Goscha RJ
      . The Strengths Model: Case management with people with psychiatric disabilities. Oxford University Press: Oxford, New Yord, 2006.
    53. 53.↵
      2. Burchardt  T
      . Capabilities and disability: the capabilities framework and the social model of disability. Disabil Soc 2004;19:735–51.doi:10.1080/0968759042000284213
      OpenUrlCrossRefWeb of Science
    54. 54.↵
      2. Davidson L ,
      3. Ridgway P ,
      4. Wieland M , et al
      . A capabilities approach to mental health Transformation: A conceptual framework for the recovery era. Can J Commun Ment Health 2009;28:35–46.doi:10.7870/cjcmh-2009-0021
      OpenUrl
    55. 55.↵
      2. Hopper K
      . Rethinking social recovery in schizophrenia: what a capabilities approach might offer. Soc Sci Med 2007;65:868–79.doi:10.1016/j.socscimed.2007.04.012
      OpenUrlCrossRefPubMed
    56. 56.↵
      2. Moran GS ,
      3. Nemec PB
      . Walking on the sunny side: what positive psychology can contribute to psychiatric rehabilitation concepts and practice. Psychiatr Rehabil J 2013;36:202–8.doi:10.1037/prj0000012
      OpenUrlCrossRefPubMed
    57. 57.↵
      2. Resnick SG ,
      3. Rosenheck RA
      . Recovery and positive psychology: parallel themes and potential synergies. Psychiatr Serv 2006;57:120–2.doi:10.1176/appi.ps.57.1.120
      OpenUrlCrossRefPubMedWeb of Science
    58. 58.↵
      2. Slade M
      . Mental illness and well-being: the central importance of positive psychology and recovery approaches. BMC Health Serv Res 2010;10:26.doi:10.1186/1472-6963-10-26
      OpenUrlCrossRefPubMed
    59. 59.↵
      2. Borg M ,
      3. Karlsson B ,
      4. Tondora J , et al
      . Implementing person-centered care in psychiatric rehabilitation: what does this involve? Isr J Psychiatry Relat Sci 2009;46:84–93.
      OpenUrlPubMed
    60. 60.↵
      2. Rudnick A ,
      3. Roe D
      . Serious mental illness: person-centered approaches. 2011. London (GB): Radcliffe Publishing Ltd, 2014.
    61. 61.↵
      2. Boyle D ,
      3. Harris M
      . The challenge of co-production. How equal partnerships between professionals and the public are crucial to improving public services. London: NESTA, 2009.
    62. 62.↵
      2. Denham‐Vaughan S ,
      3. Clark M
      . Care clusters in mental health and co‐production of care – towards a more lay friendly set of cluster descriptions. Mental Health and Social Inclusion 2012;16:79–83.doi:10.1108/20428301211232487
      OpenUrl
    63. 63.↵
      2. Le Boutillier C ,
      3. Leamy M ,
      4. Bird VJ , et al
      . What does recovery mean in practice? A qualitative analysis of international recovery-oriented practice guidance. Psychiatr Serv 2011;62:1470–6.doi:10.1176/appi.ps.001312011
      OpenUrlCrossRefPubMedWeb of Science
    64. 64.↵
      2. Sowers W
      . Quality Management Committee of the American Association of Community Psychiatrists. Transforming systems of care: the American Association of Community Psychiatrists Guidelines for Recovery Oriented Services. Community Ment Health J 2005;41:757–74.doi:10.1007/s10597-005-6433-4
      OpenUrlCrossRefPubMedWeb of Science
    65. 65.↵
      2. Shepherd G ,
      3. Boardman J ,
      4. Slade M
      . Making recovery a reality. Sainsbury Centre for Mental Health 2008.
    66. 66.↵
      2. Shepherd G ,
      3. Boardman J ,
      4. Slade M
      . Implementing recovery: a new framework for organisational change. Sainsbury Centre for Mental Health 2009.
    67. 67.↵
      Australian Health Ministers' Advisory Council. A national framework for recovery-oriented mental health services. Guide for practitioners and providers. Canberra: Department of Health and Ageing, 2013.
    68. 68.↵
      2. Newnham EA ,
      3. Page AC
      . Bridging the gap between best evidence and best practice in mental health. Clin Psychol Rev 2010;30:127–42.doi:10.1016/j.cpr.2009.10.004
      OpenUrlCrossRefPubMed
    69. 69.↵
      2. Anthony WA ,
      3. Mizock L
      . Evidence-based processes in an era of recovery: implications for rehabilitation counseling and research. Rehabilitation Counseling Bulletin 2014;57:219–27.
      OpenUrlCrossRef
    70. 70.↵
      2. Brown TT ,
      3. Mahoney CB ,
      4. Adams N , et al
      . What predicts recovery orientation in county departments of mental health? A pilot study. Adm Policy Ment Health 2010;37:388–98.doi:10.1007/s10488-009-0253-8
      OpenUrlPubMed
    71. 71.↵
      2. McLoughlin KA ,
      3. Fitzpatrick JJ
      . Self-reports of recovery-oriented practices of mental health nurses in state mental health institutes: development of a measure. Issues Ment Health Nurs 2008;29:1051–65.doi:10.1080/01612840802319738
      OpenUrlCrossRefPubMed
    72. 72.↵
      2. Osborn LA ,
      3. Stein CH
      . Mental Health Care Providers' Views of Their Work with Consumers and Their Reports of Recovery-Orientation, Job Satisfaction, and Personal Growth. Community Ment Health J 2016;52.doi:10.1007/s10597-015-9927-8
    73. 73.↵
      2. Leamy M ,
      3. Clarke E ,
      4. Le Boutillier C , et al
      . A national survey of recovery practice in community mental health teams. Br J Psychiatry 2016;209:340–6.
      OpenUrlAbstract/FREE Full Text
    74. 74.↵
      2. Chester P ,
      3. Ehrlich C ,
      4. Warburton L , et al
      . "What is the work of recovery oriented practice? A systematic literature review". Int J Ment Health Nurs 2016;25:270–85.doi:10.1111/inm.12241
      OpenUrl
    75. 75.↵
      2. Le Boutillier C ,
      3. Chevalier A ,
      4. Lawrence V , et al
      . Staff understanding of recovery-orientated mental health practice: a systematic review and narrative synthesis. Implement Sci 2015;10:87.doi:10.1186/s13012-015-0275-4
      OpenUrl
    76. 76.↵
      Mental disorders - Fact Sheet No. 396 [press release]. 2014.
    77. 77.↵
      2. Knapp M ,
      3. Andrew A ,
      4. McDaid D , et al
      . Investing in recovery. Making the business case for effective interventions for people with schizophrenia and psychosis. London, UK: Center for Mental Health, 2014.
    78. 78.↵
      2. Latimer EA ,
      3. Bond GR ,
      4. Drake RE
      . Economic approaches to improving access to evidence-based and recovery-oriented services for people with severe mental illness. Can J Psychiatry 2011;56:523–9.doi:10.1177/070674371105600903
      OpenUrlCrossRefPubMed
    79. 79.↵
      2. Damschroder LJ ,
      3. Aron DC ,
      4. Keith RE , et al
      . Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50.doi:10.1186/1748-5908-4-50
      OpenUrlCrossRefPubMed
    80. 80.↵
      2. Shamseer L ,
      3. Moher D ,
      4. Clarke M , et al
      . Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;349:g7647.doi:10.1136/bmj.g7647
      OpenUrlAbstract/FREE Full Text
    81. 81.↵
      2. Heyvaert M ,
      3. Maes B ,
      4. Onghena P
      . Mixed methods research synthesis: definition, framework, and potential. Qual Quant 2013;47:659–76.doi:10.1007/s11135-011-9538-6
      OpenUrl
    82. 82.↵
      2. Pluye P ,
      3. Hong QN
      . Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health 2014;35:29–45.doi:10.1146/annurev-publhealth-032013-182440
      OpenUrlCrossRefPubMedWeb of Science
    83. 83.↵
      2. Pluye P ,
      3. Gagnon MP ,
      4. Griffiths F , et al
      . A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. Int J Nurs Stud 2009;46:529–46.doi:10.1016/j.ijnurstu.2009.01.009
      OpenUrlCrossRefPubMedWeb of Science
    84. 84.↵
      New Zealand Mental Health Commission. Blueprint for mental health services in New Zealand. How things need to be. Wellington: Mental Health Commission, 1998.
    85. 85.↵
      2. Anthony WA
      . Recovery from mental illness: The guiding vision of the mental health service system in the 1990s. Psychiatr Rehabil J 1993;16:11–23.doi:10.1037/h0095655
      OpenUrlCrossRef
    86. 86.↵
      2. Davidson L ,
      3. Roe D
      . Recovery from versus recovery in serious mental illness: One strategy for lessening confusion plaguing recovery. J Ment Health 2007;16:459–70.doi:10.1080/09638230701482394
      OpenUrlCrossRef
    87. 87.↵
      2. Richardson WS ,
      3. Wilson MC ,
      4. Nishikawa J , et al
      . The well-built clinical question: a key to evidence-based decisions. ACP J Club 1995;123:A12–13.
      OpenUrlPubMed
    88. 88.↵
      2. Nilsen P
      . Making sense of implementation theories, models and frameworks. Implement Sci 2015;10:53.doi:10.1186/s13012-015-0242-0
      OpenUrlCrossRefPubMed
    89. 89.↵
      2. Munn Z ,
      3. Tufanaru C ,
      4. Aromataris E
      . Data extraction and synthesis. Am J Nurs 2014;114:49–54.
      OpenUrl
    90. 90.↵
      2. Aromataris E ,
      3. Pearson A
      . The systematic review: an overview. Am J Nurs 2014;114:53–8.doi:10.1097/01.NAJ.0000444496.24228.2c
      OpenUrl
    91. 91.↵
      2. Kmet LM ,
      3. Lee RC ,
      4. Cook LS
      . Standard quality assessment criteria for evaluating primary research papers from a variety of fields. Alberta Heritage Foundation for Medical Research (AHFMR), 2004. HTA Initiative #13.
    92. 92.↵
      2. Dixon-Woods M ,
      3. Agarwal S ,
      4. Jones D , et al
      . Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy 2005;10:45–53.doi:10.1177/135581960501000110
      OpenUrlCrossRefPubMed
    93. 93.↵
      2. Lucas PJ ,
      3. Baird J ,
      4. Arai L , et al
      . Worked examples of alternative methods for the synthesis of qualitative and quantitative research in systematic reviews. BMC Med Res Methodol 2007;7:4.doi:10.1186/1471-2288-7-4
      OpenUrlCrossRefPubMed
    94. 94.↵
      2. Higgins JP ,
      3. Altman DG ,
      4. Gøtzsche PC , et al
      . The cochrane collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928.doi:10.1136/bmj.d5928
      OpenUrlFREE Full Text
    95. 95.↵
      2. Pope C ,
      3. Mays N ,
      4. Popay J
      . How can we synthesize qualitative and quantitative evidence for healthcare policy-makers and managers? Healthc Manage Forum 2006;19:27–31.doi:10.1016/S0840-4704(10)60079-8
      OpenUrlPubMed

    Footnotes

    • Contributors MP is the guarantor. MP, ES and JS drafted the manuscript. MP, ES, JS, CB, BV and JC contributed to the development of the selection criteria and data extraction criteria. AL developed the preliminary search strategy. HC, CB, BV and JC provided written feedback on the manuscript and AL, HC, CB, BV and JC approved the final manuscript.

    • Funding This study was funded by the Canadian Institute of Health Research, grant number KRS 144043.

    • Competing interests None declared.

    • Provenance and peer review Not commissioned; externally peer reviewed.