Article Text

PDF

How to adapt existing evidence-based clinical practice guidelines: a case example with smoking cessation guidelines in Canada
  1. Peter Selby1,2,3,4,
  2. Katie Hunter1,5,
  3. Jess Rogers5,
  4. Kelly Lang-Robertson5,
  5. Sophie Soklaridis3,6,
  6. Virginia Chow1,
  7. Michèle Tremblay7,
  8. Denise Koubanioudakis7,
  9. Rosa Dragonetti1,
  10. Sarwar Hussain1,
  11. Laurie Zawertailo1,8
  1. 1 Centre for Addiction and Mental Health, Addictions Program, Toronto, Ontario, Canada
  2. 2 Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
  3. 3 Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
  4. 4 Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
  5. 5 Centre for Effective Practice, Toronto, Ontario, Canada
  6. 6 Education, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
  7. 7 Institut National de Santé Publique du Québec, Montreal, Québec, Canada
  8. 8 Department of Pharmacology and Toxicology, University of Toronto, Toronto, Ontario, Canada
  1. Correspondence to Dr Peter Selby; peter.selby{at}camh.ca

Abstract

Objective To develop and encourage the adoption of clinical practice guidelines (CPGs) for smoking cessation in Canada by engaging stakeholders in the adaptation of existing high-quality CPGs using principles of the ADAPTE framework.

Methods An independent expert body in guideline review conducted a review and identified six existing CPGs, which met a priori criteria for quality and potential applicability to the local context. Summary statements were extracted and assigned a grade of recommendation and level of evidence by a second expert panel. Regional knowledge exchange brokers recruited additional stakeholders to build a multidisciplinary network of over 800 clinicians, researchers and decision-makers from across Canada. This interprofessional network and other stakeholders were offered various opportunities to provide input on the guideline both online and in person. We actively encouraged end-user input into the development and adaptation of the guidelines to ensure applicability to various practice settings and to promote adoption.

Results The final guideline contained 24 summary statements along with supporting clinical considerations, across six topic area sections. The guideline was adopted by various provincial/territorial and national government and non-governmental organisations.

Conclusions This method can be applied in other jurisdictions to adapt existing high-quality smoking cessation CPGs to the local context and to facilitate subsequent adoption by various stakeholders.

  • smoking cessation
  • clinical practice guideline
  • tobacco
  • healthcare provider
  • guideline implementation

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Strengths and limitations of this study

  • This paper describes the methodology used to develop clinical practice guidelines for smoking cessation in Canada by adapting existing high-quality guidelines using the ADAPTE framework and engaging key stakeholders and end-users in the process. This method can be applied in other jurisdictions to adapt existing high-quality guidelines to the local context to facilitate subsequent adoption.

  • The online wiki platform designed to foster engagement and allow for discussion of the guideline by network members was used minimally. In-person strategies were more successful for gathering feedback from end-users to inform development of the guideline.

  • Patient-level outcome data were not available to evaluate the impact of development and dissemination of the guideline.

Background

Smoking cessation interventions are one of the most cost-effective interventions in medicine.1 Even brief simple advice by healthcare providers (HCPs) produce small but clinically significant increases in quit rate2 3 that are associated with important public health benefits at a population level.4 More intensive interventions confer even greater benefits.3 Historically, a large proportion of smokers in Canada who wanted to make a quit attempt have not consistently received help to quit from their HCPs. In 2005, >88% of the close to 5 million Canadians who smoked made at least one visit to a healthcare provider in the previous year, yet only about half were advised to reduce or quit smoking and even fewer received information regarding smoking cessation aids.5

Although clinical practice guidelines (CPGs) for smoking cessation have long recommended that HCPs assess current smoking status and provide assistance with smoking cessation,3 there has been poor uptake of these recommendations. Commonly cited barriers to guideline implementation or uptake are attitudinal barriers such as acceptance of guidelines, willingness to change and the day-to-day experiences of practitioners not reflected in the guideline.6 As a result, much research has been done to enhance guideline development methodology to ensure greater consideration of implementation during the development process,7–10 with the aim to increase the applicability of CPGs to target end-users, resulting in a greater impact on clinical practice.

Article 14 of the WHO Framework Convention on Tobacco Control (WHO FCTC) states that ’each Party shall develop and disseminate appropriate, comprehensive and integrated guidelines based on scientific evidence and best practices, taking into account national circumstances and priorities’.11 Canada is a signatory to this framework, but previously did not have a national smoking cessation guideline adapted to the Canadian context. A number of CPGs for smoking cessation existed internationally,3 12 in addition to high-quality Cochrane reviews.13 14 However, no independent high-quality CPG had been previously developed and implemented consistently across Canada. Health Canada released a call for proposals to develop such guidelines in 2006, and CAN-ADAPTT (the Canadian Action Network for the Advancement, Dissemination and Adoption of Practice-informed Tobacco Treatment) was formed in 2008 (http://www.nicotinedependenceclinic.com/English/CANADAPTT). To prevent duplication of effort and cost, existing guidelines could be adapted but needed specific attention to transcontextual issues.15 The unique circumstances in Canada include a publicly funded healthcare system, special populations such as Aboriginal peoples, expanded roles of a variety of HCPs and regional variations in priorities and capacity in clinical prevention. These highlight the need for a guideline specific to the Canadian context. Therefore, our two main goals were to use evidence-based methods to synthesise existing high-quality guidelines and to engage end-users to contextualise the recommendations in order to increase adoption and dissemination of the guidelines within Canada.

Methods

The development of the guidelines met all the recommended elements described by the Institute of Medicine (IOM) and Guidelines International Network (G-I-N).16 17 To develop the guideline we used the following three-step process. First, we situated the project in the Knowledge to Action (KTA) Cycle to position the guideline for subsequent implementation.18 We then used the ADAPTE framework to guide the transcontextual adaptation.19 Within the ADAPTE model, we used the Appraisal of Guidelines for Research and Evaluation (AGREE) Instrument20 to rate and select appropriate guidelines. Lastly, we engaged a variety of end-users in the process to facilitate subsequent adoption.21 This was facilitated by employing knowledge brokers and establishing a network. These two activities have been identified as promising methodologies to facilitate knowledge exchange.22

As the first step, we synthesised existing research as recommended in the ‘Knowledge Funnel’ component of the KTA model.18 This represents the process through which knowledge is distilled to meet the needs of knowledge end-users. Given the existence of several guidelines, we relied on knowledge synthesis of existing guidelines to produce knowledge tools and products instead of rereviewing primary literature. This was done to save time and effort. Although the KTA model describes sources of information such as the Cochrane collaboration, it does not inform how existing CPGs are to be adapted to the local context. We identified the ADAPTE framework as a possible framework to guide the adaptation process since it specifically describes steps to consider transcontextual issues without losing the validity of the evidence-based practice. The ADAPTE process, first described in chemotherapy guidelines, outlines a systematic approach for adapting existing guidelines so they are appropriate for use in a different cultural or organisational context, taking into account the needs, priorities, legislation, policies and resources of the intended setting.19 The main steps include: search for existing guidelines; quality assessment of the guidelines; adaptation and applicability to the target setting; literature update; adaptation of the format; external review and finally adoption, endorsement and implementation. The ADAPTE framework involves the engagement of end-users in the guideline adaptation process to provide context for implementation and enhance uptake of the final guideline.15 19 23 The core principles on which the ADAPTE process are based include: respect for evidence-based principles in guideline development; ensuring guideline quality through use of reliable and consistent methods; involvement of key stakeholders to promote acceptance and use of the guideline; consideration of context to ensure applicability to local practice; flexibility of format to accommodate specific needs and acknowledgement of source materials.15

Synthesis of the evidence base

We first identified and evaluated existing guidelines in smoking cessation. A preliminary review of published and grey literature revealed several existing CPGs for smoking cessation from a variety of jurisdictions and one pharmaceutical company sponsored guideline from Canada.

Identification of existing clinical practice guidelines: two cycles

To establish a strong evidence base from which CAN-ADAPTT would build its Canadian practice-informed guideline, the Guidelines Advisory Committee (GAC), an independent, not-for-profit organisation was engaged to identify and assess existing CPGs. They provided independence to the process and mitigated potential bias by experts in smoking cessation with ties to commercial interests in smoking cessation who formed part of the Guideline Development Group (GDG, see below). The GAC comprises leaders in guideline development and evaluation methods with a trained reviewer pool of practising family physicians. Family physicians are the key primary care providers in Canada representing the primary target audience. The first iteration was conducted in November 2006. The GAC used a previously established process24 to conduct a full review of existing CPGs in smoking cessation published between 2002 and 2006.

The search was conducted using subject headings and focused terms such as smoking, tobacco or nicotine, in Ovid MEDLINE, Ovid Embase, guideline repositories such as National Guideline Clearinghouse, renowned developers with a history of developing high-quality guidelines such as the National Institute for Health and Clinical Excellence and websites of national and international specialty societies. A general Internet search was also conducted to ensure that no significant guidelines were missed. The search was limited to guidelines published in English. At that time, nine guidelines were identified (see box 1), which met basic predetermined quality criteria (ie, contained recommendations linked to the evidence and included some indication that a systematic search of the literature had been conducted). The second search of the published literature was conducted in January 2009 using an identical search and data extraction strategy. Five additional guidelines published since the previous search in 2006 met inclusion criteria (see box 1).

Box 1

Existing clinical practice guidelines identified

2002–2006

2006–2008

  • US Department of Health and Human Services Public Health Service. (2008, May). Clinical practice guideline: Treating tobacco use and dependence: 2008 update.*

  • Reichert J, de Araújo AJ, Gonçalves,CM, et al. (2008, October). Smoking cessation guidelines: 2008. Jornal Brasileiro de Pneumologia, 34(10), 845–880.

  • Ministry of Health. (2007 August). New Zealand smoking cessation guidelines. Wellington: Ministry of Health.*

  • Registered Nurses’ Association of Ontario (RNAO). (March 2007). Integrating smoking cessation into daily nursing practice.*

  • Tønnesen P, Carrozzi L, Fagerstrom,KO, et al. (2007). Smoking cessation in patients with respiratory diseases: a high priority, integral component of therapy. European Respiratory Society Task Force. European Respiratory Journal, 29, 390–417.

  • *High-quality guidelines identified as the evidence base for the Canadian guideline.

Appraisal of existing guidelines

The 14 guidelines identified in both reviews were evaluated for quality by four independent GAC reviewers using the AGREE instrument (see online supplementary table 1).20 Reviewers were practising family physicians in Ontario who had each been formally trained in the application of the AGREE instrument by the Centre for Effective Practice. The AGREE instrument was developed in 2001 as a tool to assess guideline quality and is an internationally recognised and validated tool. The AGREE instrument includes 21 items each scored on a scale from 1 to 4, categorised under six domains: scope and purpose, stakeholder involvement, rigour of development, clarity and presentation, applicability and editorial independence. The domain scores for all appraisers are combined and standardised as a total percentage of the maximum possible score for that domain. Guidelines are also assigned a global assessment of ‘strongly recommend’, ‘recommend’ or ‘not recommend’. Along with the AGREE instrument, reviewers were also asked to answer eight additional questions developed by CAN-ADAPTT to help capture information on the applicability of the recommendations to the Canadian context (see box 2). This was done to explicitly identify issues of applicability to facilitate adoption of the Canadian guideline.

Box 2

Additional questions to address applicability to the Canadian context

  1. The recommendations made in the guideline are appropriate for the intended users (ie, you and your colleagues) to perform.

  2. The recommendations made in the guideline are practical for the intended users (ie, you and your colleagues) to perform.

  3. The recommendations made in the guideline are consistent with patient treatment expectations.

  4. The recommendations are compatible with existing attitudes and beliefs of the guideline’s intended users (ie, you and your colleagues).

  5. The recommendations can be performed by the guideline’s intended users (ie, you and your colleagues) without the acquisition of new competencies (knowledge, skills, etc).

  6. What new competencies, if any, would be required?

  7. Criteria can be extracted from the guideline that would permit the measurement of specific outcomes related to the recommendations.

  8. Criteria can be extracted from the guideline that would permit the measurement of adherence to the recommendations.

Supplementary file 1

The AGREE instrument does not provide thresholds to indicate whether a guideline is of high-quality, but instead requires the appraiser to make an overall assessment taking each of the appraisal criteria into consideration.20 The GAC used the following criteria to identify high-quality guidelines for the purposes of this project: received an overall AGREE rating of ‘strongly recommend’ from at least three of the four reviewers; had a combined score of over 75% in the domain for rigour of development as well as at least three other domains and were determined to be applicable in the Canadian context. The rigour of development domain includes questions relating to the systematic approach and transparency of methods as well as the extent to which recommendations are linked to the evidence. This domain was identified by the GAC as critical to determining the quality of a CPG; for this reason, guidelines that did not score at least 75% in this domain were not considered high-quality and were not considered for use when developing the guideline. These criteria were based on the GAC’s expertise and years of experience reviewing and endorsing guidelines. Applicability to the Canadian context was based on scores of the AGREE ‘applicability’ domain, as well as results from the CAN-ADAPTT applicability questionnaire. One guideline (the Institute for Clinical Systems Improvement guideline for adults and mature adolescents, see box 1) that received two ‘strongly recommend’ and two ‘recommend’ overall ratings also scored over 75% in five of the six AGREE domains, and was also included for this reason. Ultimately, six high-quality guidelines were selected for use in developing the Canadian clinical practice guideline (see figure 1 for a detailed process diagram and box 1 for the list of high-quality guidelines selected).

Figure 1

Methodology used for identification of existing high-quality clinical practice guidelines.

Role of the guideline development group

The CAN-ADAPTT coordinating team invited a variety of HCPs from across Canada to adapt the recommendations to develop a practice-informed CPG. There were seven members of the GDG including a family physician, public health researcher, health psychologist and physician specialists from respirology, addiction and cardiology. GDG members were identified by the Chair of the GDG to include experts in each guideline topic area while ensuring a multidisciplinary and nationally representative committee. Representatives from four provinces (Ontario, Nova Scotia, Alberta and Quebec) were included for regional representation. Each GDG member received a modest honorarium to support their attendance at guideline development meetings and reimbursement for travel and accommodation for in-person meetings. Seven GDG meetings were held from 2006 to 2010. Each GDG member confirmed that they had not received funds from the Tobacco Industry. All network members and GDG Section Leads had to disclose any potential or perceived conflicts of interest, especially with pharmaceutical companies. Members of the GDG without commercial conflicts were asked to be Section Leads and adjudicate the final recommendations. In addition, we ensured that having a majority without conflicts in each section subgroup diluted the effects of any potential commercial bias. Lastly, we did not specify any particular pharmacotherapy in the first iteration of the guideline given that each medication (nicotine replacement, bupropion and varenicline) required a primary review of the extant literature by Canadian prescribers and was beyond the scope of the first iteration of the CAN-ADAPTT guideline process. Taken together, we believe the independence of the GAC and the steps taken to dilute any effects of commercial bias led to a balanced set of recommendations. Given the large number of potential guideline target end-users, representation on the GDG from all end-users was not feasible. However, end-users were involved throughout the development process (described below) to ensure the guideline reflected the experiences and needs of as many HCPs as feasible with the funds available.

Attributing level of evidence and grade of recommendation

Summary statements contained in CAN-ADAPTT’s guideline25 were based on the recommendations extracted from the six high-quality guidelines identified, along with input from GDG members. The six high-quality guidelines that were chosen each had different classifications for the grade of recommendation and level of evidence. The GRADE (Grading of Recommendations, Assessment, Development and Evaluation) Working Group’s guide for grading strength of recommendations and quality of evidence26–28 was used as a tool to bring CAN-ADAPTT’s GDG to consensus on the level of evidence and grade of recommendation for each of the summary statements they developed. Each summary statement was attributed a level of evidence (A, B or C) and a grade of recommendation (1=strong or 2=weak). This is a transparent and reproducible method for grading recommendations and could also be used in subsequent iterations of the guideline if primary studies were evaluated.

End-user adaptation

Many internationally developed guidelines have relied primarily on the expertise of subject matter experts.3 12 29 In contrast, to complement the contributions from the GDG, the CAN-ADAPTT coordinating team and knowledge exchange brokers actively engaged target end-users throughout the development process. To meet the needs of Francophone communities in Quebec and across Canada, the complete CPG was translated into French. It was then reviewed by experts in smoking cessation in Quebec, including two public health experts and a specialist physician with extensive clinical experience in smoking cessation interventions. They confirmed the guideline was applicable to Francophone communities, relevant to clinical practice and recommended its dissemination in Quebec and among French-speaking HCPs working in Canada (www.nicotinedependenceclinic.com/Francais/CANADAPTT).

CAN-ADAPTT network

An interprofessional network of over 800 members across Canada was established to provide an opportunity for end-users to refine and adapt the guideline, as well as contribute to the dissemination and implementation efforts. A number of strategies were used to promote CAN-ADAPTT and recruit members. This included invitations to join the network that were sent to over 100 professional associations and organisations representing various related disciplines, presentations and displays at practitioner conferences, email blasts and other print promotional materials, conducting workshops for HCPs and publishing articles in professional journals and newsletters. Network members were recruited from across Canada, and almost all Canadian provinces and territories were represented. Approximately, two-thirds of the members were HCPs, with a wide range of disciplines represented, including nurses (25%), dental assistants/hygienists (24%), respiratory therapists or asthma educators (8%), counsellors/therapists (7%), pharmacists (7%), nurse practitioners (6%), social workers (5%), general practitioner or family physicians (4%), specialist physicians (3%), dentists (2%), psychologists (2%), chiropractors (1%), occupational therapists (1%), dietitians/nutritionists (1%), physiotherapists (<1%) and other (3%). Target end-users of the CPG extended beyond the various HCPs to researchers and policy/decision makers to impress on the need for further research as well as support for implementation and dissemination of the guideline. Network members were from over 400 organisations (see online supplementary table 2).

End-user input from the network was actively sought throughout the development process to help ensure an understanding of the current research and gaps, barriers to practice and relevant clinical questions to inform recommendation development. They were also invited to review the CPG in draft format and provide insight into the clinical considerations and existing resources (clinical tools, websites, etc) contained in the CPG. A number of strategies used in an attempt to engage end-users throughout the guideline development process are described below.

Role of knowledge exchange brokers

Four individuals acted as regional knowledge exchange brokers (for Atlantic Canada, Ontario, Quebec and Western Canada) to recruit and attempt to engage practitioner groups and individuals across Canada to join the network and collaborate with the CAN-ADAPTT initiative. This acted to decentralise activity and ensure national representation within the network. HCP involvement and feedback was invited through guideline revision meetings, collaborative workshops, stakeholder meetings and an online discussion board. Each knowledge exchange broker had master’s level experience and a background in public health, and were hired following a competitive selection process. Three of the four brokers were situated in Ontario as part of the main team and had access to the internet, telephone and travel budgets to visit their respective regions. Due to the distinct nature of Quebec and the infrastructure of the Institut national de santé publique du Québec, the knowledge broker for Quebec was situated there and was under the direct supervision of a CAN-ADAPTT executive committee member (MT) also situated in Quebec; she also had access to resources and a budget for provincial engagement and dissemination.

Engaging end-users in guideline development

The CAN-ADAPTT initiative held a face-to-face workshop at annual general meetings (AGMs) in 2009 and 2010. Invitations to the AGMs were sent to all CAN-ADAPTT network members and were also widely circulated to healthcare-related professional associations and other stakeholders across Canada (eg, Newfoundland Smokers Helpline, Ontario Tobacco Research Unit, Manitoba Tobacco Reduction Alliance). These workshops provided an opportunity for guideline revisions and promoted cross-disciplinary discussion by allowing network members and various stakeholders from across Canada to provide feedback on initial versions of the guideline. The format included small group discussion for each of the guideline sections and was facilitated by the respective GDG Section Lead. Each workshop participant was provided with a workbook to capture his or her feedback. In addition, a CAN-ADAPTT staff member participated in each breakout session and was responsible for taking notes, which were then reviewed and approved by each breakout group lead facilitator. Input from the participant workbooks and the notes were compiled and provided to the GDG for consideration in the drafting and revision of the clinical considerations portion of each guideline section.

Between meetings, additional opportunities were provided for CAN-ADAPTT network members to provide input and feedback on the guideline. Regional knowledge exchange brokers met with various regional organisations and associations to seek input on the guideline, discuss potential opportunities to further engage HCPs, researchers and decision makers in the region as well as discuss any other opportunities for collaboration. Collaborative workshops targeted at various HCP groups were held in an effort to educate practitioners about the Canadian guideline, to offer practical advice (often from HCPs within their discipline) on how to implement the guideline into practice, and seek feedback on barriers and enablers to implementing the guideline. This input was incorporated into the clinical considerations section of the guideline. Additionally, teleconferences, webinars and online surveys were conducted to further discuss the guideline, strategies for implementation and to gather feedback on the guideline.

Use of an online platform

By launching the guideline and seeking feedback online throughout the guideline development process, knowledge exchange occurred rapidly. The use of an online discussion board allowed feedback to be provided to the CAN-ADAPTT coordinating team, and among the network members, allowing others to view comments and consider the impact for their own setting. To ensure sustainability of this dynamic, practice-informed guideline, an online wiki platform was launched to host the guideline and allow network members to continuously update specified portions of the guideline. Summary statements are based on high-quality evidence and expert opinion, however network members are able to provide contributions to other sections of the guideline including ‘clinical considerations’ and ‘tools and resources’.

Results

There were 24 summary statements produced for the guideline (table 1),25 along with supporting clinical considerations. These were posted online in the Spring of 2010. The Canadian guideline includes six topic area sections. Although overall prevalence has declined, select subpopulations have not experienced similar declines in smoking and currently bear most of the burden with prevalence rates two to three times that of the general population, and we therefore included these as specific areas for consideration: Aboriginal peoples,30 mental illness and/or other addictions31 and youth.32 Additional populations were identified as being at increased health risk from smoking and were also included: hospital-based populations33 and pregnant and breastfeeding women.34 Pharmacotherapy was also identified as a topic, however, given the nature of the rapidly changing evidence and policy in this area, a more traditional guideline development process (with involvement limited to prescribers) was undertaken for that section and will be outlined in a separate paper.

Table 1

Canadian smoking cessation guideline summary statements

Approximately 50–60 participants representing a range of organisations and professions attended each 1-day workshop at the AGM, during which they had the opportunity to provide feedback on the guideline. Feedback was incorporated into 79 clinical considerations,25 see table 2 for examples from each guideline section.

Table 2

Examples of clinical considerations from the Canadian smoking cessation guideline

Dissemination efforts included the following: the guideline was provided to provincial, territorial and federal government and non-governmental organisations to be integrated into their respective dissemination activities; exhibits and presentations were given about the Canadian guideline at various provincial and national conferences; the summary statements were incorporated into a book about tobacco reduction and cessation35; and the guideline is covered in the curriculum of the internationally accredited Training Enhancement in Applied Cessation Counselling and Health certificate programme, which provides training to HCPs in order to build capacity in evidence-based tobacco dependence treatment.36 Adoption of the guideline was evident by several agencies including the: Canadian Cardiovascular Harmonized National Guidelines Endeavour, harmonised guidelines for heart disease, hypertension, lipids and cholesterol37; Canadian Stroke Best Practice Recommendations38; Canadian Society of Respiratory Therapists39 and the Regional Municipality of Peel in Ontario.40

The guideline continues to be housed on the Centre for Addiction and Mental Health servers and will be updated as funding allows. Additionally, the guideline will be sustained by various partner organisations and programme that have embedded the information and website link in various materials. Having an online interactive experience allows the guideline to be available at a relatively low cost.

Discussion

This paper describes the process used to produce a practice-informed, evidence-based smoking cessation CPG for the Canadian context. This method focused on building from existing high-quality guidelines and engaging interprofessional end-users in the process to encourage adoption. Guideline development and implementation are complex activities that require models of knowledge to action as well as methods of implementation. Given there was no need for a de novo guideline, we focused our efforts on contextualisation and potential implementation.41 This paper describes one process of adaptation of the evidence base for Canada while engaging interdisciplinary end-users in the production of the guideline to facilitate a practice-informed guideline to enhance chances of adoption. Our assumption was that engaging target end-users at the outset to better understand needs, barriers and gaps would allow us to address those needs in order to minimise the disconnect between knowledge creation and implementation. During the process, we recognised that specific pharmacotherapy recommendations would require a primary review of existing randomised clinical trials and meta-analyses using GRADE. There was concern that the included existing guidelines did not have pharmacotherapy recommendations based on current published literature and so a separate project was initiated in 2011 to address this limitation (not described in detail in this paper). In addition, to help engage Francophones in Quebec, a separate team was involved in adaptation of the guidelines in Quebec to ensure national inclusion.

In undertaking this approach to guideline development, one of the challenges encountered was ensuring an appropriate balance between the evidence base, expert opinion and practitioner feedback was reflected in the guideline. It was determined that in order to appropriately balance evidence and clinical practice, end-users would provide feedback and input to inform the scope and content of the clinical considerations sections, suggest tools and resources to implement the guideline, identify current gaps in knowledge and identify important barriers and opportunities for adoption of the guideline. Summary statements would be based on the best available evidence from existing high-quality guidelines with input from established experts in the area. This approach allowed for a combination of evidence and experience of HCPs to be represented in the guideline.

Various opportunities for end-users to engage in the guideline development process provided different levels of success in collecting input. An online platform was used in an effort to address the commonly cited barrier to uptake of traditionally developed guidelines quickly becoming out of date, which has been reinforced by the description of the need for a ‘living guideline’ by Davis et al 42. The online platform would allow for rapid updating and dissemination of the guideline, as necessary. However, the use of online platforms as a mechanism to provide feedback on the guideline proved to be a challenge as the number of end-users engaging in the online discussion board was significantly lower than expected. This may be a result of users not being familiar or comfortable with participating in an electronic medium. Appropriate use of these technologies/platforms requires investigation in order to explore the utility of an online and iterative process for guideline development. The most successful activity in terms of gathering feedback from end-users to inform development of the guideline was the workshops at AGMs. This may reflect the preference of end-users to network, collaborate and provide feedback in person rather than online and to participate in structured discussions. The regional knowledge exchange brokers for Western and Atlantic Canada were situated in Ontario due to administrative reasons, incurring high travel costs. This limited the number of personal interactions with end-users in those regions. Contracting with local agencies and consultants as regional brokers could have improved engagement in these provinces as we had done in Quebec.

A recent systematic review of 35 handbooks on CPG development concluded that there are no established standards for updating guidelines and state that 40% suggest a 2-year to 3-year gap in updating CPGs.43 Recommendations are not explicit on updating of the Canadian guidelines as recommended by G-I-N or IOM primarily because the process was conceptualised before the project began.16 17 However, the guidelines were updated in 2009, prompted by the release of the US guidelines3 in 2008, and a section on pharmacotherapy was updated in 201235 due to the release of several primary studies on the use of varenicline and nicotine replacement including head-to-head studies. Currently, the pharmacotherapy section is being updated and due for release as an updated decision aid for prescribers in 2017. The other sections do not require as frequent updating given the robustness of the evidence to date for screening and counselling of tobacco use. In addition, the team constantly searches for updates in the source guidelines and the primary author (PS) is co-chairing the development of the updated Registered Nurses’ Association of Ontario guidelines which was one of the source guidelines for CAN-ADPTT, due for release in 2017. We will use the criteria described by Cancer Care Ontario to be explicit as to whether the update validates or invalidates all or parts of the previous guideline, and/or changes the strength of the evidence for each recommendation.44 Without ongoing funding, it is not feasible to keep the original GDG engaged in CAN-ADPTT activities. However, updates could be accomplished with limited funding and engagement via email/webcasts with a limited group of key stakeholders. Systematic reviews and meta-analyses, such as Cochrane reviews (tobacco.cochrane.org), could be appraised by the group and adapted to the Canadian context to provide updated recommendations. These could be posted online for public comment and emailed to network members for professional comments. Unfortunately, funding was not available for ongoing engagement of network members that could have been maintained with a listserv. In addition, new members would be required to replace members who leave or change the focus of their work. However, since funding has ended, ongoing dissemination and updates by other organisations has kept the guideline alive while we seek additional funding to conduct the updates.

The limitations of our process include the following. Although we tried using a wiki platform for dynamic discussion, use was minimal. We also were not able to tailor the information displayed on the website according to the audience reading the guidelines. There was no formal patient or public involvement in development of the guideline to prevent tokenism. Some HCPs and other target end-users who provided input may have been current or former smokers themselves or family members of people affected by smoking but we did not ask people to disclose this information to respect privacy. Only a minority of the large group of network members were engaged in the guideline development process. However, it is difficult to assess the success of our engagement efforts given the absence of similar projects with which to compare and the fact that the quality of the feedback received is difficult to quantify and evaluate. Lastly, we do not have data for patient-level outcomes across Canada to evaluate the impact of guideline implementation. Smoking prevalence rates continue to remain high but that is determined by more than clinical interventions per se.

This paper describes how to operationalise the ADAPTE framework in a highly resourced country where the culture differs across jurisdictions. We focused on respecting existing guidelines and focused on the factors that could increase adoption: wide stakeholder participation in the creation of the guideline; relevance to regional and local conditions by engaging funders and researchers in addition to clinical groups and use of technology and in-person meetings to develop and disseminate the guidelines. By placing them on the website and having a white board video by a famous influencer (Dr Mike Evans), we have made it accessible to patients as well (www.nicotinedependenceclinic.com/English/CANADAPTT/Pages/Home.aspx). Next steps for this initiative include continued knowledge translation efforts with a focus on guideline implementation as well as continued efforts to expand and strengthen the network. Opportunities to ensure sustainability of the guideline are being explored.

Conclusion

The CAN-ADAPTT initiative successfully used the ADAPTE process to create a Canadian guideline for smoking cessation. By engaging end-users to better understand needs, barriers and gaps at the outset, we were able to minimise the disconnect between knowledge creation and implementation. CAN-ADAPTT’s work suggests that where high-quality guidelines already exist and funds are limited, methods to adapt existing guidelines to the local context are possible. Other groups undertaking a similar process should consider the value of engaging target end-users and deploying knowledge exchange brokers during guideline development.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
View Abstract

Footnotes

  • Contributors PS was the principal investigator and provided overall supervision of the project at all stages. PS, KH, JR, KL-R, VC, MT, DK, RD, SH and LZ each made substantial contributions to the guideline development concept and process. KH wrote the initial draft of the manuscript. PS, KH, JR, KL-R, SS, VC, MT, DK, RD, SH and LZ revised the manuscript critically for important intellectual content.

  • Funding Funding was provided by Health Canada (Drugs and Tobacco Initiatives Program).

  • Competing interests No pharmaceutical or tobacco industry funds were used or received in the development of these guidelines. During the course of the grant, PS received funding for ad hoc consulting for advisory boards, education and unrestricted research grants from manufacturers of smoking cessation medications including Pfizer, Johnson and Johnson, Nabi Pharmaceuticals via an arm’s length Data Safety and Monitoring Board, Novartis and Biovail. PS also received consulting fees from manufacturers of anti-addiction medications including Prempharm, Lundbeck and Sanofi Synthélabo. No funds for entertainment were accepted. VC reports grants from Drugs and Tobacco Initiatives Program, Health Canada, during the conduct of the study. LZ reports grants from Global Research Awards for Nicotine Dependence, and a grant from Pfizer Canada, outside the submitted work. The remaining authors have nothing to disclose.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.