Article Text
PDF
Abstract
Objective We describe the use of an integrated knowledge translation (KT) approach in the development of the CONsolidated Standards Of Reporting Trials extension for equity (‘CONSORT-Equity 2017’), and advisory board-research team members’ (‘the team’) perceptions of the integrated KT process.
Design This is an observational study to describe team processes and experience with a structured integrated KT approach to develop CONSORT-Equity 2017. Participant observation to describe team processes and a survey were used with the 38 team members.
Setting Use of the CONSORT health research reporting guideline contributes to an evidence base for health systems decision-making, and CONSORT-Equity 2017 may improve reporting about health equity-relevant evidence. An integrated KT research approach engages knowledge users (those for whom the research is meant to be useful) with researchers to co-develop research evidence and is more likely to produce findings that are applied in practice or policy.
Participants Researchers adopted an integrated KT approach and invited knowledge users to form a team.
Results An integrated KT approach was used in the development of CONSORT-Equity 2017 and structured replicable steps. The process for co-developing the reporting guideline involved two stages: (1) establishing guiding features for co-development and (2) research actions that supported the co-development of the reporting guideline. Stage 1 consisted of four steps: finding common ground, forming an advisory board, committing to ethical guidance and clarifying theoretical research assumptions. Bound by the stage 1 guiding features of an integrated KT approach, stage 2 consisted of five steps during which studies for consensus-based reporting guidelines were conducted. Of 38 team members, 25 (67.5%) completed a survey about their perceptions of the integrated KT approach.
Conclusions An integrated KT approach can be used to engage a team to co-develop reporting guidelines. Further study is needed to understand the use of an integrated KT approach in the development of reporting guidelines.
- health equity
- reporting guidelines
- consort
- integrated knowledge translation
- collaborative research
- research co-creation
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
- health equity
- reporting guidelines
- consort
- integrated knowledge translation
- collaborative research
- research co-creation
Strengths and limitations of this study
Reporting guidelines in health research improve and contribute to a robust evidence base for health systems decision-making.
Integrated knowledge translation (KT) is an approach to research that structures the engagement of knowledge users, meaning those for whom the research is meant to ultimately be of use, with researchers to facilitate the co-development of knowledge.
An integrated KT approach was used to engage knowledge users with researchers as a team, to develop the CONsolidated Standards Of Reporting Trials extension for equity (‘CONSORT-Equity 2017’) reporting guideline.
Limitations are that the use of an integrated KT approach includes the logistics of including a range of people and the management of views.
The strengths include that the integrated KT approach allows consideration and inclusion of a range of views; an integrated KT approach can be used to engage a team to co-develop reporting guidelines.
Introduction
Reporting guidelines in health research are important, as they improve and contribute to a more robust evidence base for health systems decision-making.1 2 There is a significant amount of avoidable waste in research,3 and part of this waste can be attributed to potentially useful research findings being disregarded because of inadequate reporting, which reporting guidelines can help address. Defined as a tool for use by health researchers to structure manuscript writing, reporting guidelines consist of minimal lists of information to ensure that a manuscript can be understood by a reader, replicated by a researcher, used by a clinician to make a clinical decision and included in a systematic review.4 The use of reporting guidelines in health research may improve completeness and transparency of reported evidence from research studies. Many examples of reporting guidelines can be found at the Ottawa Hospital Research Institute’s Centre for Journalology site at http://www.ohri.ca/journalology/docs/guidelines.aspx,5 as well as the Enhancing the QUAlity and Transparency Of Health Research (EQUATOR) network site at https://www.equator-network.org/.4
The internationally recognised CONsolidated Standards Of Reporting Trials (CONSORT) statement is an evidence-based guideline consisting of 25 items to encourage completeness and transparency in reporting of randomised controlled trials (‘randomized trials’). CONSORT is in the form of a checklist and flow diagram.6 The checklist focuses on reporting how the randomised trial was designed, analysed and interpreted, and the flow diagram depicts participant progress through the randomised trial processes. Extensions to the CONSORT statement have been developed for specific issues (eg, pragmatic trials, non-pharmacological therapies, and social and psychological interventions).4 No extension has yet been developed to report items to assess the effects of an intervention on health equity.7
Striving for health equity is a matter of social justice and implies that everyone can attain their health potential and that no one is disadvantaged by their social positioning or other socially determined circumstances.8 Randomised trials are a powerful design for determining the relative impact of an intervention.9 Nevertheless, for randomised trials to contribute effectively to policies that promote health equity, there remain challenges to overcome.10 For example, poor reporting of equity considerations for randomised trials can have undesired effects on health systems’ organisational practices and policies, clinical and public care. Additionally, some interventions can even aggravate and/or undermine health equity.11 Reporting guidelines are needed to support the consideration of equity in the conduct of and communication about randomised trials.
‘Knowledge users’ are those who influence, administer and/or who are active users of healthcare systems, and who for our study were identified as potential holders of expertise about or relevant to health, research and/or reporting guidelines. ‘Engagement’ is defined here as an arrangement with knowledge users in the governance of the research process to co-lead research and that leads to co-development of knowledge (beyond being a research participant).12 While the engagement of knowledge users has been identified as important for clinical guideline development,13 14 a recent review of clinical guidelines shows that there is evidence for low levels of such engagement.15 Achieving consensus among developers of health research guidelines has been identified as important,16 but there is little information on how to achieve consensus when involving interdisciplinary knowledge users that include patients and members of the public in reporting guideline development.17
‘CONSORT-Equity 2017’
Wishing to produce the highest quality reporting guideline and recognising that the uptake of the resulting reporting guideline would be critical to improving the reporting of future randomised trials,18 between 2015 and 2017, an interdisciplinary group of knowledge users and researchers came together as an advisory board-research team (‘the team’) to develop an equity extension of CONSORT, ‘CONSORT-Equity 2017’.7
Of particular concern to the team was the need to prompt careful consideration of the knowledge translation (KT) issues that might promote uptake of the final reporting guideline product (ie, the equity extension of the CONSORT guideline). ‘Knowledge translation’ is a term used to refer to processes that bridge the ‘know-do’ gap, which is defined as the gap between what is learned from research and the implementation of what is learned by knowledge users, with the aim to improve health delivery systems and health outcomes.19 Initially, know-do gaps (eg, uptake of reporting guidelines) were considered simply a problem of knowledge transfer,20 and it was thought that end users only needed to become aware of the knowledge and they would then implement it. Understandings of the causes of know-do gaps continue to evolve, and now these gaps are considered to be more of a knowledge production problem (the knowledge being produced does not meet the needs of those who should be using it). Taking this later perspective, addressing the know-do gap requires researchers to begin thinking of KT before knowledge is created.21 22 Proposed as an approach to address the issues of knowledge production and application,21 22 ‘integrated knowledge translation’ (integrated KT) is also identified as an approach that is more likely to lead to the practical application of knowledge.20 23 The engagement of knowledge users in co-developing the research means the findings are more likely to be useful, usable and used.21 22 As there are issues with the uptake of reporting guidelines,6 an integrated KT approach is appropriate for the development of reporting guidelines.
Given the presumed benefits of an integrated KT approach and the desire to maximise the quality, usefulness and use of the reporting guideline, the team decided to adopt an integrated KT approach for the development of the CONSORT- Equity 2017 reporting guideline. In the case of CONSORT-Equity 2017, potential knowledge users of the reporting guideline were identified from a broad range of disciplines. These knowledge users are involved in research-related activities and disciplines such as clinical epidemiology, economics, social science, public health, international development, KT, patients or patient organisations (‘patients’), and members of the public, and so were invited to engage in the research to develop the reporting guideline.
The objective of this paper is to describe the use of an integrated KT approach in the development of the CONSORT-Equity 2017 reporting guideline and team members’ perceptions of the integrated KT process.
Methods
We adopted an observational study design involving participant observation supplemented with a survey of team members. We produced a description of team processes and experiences with the structured integrated KT approach used to develop the CONSORT-Equity 2017 reporting guideline.7 The research stages followed in developing the reporting guideline are described in detail in a published protocol.7 Participant observation is a qualitative and interactive process that connects to human experience through immersion and participation in a particular context.24 The processes to develop CONSORT-Equity 2017 were structured by a framework that depicts integrated KT, called the Collaborative Research Framework (‘framework’).25
The framework was selected as appropriate for use as engagement of knowledge users with researchers throughout the development of CONSORT-Equity 2017 was a priority. The framework was originally developed to describe the collaborative processes of work conducted by researchers in full partnership with an Indigenous community to culturally adapt a shared decision-making tool through research processes of development, conduct and dissemination.25 The framework consists of two stages that involve knowledge users and researchers agreeing to establish the parameters of the study (forming an advisory body, agreements on the approach to ethics and theoretical assumptions in the research) and then the conduct of the study with the knowledge users and researchers in full partnership throughout all the steps of a series of studies. The framework describes structured processes of negotiation within the study partnerships. It stresses the importance of engaging knowledge users as full partners with researchers in a team.25 We describe the study processes of CONSORT-Equity 2017 in relation to the framework that depicts integrated KT.
We used the framework to guide the development of CONSORT-Equity 2017 and to organise documented observations and events that describe the development of CONSORT-Equity 2017.26 At the completion of the study, a survey was conducted with team members about their perceptions of the integrated KT approach.
A survey was developed for team members to gather their feedback on the experience with the integrated KT approach. In consultation with an integrated KT expert (IDG), an eight-question online survey consisting of two Likert questions with an option for an open-ended comment and six open-ended questions about experience with integrated KT during the CONSORT-Equity 2017 study was developed and pilot-tested. The survey questions were designed to evoke understandings of the team experiences, with the two Likert questions about the extent to which team members felt they were engaged and their satisfaction with engagement. The open-ended questions were aimed at soliciting details on the experience with integrated KT during the CONSORT-Equity 2017 study. The team members were asked to participate in a survey following the development of the CONSORT-Equity 2017 reporting guideline. There were 38 individuals invited to participate in the survey, with one declining to be invited to participate due to personal time constraints.
Following a process of informed consent, the survey was administered in July 2017 to the team members. The frequency of the responses to the two Likert questions was tabulated. To analyse participant responses to the six open-ended survey questions, a process of inductive content analysis was used, which involves segmenting responses by topics and into categories. For the analysis of these responses, each question was considered to be a topic and the responses and development of codes defined the content in each category.27 One researcher conducted the content analysis process (JJ) and was confirmed by a second reviewer (MY).
Patients and public involvement
Patients (ie, patients and members of the public) were members of the team involved in the design, conduct and reporting of the work to develop CONSORT-Equity 2017. As patients were members of the CONSORT-Equity 2017 team, patient priorities, experience and preferences informed the development of research questions, design of the study and the outcome measures that are reported in this document to describe the research processes of CONSORT-Equity 2017. Patients are also identified as coauthors or acknowledged on the work presented here. The roles and membership of the team are reported in the study protocol and final product documents.7 17 18 28 For this reason, the work that is presented here is an example of how to conduct and report on the development of reporting guidelines in ways that include patients and which reflect their priorities, experiences and preferences.29
Results
The development of CONSORT-Equity 2017 used an integrated KT approach to structure replicable steps: to conduct research in a collaborative manner that uses consensus-building methods and involves co-development of knowledge25; and to develop a reporting guideline for equity (CONSORT-Equity 2017). The process for co-developinging the reporting guideline involved two stages: (1) establishing guiding features for co-development and (2) engaging knowledge users and researchers (the team) in research actions that supported the co-development of the reporting guideline (figure 1).
Integrated knowledge translation (IKT) approach for CONsolidated Standards Of Reporting Trials extension for equity (CONSORT-Equity 2017).
Stage 1: establishing guiding features for co-development
Preparation: finding common ground
Initiating a process to engage researchers with potential knowledge users in the development of CONSORT-Equity 2017 involved discussions with individuals and meetings: (1) determining if and how knowledge users’ interests and concerns align with those of researchers; (2) building relationships among knowledge users and researchers; and (3) defining the parameters of a team relationship for knowledge users and researchers to find common ground and collaborate as a team on a project to develop CONSORT-Equity 2017.25
Finding common ground was an iterative three-step process that involved the preparation of a research team. The research team consisted of researchers and knowledge users who chose to work together to produce an agreed-upon research agenda. Two research members (VAW, PT) initially recognised the interest and need to extend a reporting guideline, CONSORT, for equity. Next, these research members identified potential research team members who shared concerns about equity in health systems, and so relationships were built and a rudimentary research team was formed. The members of the growing research team defined the objectives and parameters of a reporting guideline project in a proposal that was submitted for funding. Following the success of the funding proposal, the iterative three-step process was then engaged in again by the research team to ensure inclusion of team members with a broad range of skills and expertise.
An advisory board was formed
Collaboration with knowledge users during the development of CONSORT-Equity 2017 was identified as an important feature of the study by the research team, and a decision was made to form an advisory board consisting of the intended users of the reporting guideline. There was a deliberate effort to define roles and recruit nine members to the advisory board: journal editors, trialists, bioethicists, patients, clinicians, systematic review authors, policy makers and funders. The advisory board is described in detail elsewhere.7 The need to ensure effective communication within and between the members of the advisory board and research team was identified, and two members of the research team were selected as facilitators: one with the advisory board (JJ) and the other with the research team (VAW).
The advisory board facilitator (JJ) worked with the advisory board members to define terms of reference and that included expectations (eg, meetings, types of contributions) and opportunities (eg, authorship guidelines) (table 1). The facilitators (JJ, VAW) worked to make plans and schedule events that created opportunities for the advisory board-research team (collectively referred to as ‘the team’) to function in a partnership to promote inclusion and respect for a multiplicity of views in the CONSORT-Equity 2017 study. Engagement between team members created opportunities to explore concepts related to health equity, and the results were reflected in products (eg, a tool to identify when a randomised trial is health equity-relevant18). Finally, the members of the team defined and agreed on an agenda for the study which was published in a study protocol.7
Terms of reference
Commitment to ethical guidance
The members of the team agreed to collaborate and engage in decisions about how to structure the development of the reporting guideline so that there was adherence to ethical guidelines. The aim was to ensure respect for and representation of a broad range of views through agreements, structured communication and consensus-building processes.18 The team agreed to adhere to Canadian ethical research guidelines during the conduct of the CONSORT-Equity study.30
Theoretical perspective clarified
The poor quality or absence of evidence about health equity is identified by policy makers as a key limitation of research.31 The team identified the lack of consensus on the use of terminology related to health equity concepts and the importance of underpinning assumptions as critical to the development of the reporting guideline. Therefore, the members of the team sought to clarify terminology and relate these understandings in publications to define the study parameters.7 18 The team reflected on the underpinning assumptions throughout the reporting guideline development process (eg, a focus on social determinants of health theory, revisiting and reflecting on meanings of health equity, and so on).
Stage 2: research actions that supported the codevelopment of the reporting guideline
Reporting guideline development process
The agreed-upon guiding features of the research approach (stage 1) were used to structure the multiphase (stage 2) CONSORT-Equity 2017 study to accomplish objectives and create products over a 2-year timeframe (table 2). Participatory methods in the form of facilitated online and inperson team meetings were used to promote consensus building among team members, and this resulted in the co-development of knowledge in the form of a reporting guideline.
Stages in the development of CONSORT-Equity 2017 update terms
The team co-developed the CONSORT-Equity 2017 following the methodology for consensus-based reporting guideline development advanced by Moher et al 16 and with the innovation of key informant interviews.17 The following are the five steps in reporting guideline development: (1) define (establish guideline need within the team; (2) assess (state of the literature, consultation with experts on health equity); (3) develop/adapt (propose and debate adaptation of the reporting guideline); (4) disseminate (develop and execute plan for uptake of the reporting guideline); and (5) apply (process of road-testing the reporting guideline).
Extent of knowledge user engagement
The use of the integrated KT approach facilitated engagement within the team by creating structures and opportunities for all team members to offer their views for the development of CONSORT-Equity.17 28 We failed to engage with one advisory board member due to time constraints around their ability to participate, and it was not possible for every member of the team to have their views accommodated, and some members chose to remove themselves from participation either temporarily or permanently (n=2). As well, it was not possible (and indicated as not desirable by members of the team) for every team member to participate in every step of the guideline development process, although opportunities to participate were actively welcomed and sought by the facilitators. For the development of the CONSORT-Equity 2017 reporting guideline, there are publications (see table 2) that document descriptions of the particular study processes and that include identification of who and how the team members were involved.7 18 28 32 33
As collaboration and consensus-building methods were a central feature in CONSORT-Equity 2017 development, it was important to understand the experiences of those who were involved in the reporting guideline development. An eight-question online survey consisting of two Likert questions with an option for an open-ended comment and six open-ended questions about the experience with an integrated KT approach during the CONSORT-Equity 2017 study was administered to team members. Twenty-four of the 37 team members responded to the first two Likert questions on the survey (response rate of 65%) (table 3). When asked ‘Overall, how would you rate the extent to which the research team engaged you in the study? (Where 1 is not at all satisfied and 5 is totally satisfied)’, 18 of 24 (75%) surveyed respondents indicated ‘very or totally satisfied’. The following is an illustrative quote: “I had a concrete role in the process and the team was very respectful and considerate of input so it was easy to feel invested.” In response to the second Likert question ‘How satisfied are you with the level of your engagement with the research team? (Where 1 is not at all satisfied and 5 is totally satisfied)’, 21 of 24 (87.5%) respondents indicated ‘very or totally satisfied’. The following is an illustrative quote from this response: “[I would] be happy (very) if all research teams engaged all participants in the same manner.”
Results of two Likert questions on a team survey about experience with integrated knowledge translation approach (n=24)
In the portion of the survey that included six open-ended questions, respondents were asked to provide details about their experience with the integrated KT approach during the development of the CONSORT-Equity 2017 reporting guideline. Frequency counts of the type of responses were recorded and are reported in table 4 with illustrative quotes.
Results of six open-ended questions on a team survey about experience with an integrated knowledge translation approach (n=25)
When participants were asked what they perceived as the benefits of an integrated KT approach (question 1), the most common (14/25, 56%) response described integrated KT as an approach that allows multiple voices/opinions to be heard and considered. In response to being asked about whether they thought that the team faced any challenges in the study as the result of the integrated KT approach (question 2), many participants (8/25, 32%) reported that the logistics involved with including a lot of people was a challenge, but a slightly larger number (9/25, 36%) reported that they were unaware of any team challenges. When asked about whether they faced any challenges during the development of the reporting guideline as the result of the integrated KT approach (question 3), the vast majority of participants (19/25, 76%) indicated that they did not face any challenges.
Participants were asked what they considered to be the impact(s) of using an integrated KT approach with reporting guideline development (question 4), and many (11/25, 44%) indicated that an integrated KT approach improved the relevance of the final guideline product, and 11 of 25 (44%) reported that the work to develop CONSORT-Equity 2017 was better informed. When asked if they would change anything about how the integrated KT approach was used (question 5), few participants provided a response (n=15), and of those who did indicate a response, most participants (8/15, 53%) indicated that they would not have changed anything. Finally, when asked for additional comments (question 6), while most respondents (19/25, 76%) provided no comments, some (6/25, 24%) reported that the integrated KT process was a positive experience (table 4).
During the development of CONSORT-Equity 2017, team members were found to be more engaged in particular activities in relation to their knowledge, occupational roles and in relation to life events. For example, some team members were found to play a larger role when the team activities required expertise held by team members (eg, expertise about health equity, the conduct of randomised trials and so on). The development of the CONSORT-Equity 2017 reporting guideline was voluntary for most team members—and was unpaid work—and so other employment or volunteer commitments may have influenced the ability of team members to participate in meetings. As well, personal factors (eg, health issues, family events, travel plans) had impact on the participation of team members in the development of CONSORT-Equity 2017.
Discussion
A team engaged in mutually agreed-on processes to co-develop knowledge and assemble empirical evidence to develop a reporting guideline, CONSORT-Equity 2017. The team was established to function as a partnership throughout the study process to promote inclusion and respect for a range of views. A structured integrated KT approach was used to organise ongoing negotiations among team members and used replicable steps to develop a reporting guideline. The aim was to ensure that the team’s agreed-on goals were achieved: to conduct research in a collaborative manner that uses consensus-building methods and involves co-development of knowledge; and to develop a reporting guideline for equity (CONSORT-Equity 2017) as a contribution to address health systems’ equity issues.
Perceptions of the integrated KT approach and impacts on co-development of knowledge
Our study involved a 38-member interdisciplinary team from eight countries that included patients and who collaborated in the development of CONSORT-Equity 2017. Details on the team members and processes are reported in detail elsewhere.7 28 There is little evidence in the literature about the experiences of interdisciplinary teams that include journal editors, trialists, bioethicists, patients, clinicians, systematic review authors, policy makers and funders. Previous studies that investigate patient perspectives on clinical guideline development concluded that effective engagement in the development process requires planning, and the recommendations arising from that work include the use of smaller and diverse groups, with no prior relationships with other members of the team; individual and group preparation for engagement on the team; and an identified contact person for participants.34 In our study, we prepared an interdisciplinary and international team to work together in the development of a reporting guideline.
Many options exist to facilitate collaboration within research partnerships and that foster democratic approaches to knowledge development.23 35–37 An integrated KT approach was identified as appropriate for our team and its proposed development of a reporting guideline, as it focuses on the codevelopment of knowledge with practical applications.23 Furthermore, we found that during the development of the reporting guideline, an integrated KT approach supported many opportunities for team members to be fully involved in the entire research process as planned during the CONSORT-Equity 2017 protocol development.7 The integrated KT approach began with an iterative process of preparation of team members for participation in a research partnership, a feature reported in other frameworks that structure engagement of knowledge users with researchers in health research.36 38 39 The members of the team involved in the development of CONSORT-Equity 2017 were invited to participate in all phases of the reporting guideline development process, and efforts were made by facilitators to accommodate their participation.
The value of knowledge user engagement during the reporting guideline development is asserted in a substudy that was conducted with interdisciplinary key informants. This study, which engaged key informants in interviews about their views and suggestions for an extension of CONSORT for equity, was found to generate new concepts that contributed to the development of CONSORT-Equity 2017.17 We prioritised the engagement of team members throughout the development of CONSORT-Equity 2017 to improve the likelihood that CONSORT-Equity 2017 would be perceived as useful and applicable in practice. To strive for authentic (ie, ethical, equitable) engagement, deliberate efforts were made to foster relationships within a team that consisted of knowledge users and researchers.
The successful engagement of team members was possibly due to the structured integrated KT approach that fostered processes of negotiation and created opportunities for team members to choose their level of engagement. For example, there were ongoing opportunities for members of the team to engage at different stages of the CONSORT-Equity 2017 study. These opportunities were initially identified during the preparation for the development of CONSORT-Equity 2017. The iterative and prolonged focus on preparation of team members led to the development of a shared agenda for the work to develop CONSORT-Equity 2017. The finding of a focus on iterative preparation of team members is an innovation on the original framework used to guide the integrated KT approach (figure 1). The opportunity to prepare team members to engage in the CONSORT-Equity 2017 study and to work together led to opportunities to develop and make shared understandings and agreements explicit. The team facilitators built on the success of the initial engagement of team members in the reporting guideline development, and created frequent and varied opportunities for ongoing participation in the CONSORT-Equity 2017 study processes (eg, through scheduled face-to-face and/or telephone calls, maintained regular email study updates).
The experience with varied levels of engagement by team members in the CONSORT-Equity 2017 study led to consideration of the meaning of ‘engagement’ among an interdisciplinary team consisting of knowledge users and researchers. Overall, our team consisted of a committed group of team members who were involved in a collaborative effort for the duration of the work to develop CONSORT-Equity 2017. Team members met and agreed on objectives, and this in turn resulted in co-developed products. During the series of CONSORT-Equity 2017 studies, the nature and degree of engagement varied over time and according to the capacity of team members and study tasks. Team members asked to be kept informed but did not want to actively participate (eg, one-way direction of information updates on the study, such as an email with announcements); be consulted for feedback (eg, responding to an email request for information or feedback on a document); play a supportive role for others who provide governance in the CONSORT-Equity 2017 study processes (eg, providing support in a study in response to requests by team leads); and share in the governance of the study (eg, advising and/or decision-making in a co-leading role, such as in the development of CONSORT-Equity 2017 study directions or products. The different levels at which knowledge user engagement may occur has been under examination for many years, and one of the earliest instances is Arnstein’s 1969 ladder of participation and that ranges from non-participation to citizen control.40 Since then there have been many other ways of conceptualising knowledge user engagement in research.41–43
During our CONSORT-Equity 2017 study, we accomplished the engagement of team members that included knowledge users in study governance—and then exceeded this aim with knowledge user leadership. There are documented instances of varied team members taking the lead during the CONSORT-Equity 2017 study conduct and that occurred during meetings (eg, expert knowledge user leads taking initiative with and guiding sessions at the Boston Equity Symposium) and with study publications.33 The range of engagement that was observed during the CONSORT-Equity 2017 study processes demonstrates that engagement may be more changeable, nuanced and less able to be anticipated than is currently described in the literature encouraging knowledge user engagement.12 42 The use of the structured integrated KT approach allowed members of the team to determine how and in what capacity they would contribute, while also being engaged to co-develop a reporting guideline.
Limitations and strengths for use of an integrated KT approach to develop a reporting guideline
The surveyed team members identified the main limitations (challenges) of an integrated KT approach to be the logistics of including a range of interdisciplinary team members in the study and the management of team views. The team facilitators reflected on the logistics and the challenges of scheduling meetings to accommodate or align with team member commitments (outside of CONSORT-Equity 2017) and time constraints for those on the team to participate in the study. As well, there may have been impacts on the participation of team members due to the reliance on the facilitators who were based at one site and responsible for fostering regular and productive contacts, and with the use of online communications (vs face-to-face meetings). For example, communication between and within those on the team was a challenge due to the logistics of time zones, the number of people and limitations of technology. These challenges were further complicated by the need to bring team member views together in consensus to achieve CONSORT-Equity 2017 study objectives.
The surveyed team members identified the main strength of the integrated KT approach to be the consideration and inclusion of a range of views in the research process. The facilitators of the team reflected on the use of study processes structured by the integrated KT approach that, for the duration of the study, made it possible to build and/or strengthen research relationships initiated at the start of the study and across a range of team members. These research relationships were demonstrated by team member participation in publication coauthorship, attendance at regular meetings, email contacts and feedback on products.
Limitations and strengths of the study to evaluate an integrated KT approach
The limitations of the study about the use of an integrated KT approach reported in this paper include that the work to evaluate the use of an integrated KT approach (the observational study) was done with a smaller group of interdisciplinary team members and that team members already shared an interest in taking an integrated KT approach in the development of a reporting guideline (CONSORT-Equity 2017). For this reason, the findings about the integrated KT process presented here may not be relevant to other teams that consist of a different groups of team members and that have different team objectives. In addition, the methods we used are observational and not established for use with teams who are engaged in a multiple series of studies to develop an end product (in our instance, a reporting guideline). The strengths are that we used a previously developed framework25 to structure our reporting about the use of an integrated KT approach. As well, we successfully engaged an interdisciplinary team throughout the guideline development process and were able to evaluate the process.
Conclusions
A structured integrated KT approach was successfully used to engage an interdisciplinary and international team to develop a reporting guideline, CONSORT-Equity 2017. The use of an integrated KT approach fostered engagement of the team in the study processes and prompted deliberation and consensus building among team members. Further work is needed to examine and better understand the use and potential applications of an integrated KT approach to other initiatives seeking to improve research reporting guidelines.
Acknowledgments
We thank the following individuals for their support and encouragement: Mark Petticrew, Jeremy Grimshaw, Charles Weijer, Monica Taljaard and Yukiko Asada.
References
Footnotes
Contributors JJ, IDG, VAW conceived and led the design of the work described in the manuscript and were responsible for the first and final drafts of this manuscript. All authors participated in and provided substantial contributions to the analysis and interpretation during development of the work described in the manuscript. JJ led the writing of the first version of the manuscript. JJ and IDG revised the manuscript. All authors made contributions to the drafts of this manuscript (including the listed members of the CONSORT-Equity 2017 and Boston Equity Symposium) and have reviewed and revised the manuscript for important intellectual content and approved the final version of the manuscript.
Funding JJ held a Canadian Institutes of Health Research (CIHR) Postdoctoral Fellowship for a portion of the time she was writing the paper. IDG is a recipient of a CIHR foundation grant (FDN# 143237).
Competing interests All authors have completed the Unified Competing Interest form (available on request from the corresponding author) and declare no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the previous 3 years; no other relationships or activities that could appear to have influenced the submitted work, with the following exceptions: (1) LGC reports he works as a Senior Advisor for Health Systems Research to the Pan American Health Organization/WHO. His Organization’s Policy on Research for Health calls for the development and use of research reporting standards and improving the value and impact of research for health. His opinions and contributions to this manuscript are his own and do not necessarily reflect the decisions or policies of his employer. (2) DM reports that he is one of the ‘inventors’ of CONSORT. (3) VAW reports grants from Canadian Institutes of Health Research, grants from Ontario Early Career Researcher Award, during the conduct of the study.
Ethics approval Participants gave informed consent before taking part in the study of the integrated KT approach used in the development of the CONSORT-Equity 2017 reporting guideline reported in this manuscript. Research ethics approval was obtained from the Bruyère Research Ethics Board (Bruyère REB Protocol #M16-15-042).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data available.
Collaborators Collaborating authors who are identified as a member of the CONSORT-Equity and Boston Equity Symposium participants are as follows: Rebecca Armstrong, Sarah Baird, Yvonne Boyer, Luis Gabriel Cuervo, Regina Greer-Smith, Anne Lyddiatt, Jessie McGowan, Lawrence Mbuagbaw, Tomas Pantoja, Beverly Shea, Bjarne Robberstad, Howard White and George Wells.