Article Text

Protocol
Expert consensus on a standardised definition and severity classification for adverse events associated with spinal and peripheral joint manipulation and mobilisation: protocol for an international e-Delphi study
  1. Martha Funabashi1,2,
  2. Katherine A Pohlman3,
  3. Lindsay M Gorrell4,
  4. Stacie A Salsbury5,
  5. Andrea Bergna6,
  6. Nicola R Heneghan7
  1. 1Division of Research and Innovation, Canadian Memorial Chiropractic College, Toronto, Ontario, Canada
  2. 2Department of Chiropractic, University of Quebec in Trois Rivieres, Trois-Rivieres, Quebec, Canada
  3. 3Research Center, Parker University, Dallas, Texas, USA
  4. 4Integrative Spinal Research Group, Department of Chiropractic Medicine, Balgrist University Hospital, Zurich, ZH, Switzerland
  5. 5Palmer Center for Chiropractic Research, Palmer College of Chiropractic, Davenport, Iowa, USA
  6. 6Research Department, SOMA Istituto Osteopatia Milano, Milan, Italy
  7. 7School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, UK
  1. Correspondence to Dr Martha Funabashi; mfunabashi{at}cmcc.ca

Abstract

Introduction Spinal and peripheral joint manipulation (SMT) and mobilisation (MOB) are widely used and recommended in the best practice guidelines for managing musculoskeletal conditions. Although adverse events (AEs) have been reported following these interventions, a clear definition and classification system for AEs remains unsettled. With many professionals using SMT and MOB, establishing consensus on a definition and classification system is needed to assist with the assimilation of AEs data across professions and to inform research priorities to optimise safety in clinical practice.

Methods and analysis This international multidisciplinary electronic Delphi study protocol is informed by a scoping review and in accordance with the ‘Guidance on Conduction and Reporting Delphi Studies’. With oversight from an expert steering committee, the study comprises three rounds using online questionnaires. Experts in manual therapy and patient safety meeting strict eligibility criteria from the following fields will be invited to participate: clinical, medical and legal practice, health records, regulatory bodies, researchers and patients. Round 1 will include open-ended questions on participants’ working definition and/or understanding of AEs following SMT and MOB and their severity classification. In round 2, participants will rate their level of agreement with statements generated from round 1 and our scoping review. In round 3, participants will rerate their agreement with statements achieving consensus in round 2. Statements reaching consensus must meet the a priori criteria, as determined by descriptive analysis. Inferential statistics will be used to evaluate agreement between participants and stability of responses between rounds. Statements achieving consensus in round 3 will provide an expert-derived definition and classification system for AEs following SMT and MOB.

Ethics and dissemination This study was approved by the Canadian Memorial Chiropractic College Research Ethics Board and deemed exempt by Parker University’s Institutional Review Board. Results will be disseminated through scientific, professional and educational reports, publications and presentations.

  • adverse events
  • health & safety
  • complementary medicine
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Strengths and limitations of this study

  • This study protocol is based on a formal scoping review of the literature and the published ‘Guidance on Conducting and REporting DElphi Studies (CREDES)’.

  • Researchers will represent all professional groups who perform spinal and peripheral joint manipulation and mobilisation as part of routine clinical practice.

  • Participants will involve international and multidisciplinary spinal and peripheral joint manipulation and mobilisation stakeholder representatives.

  • Definitions and a priori criteria for consensus, agreement and stability are detailed.

  • Findings will be specific to spinal and peripheral joint manipulation and mobilisation, limiting the external validity to other manual therapy techniques.

Introduction

Spinal and peripheral joint manipulation and mobilisation are interventions commonly used in the management of many musculoskeletal conditions, including spinal pain, and are most often administered in ambulatory care settings.1 2 These interventions, which are described in many ways, include among others, high-velocity low-amplitude manipulation, low-velocity variable-amplitude mobilisation, spinal manipulative therapy, musculoskeletal manipulation, osteopathic manipulative treatment, Maitland mobilisation grades, and so on. While both interventions are applied to spinal or peripheral joints, an important distinction is that manipulation usually consists of the application of a dynamic high-velocity, low-amplitude thrust, whereas mobilisation consists of the application of a cyclic low-velocity and variable amplitude manual force.3 For the purpose of this manuscript, ‘SMT’ will be used to refer to manipulative therapy and ‘MOB’ will be used to refer to mobilisation.

With increasing evidence supporting the effectiveness of SMT and MOB to reduce pain and improve function in patients with musculoskeletal conditions,4–6 the use of these interventions by patients have also increased.1 However, research that demonstrates the safety of these approaches has lagged behind efforts to establish the efficacy of these interventions.

Patient safety is a top priority within healthcare and generally focuses on minimising preventable and/or unexpected adverse events following any type of intervention, including SMT and MOB.7 8 Despite this awareness, efforts to reduce adverse events within the SMT and MOB fields have been minimal.7 9–11 In 2015, a National Patient Safety Foundation expert panel emphasised that patient safety was still a major public health issue.12 Their key recommendation included the creation of a common set of safety metrics that reflect meaningful outcomes and focused on ambulatory care centres; patient contact in such sites is substantially higher than those located in hospital settings (1 billion annual visits vs 35 million annual admissions, respectively).13

While hospital inpatients are expected to have more adverse events due to their acute condition and undergoing more invasive procedures,14 it is still important to collect adverse events data following SMT interventions in a standardised way.15 Similar to other healthcare interventions, adverse events after SMT and MOB have been reported. Adverse events attributed mostly to SMT present great variation, ranging from frequent and expected minor adverse events (such as mild discomfort and increased muscle soreness after treatment) to rare and serious adverse events (such as cauda equina syndrome).10 16–18 An accurate estimation of the incidence of adverse events following SMT and MOB remains challenging for several reasons, including the varied definitions of what constitutes an adverse event, and the use of diverse terminology.19 Specifically, ‘adverse events’, ‘adverse reactions’, ‘complications’ and ‘side-effects’ have been used interchangeably in studies reporting unintended and undesirable outcomes following SMT.20–23 Similarly, ‘mild’, ‘minor’ and ‘benign’, as well as ‘major’, ‘severe’ and ‘intense’ have been used to classify the severity of such events.24–26 The use of such diverse terminology precludes not only the accurate estimation of adverse events following SMT and MOB, but also advancements of patient safety.

To address these concerns, the systematic evaluation and reporting of adverse events following SMT and MOB would significantly facilitate a better understanding of such events and potentially allow for the development of strategies to prevent and manage their occurrence. More specifically, this standardisation includes the operational definition of what constitutes an adverse event and the severity classification system for similar modalities. By establishing consensus on the definition and the use of a standardised severity classification system, adverse event reports following SMT and MOB can then be better identified and put into the same frame of reference across professions. This has the potential to significantly advance the knowledge related to adverse events, promoting a fundamental advancement in patient safety and quality of care for SMT and MOB.

Aims

The aim of this Delphi study is to determine, by an expert consensus process, a standardised definition and severity classification for adverse events following SMT and MOB, within an adult population with musculoskeletal conditions, for use in both clinical care and research studies.

Methodology

Design and justification

The electronic Delphi (e-Delphi) method is suited to achieving consensus among experts through the independent completion of sequential questionnaires that are refined by participant feedback resulting in a convergence of opinion and eventual consensus.27 An e-Delphi method in this instance overcomes barriers to other consensus approaches, for example, nominal group technique, differences in geographical location, time zones, and so on. This method therefore allows us to approach experts globally and without limits to specific participant groups.

This protocol has been informed by a rigorous scoping review of the literature (in preparation), is in accordance with the ‘Guidance on Conducting and REporting DElphi Studies (CREDES)’28 and was registered at Open Science Framework (osf.io/ex3ha). This protocol is also being published a priori to ensure quality, rigour and transparency. Our three-round e-Delphi procedure is outlined in figure 1 with data collection taking place between November 2021 and June 2022. Using the Research Electronic Data Capture system (REDCap) platform, all rounds will be completed electronically and confidentially. In round 1, participants will be invited to answer open-ended questions on their working definition and/or understanding of adverse events and their current severity classification for SMT and MOB. In round 2, participants will rate their level of agreement with statements generated from round 1 and results from the scoping review of the literature using a 5-point Likert scale. In round 3, participants will rerate their agreement with statements that achieved consensus in round 2. Statements reaching consensus must meet the a priori criteria at rounds 2 and 3.

Figure 1

Delphi study procedures.

Expert eligibility and sample

Experts will be defined as adult individuals with a high level of knowledge within the area of patient safety and adverse events related to SMT and MOB for musculoskeletal conditions which will be confirmed using the eligibility criteria (see table 1). Potentially eligible participants will be identified through existing professional networks and social media/internet-based searching. They will be recruited worldwide and be aged 18 or above, able to read and write in English, and willing to provide signed informed consent. Through email, potential participants will be invited to participate by an author or via their professional network connection. Recruitment will be maximised by encouraging identified experts to snowball the invitation with other potential expert participants, including calls for expressions of interest on social media and professional organisations and networks. While expressing their interest in participating in this study on a REDCap electronic form, potential participants will be asked to provide eligibility information.

Table 1

Eligibility criteria for expert consensus panel

Informed consent will be obtained electronically through REDCap. Recruitment will continue for 8 weeks with a reminder email sent at weeks 2, 4 and 6. Should no contact be made after 8 weeks, no further communication will be sent.29

Sample size in previously published Delphi studies and expert panels have ranged from 4 to 3000.30 Previous Delphi studies with an aim of defining intervention adverse events and complications typically achieved consensus with responses from 30 to 7331–34 experts in the final round and therefore a conservative estimate of 75 responses are required. Assuming a response rate of 70%, a minimum of 108 experts are required to complete the consent form to ensure at least 75 responses.27 To prevent over representation from one expert group or profession, expressions of interest from potential participants and their eligibility information will be monitored and, to achieve similar number of responses between all professions and groups, additional invitations will be sent to expert groups or professions who are underrepresented.

Procedure

Round 1

The objectives of round 1 are to collect participant demographic information and generate statements on the definition and severity classification of adverse events following SMT and MOB. Participants will complete the ‘Demographic Information Form’ specific to their expert group (ie, researcher, manual therapy clinician, patient, medical doctor, student, professional regulatory body, malpractice insurance and informatics/electronic health records representatives, lawyers and judges; online supplemental file 1). The round 1 questionnaire will consist of open-ended questions. Open-ended questions improve content validity as statements are generated by expert opinion.27 35 36 Statements based on the results of the scoping literature review will be generated and included in round 2, rather than round 1, to allow participants to provide their expert opinion without bias from the literature, thereby reducing experimenter bias.37 The round 1 questions will ask participants to define their current understanding of adverse events and their severity classification following SMT and MOB. This may or may not include providing references or resources to support their definition or classification. Participants will have the opportunity to provide general comments related to this topic at the end of the questionnaire. The round 1 questionnaire will be piloted for feedback on readability, relevance and appropriateness through selected Delphi expert methodologists in the steering committee and edited accordingly. Round 1 will be open for 6 weeks with email reminders being provided at weeks 1, 3 and 5.

Round 2

The objectives of round 2 are to evaluate consensus of statements developed from the round 1 questionnaire and scoping review findings regarding adverse event definitions and their severity classification following SMT and MOB in adults with musculoskeletal conditions, and to identify any further statements. A detailed description of the scoping review is currently under preparation. Briefly, a literature search strategy was developed with assistance of a health sciences librarian and comprised of combinations of indexing terms (MESH and non-MESH), such as musculoskeletal manipulation, adverse event and definition or classification. Databases, such as Medline, Embase, Cumulative Index to Nursing & Allied Health (CINAHL) and Scopus were searched as well as grey literature and theses and dissertations. Relevant studies were identified and definition and classification of adverse events following after SMT and MOB were extracted.

Participants will be provided with feedback explaining how statements were generated from round 1 and the scoping review and then asked to rate their agreement with the provided statements using a 5-point Likert scale where 1=strongly disagree and 5=strongly agree.38 A 5-point scale is preferred as it displays acceptable psychometric properties while being quick and easy for participants to complete, thus reducing frustration and demotivation.39 An open text box will be included for each statement to allow for any additional comments that may generate further statements. All comments will be analysed by the executive committee and reviewed by selected Delphi expert methodologists in the steering committee. All participants will be invited to take part in round 2, including those who did not complete round 1, provided they have not withdrawn from the study. This provides the opportunity for participants to continue their involvement even when unable to complete previous rounds.27 As per round 1, the round 2 questionnaire will remain active for 6 weeks with email reminders sent at weeks 1, 3 and 5.

Round 3

The objective of round 3 is to further evaluate statements regarding adverse events definitions and their severity classification following SMT and MOB. The round 3 questionnaire will include feedback from round 2 using descriptive statistics and qualitative comments, promoting participant reflection before completing the questionnaire. In round 3, participants will be asked to rate their agreement with the statements achieving consensus from round 2 using the same 5-point Likert scale. Statements that do not achieve consensus in round 2 will be discarded. A free-text box will be provided for participants to clarify responses, but the generation of new statements will not be encouraged. All responses will be analysed by the executive committee and reviewed by the full steering committee. All participants will be invited to participate in round 3, which will again remain active for 6 weeks with email reminders sent at weeks 1, 3 and 5.

Data analysis

Quantitative data analysis will be conducted using R: A language and environment for statistical computing (R Foundation for Statistical Computing, Vienna, Austria). Qualitative data analysis will be conducted using Microsoft Excel (Microsoft Corporation, USA). Qualitative data will be analysed independently by two researchers (MF/LG) at each round and disagreements will be resolved by discussion and consensus with the consultation of a third reviewer (KP), if needed.

Complete agreement between executive committee members is required for statements to be included, with disagreements resolved by discussion.40 The selected Delphi expert methodologists in the steering committee will have the opportunity to review the data and interpretation of findings at each stage for feedback and editing before dissemination to the e-Delphi participants for the next round.

Round 1

Qualitative data from open-ended questions will be examined using a theoretical thematic analysis to generate statements under themes preidentified from the scoping review of the literature and then examined inductively for any new themes.41 42 Wording used by participants will be combined to generate statements that best represent similar statements across participants.37 Statements generated from the results of the scoping review of the literature not identified from participant responses will also be included. For a statement to be included, it must be described at least once by any participant or via results of the scoping review of the literature; therefore, all standalone statements will be kept and included. The round 2 questionnaire will be constructed using the statements generated.

Round 2

Descriptive and inferential statistics will be used to evaluate agreement and consensus (table 2). Statements nearly achieving the a priori criteria for consensus will be reviewed on a case-by-case basis and where appropriate, revised statements based on comments from participants will be carried forward to the next round. Qualitative data from comments will be analysed using thematic analysis for the emergence of any new statements.

Table 2

Definitions and statistical measures of consensus, agreement and stability

Round 3

Descriptive and inferential statistics will evaluate consensus against a priori criteria (median ≥3.5; IQR ≤1 and percentage agreement ≥70%; table 2). Statements achieving consensus after round 3 will be used to define adverse events and their severity classification following SMT and MOB. Statements that fail to achieve consensus in round three will be discarded.

Consensus, agreement and stability

Definitions and statistical measures of consensus and agreement described in the literature for Delphi studies are conflicting.40 43–45 Specifically, while consensus and agreement have been used interchangeably,45 unique definitions have also been recommended.46 Therefore, this study will use the following definitions and is consistent with earlier research47 :

  • Consensus—the extent to which the group of experts share the same opinion.45

  • Agreement—a measure of inter-rater agreement where the rating of one expert can be predicted by the rating of another.48

  • Stability—the consistency of responses between successive rounds.45

For each round, a combination of descriptive and inferential statistics will be used to assess consensus, agreement and stability (table 2).40 43 44 47 Consensus will be evaluated using descriptive statistics of central tendency and dispersion (median and IQR). Percent agreement of responses rated agree/strongly agree will also be used to evaluate consensus for each statement.49 To enable convergence and strengthen consensus overall criteria will be increased between rounds 2 and 3.49 Kendall’s Coefficient of Concordance (W) where 0 is no agreement and 1 is perfect agreement will be used to evaluate agreement across all items and within categories identified after round 1.48 Wilcoxon rank-sum test will be used to evaluate stability of the responses between rounds 2 and 3 .45 Statistical significance will be set at p<0.05.

Data management

All data will be managed using REDCap electronic data capture tools,50 which is hosted at Parker University, Dallas, Texas, USA. REDCap is a secure, web-based application designed to support data capture for research studies. All personal information and data will be kept secure from any third party using a password-protected computer during the study. Only members of the study team will have access to the study data. On completion of the study, the data will be kept securely for 10 years at Parker University, Dallas, Texas, USA, before being securely destroyed in accordance with the institution’s guidelines.

Study executive committee

The executive committee is composed of international and multidisciplinary members with expertise in patient safety and SMT and MOB (table 3). This committee will lead and conduct this study. Tasks include questionnaire development; management of data collection and questionnaire completion; compilation and summarising results at each round; proposal of additional statements; and preparing reports of final results, such as summary of findings infographic and manuscripts for publication.

Table 3

Executive and steering committee members’ background and geographical location

Study steering committee

The steering committee is composed of international and multidisciplinary members with expertise in patient safety, methodology, and SMT and MOB (table 3). Members in this committee will aid in expert participant identification and either provide their opinions and expertise through (1) being a participant in the Delphi panel, or (2) providing feedback on questionnaire development, structure and clarity, reviewing study results at each round and approving additional statement inclusion and review study conduct (selected Delphi expert methodologists mentioned in Methods section). Feedback and changes suggested by the steering committee members must be approved by the executive committee before implementation. At the end of round 3, all steering committee members will aid in the interpretation of final results and dissemination of findings.

Patient and public involvement

The study was conceived from our experience working with clinicians and patients using SMT and MOB and their views were used to highlight the relevance of this research. Our steering committee will include a patient representative who will codesign the ‘Participant Information Sheets’, expression of interest emails/social media posts and developing the round 1 questionnaire. It is anticipated that our patient representative will also contribute to reviewing results at each round and support interpretation of findings. Our patient representative will be central to our dissemination strategy including patient cohorts. A summary of results will be disseminated to all professions through professional organisations newsletter, conferences and reports. Feedback from professional groups will be invited to inform future studies and to facilitate the ongoing collaboration of an international, multidisciplinary research working group to support advancement of knowledge in the field of adverse events. Patient and public involvement in the full study will be reported using the ‘Guidance for Reporting Involvement of Patients and the Public2-short form (GRIPP2-SF)’51 when disseminating the study results.

Discussion

This e-Delphi study will provide expert consensus on the definition of adverse events and their severity classification following SMT and MOB that could not be determined from the current literature. In this study, we will use the term ‘adverse event’ in accordance with previous studies in this area,24 25 but consider it an umbrella term representative of other related terms referring to undesirable outcomes of SMT and MOB, such as ‘harms’, ‘complications’, ‘side effects’, etc.

Conducting a Delphi study electronically allows the development of expert informed recommendations from a wide range of specialists, regardless of geographical location, and who can participate confidentially, which is considered a strength. Another noticeable strength of this study is the active participation and collaboration of several professions that routinely perform SMT and MOB when treating patients with musculoskeletal conditions (ie, chiropractic, naprapathy, physiotherapy and osteopathy). Inclusion of international and multidisciplinary experts will ensure that the unique views and opinions of each profession and expert group is taken into consideration, while creating a standardised definition of adverse events and severity classification. Critically establishing standardised definitions and severity classifications across professions will significantly advance the evidence concerning adverse events. Drawing on a single expert multi-professional framework will contribute to enhancing the consistency in recording adverse events and will, in time, improve our understanding of the adverse events following SMT and MOB. From this, strategies to prevent and mitigate such events may be developed, which can significantly increase the knowledge related to adverse events, promoting a fundamental advancement in patient safety and quality of care for all professions that use SMT and MOB.

Ethics and dissemination

This study was approved by the Canadian Memorial Chiropractic College Research Ethics Board (#2103B01) and deemed exempt by Parker University’s Institutional Review Board (A-00218). Freely given e-informed consent will be obtained from all participants prior to participation through REDCap. Participants will be informed of the withdrawal process and assured anonymity throughout the study and during dissemination. Results from this study will be disseminated through scientific, professional and educational reports, publications and presentations.

Ethics statements

Patient consent for publication

Acknowledgments

The authors would like to thank the clinical, methodological and patient experts who have agreed to be members of the study steering committee and are ensuring rigour and quality of this study. We specifically acknowledge the following members of the steering committee for their assistance with this protocol development: Christopher Burrell, Anita Gross, Steven Vogel and Silvano Mior.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Twitter @FunabashiMartha, @KAPohlman_DCPhD, @andreabergna, @HeneghanNicola

  • Contributors MF, KAP, LMG, AB and NRH are leading the protocol development, analyses and dissemination. Data analysis will be completed independently by MF and LMG with oversight by KAP, AB and NRH. SAS is a member of the steering committee overseeing protocol development and made significant contributions to this manuscript. All authors and steering committee members will be involved in interpretation of the findings and dissemination strategy. All authors have contributed to the design and development of the protocol and have contributed to the manuscript draft. All authors have read, provided feedback and approved the final manuscript.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.