Article Text
PDF
Abstract
Introduction Orthopaedic injuries affect almost 90% of trauma patients. A previous scoping review and expert consultation survey identified 15 potential low-value intra-hospital practices in the adult orthopaedic trauma population. Limiting the frequency of such practices could reduce adverse events, improve clinical outcomes and free up resources. The aim of this study is to synthesise the evidence on intra-hospital practices for orthopaedic injuries, previously identified as potentially of low value.
Methods and analysis We will search Medline, Excerpta Medica Database (EMBASE), the Cochrane Central Register of Controlled Trials and Epistemonikos to identify systematic reviews, randomised controlled trials (RCTs), quasi-RCTs, cohort studies and case–control studies that evaluate selected practices according to a priori PICOS statements (Population–Intervention–Comparator–Outcome–Study design) . We will evaluate the methodological quality for systematic reviews using the Measurement Tool to Assess Systematic Reviews version 2 (AMSTAR-2). Risk of bias in original studies will be evaluated with the Cochrane revised tool for RCTs (RoB2) and with the risk of bias in non-randomised studies of interventions (ROBINS-I) tool. If for a given practice, more than two original studies on our primary outcome are identified, we will conduct meta-analysis using a random effects model and assess heterogeneity using the I2 index. We will assess credibility of evidence (I–IV) based on statistical significance, sample size, heterogeneity and bias as per published criteria.
Ethics and dissemination Ethics approval is not required as original data will not be collected. Knowledge users from three level I trauma centres are involved in the design and conduct of the study in accordance with an integrated knowledge translation approach. Findings related to the rapid review will be available in May 2020. They will be presented to key stakeholders to inform discussions and raise awareness on low-value injury care. In addition, results will be disseminated in a peer-reviewed journal, at national and international scientific meetings and to healthcare associations.
- orthopaedic injuries
- wound and injuries
- trauma
- low-value practices
- rapid review
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
Comprehensive review of evidence on low-value practices in orthopaedic trauma.
Results will be used to inform discussions and increase awareness of low-value injury care for injury admissions.
Adopts an integrated knowledge translation approach to ensure uptake of results by trauma stakeholders.
For some practices, we may identify no evidence or only low-level evidence.
Introduction
Orthopaedic injuries affect 89% of adult trauma patients.1 Such injuries are characterised by osseous, soft-tissue, neural or vascular damages to the extremities, pelvis or spine, greatly impacting the person’s physical functioning and quality of life, while being associated with a loss in productivity of nearly US$50 billion in the USA annually.2 Considering the complexity of orthopaedic injuries and the lengthy healing process associated with this type of trauma, referral to specialists such as orthopaedic surgeons as well as multiple radiological imaging and follow-up medical appointments are often recognised as standards of care. Orthopaedic injuries represent the most expensive non-fatal trauma3 with total direct and indirect costs of up to US$456 billion in the USA annually.4
Up to 30% of healthcare budgets are spent on potentially unnecessary care.5 Low-value practices are defined as ‘the common use of a particular intervention when the benefits don’t justify the potential harm or cost’6 and comprise unnecessary hospitalisations, transfers, consultations, diagnostic and therapeutic procedures.5–12 Best practice guidelines to optimise outcomes in adult patients with orthopaedic injuries have been published by recognised orthopaedic and trauma organisations (American Academy of Orthopaedic Surgeons,13 Orthopaedic Trauma Association,14 American College of Surgeons—Committee on Trauma15 and Eastern Association for the Surgery of Trauma16). The emphasis of these guidelines is on the adherence to processes of care (underuse). No evidence-based recommendations are available yet on low-value practices (overuse) in the context of orthopaedic injuries.17 Low-value injury care in orthopaedic injuries can lead to inefficient use of specialised resources. More importantly, it can expose patients to unnecessary radiation and to adverse events such as postoperative infection and impaired daily functioning.11
A recent scoping review and expert consultation survey17 identified 10 potentially low-value intra-hospital practices in the adult orthopaedic trauma population (table 1). A further 23 practices were classified in the grey zone, that is, less than 70% of experts considered them to be clearly or potentially of low value. After a second round of consultation in which experts were asked which of the 23 grey zone practices they strongly felt should go on to the evidence synthesis phase, five additional practices were retained (table 1). These practices targeted initial and post-treatment diagnostic interventions (ie, imaging and blood tests), initial and follow-up consultation with an orthopaedic surgeon and immobilisation. They represent potential indicators of overuse and could inform the development of de-implementation interventions in the treatment of orthopaedic injuries. However, before recommendations can be made, we need to appraise the available evidence for these practices. The aim of this study is, therefore, to synthesise the evidence on intra-hospital practices for orthopaedic injuries, previously identified as potentially low value, based on predetermined Population–Intervention– Comparator–Outcome–Study design (PICOS) questions (table 1).
Population–Intervention–Comparator–Outcome–Study design for the selected low-value practices in orthopaedic injuries
Methods and analysis
We will use a rapid review approach18 to synthesise a large body of evidence in ‘a timely and credible manner’. Rapid reviews are an assessment of what is known about a practice issue, making concessions to the traditional breadth and depth of the systematic review process.19 Hence, to produce timely, high-level evidence, we will limit study designs to the highest available level of evidence and restrict our search to published literature (table 2). All other aspects of the review will follow the Cochrane Handbook for Systematic Reviews of Interventions.20 We have reported this protocol using the applicable Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) checklist (online supplementary digital file 1).21
Supplemental material
Search strategy for orthosis in A0–A3 thoracolumbar burst fracture
Eligibility criteria
Eligibility criteria specific to each practice were developed using the PICOS framework by the project steering committee and expert orthopaedic surgeons (table 1). To ensure the feasibility of reviewing a large body of evidence, we will ‘identify studies that will provide the most rigorous evidence to answer the question’ as per recommendations on rapid reviews.19 Thus, we will use staged study inclusion criteria using published levels of evidence based on the type of study (ie, systematic reviews, randomised controlled trials (RCTs) and then studies with other designs) and study quality (online supplementary digital file 2).22 No restriction on date and language will be applied.
Supplemental material
Outcomes
Primary and secondary outcomes were identified for each practice by the project steering committee and clinical experts (table 1). Primary outcomes will include missed injuries (eg, fracture or luxation/subluxation identified on follow-up X-ray or other imaging tests), fracture mal-union or non-union, change in clinical management (eg, surgery and follow-up with a specialist) and functional recovery measured with validated tools (eg, Roland Morris Disability Scale and Upper Extremity Functional Index).23–29 Secondary outcomes will include pain (eg, Numerical Pain Rating Scale and Brief Pain Inventory) and quality of life measured with validated tools (eg, Numerical Pain Rating Scale, Brief Pain Inventory, 36-item short-form health survey (SF-36) and EuroQol-5 dimension (EQ-5D)),30–34 complications (eg, neurological deficits and skin lesions), healthcare service utilisation (eg, reduction in the number of X-rays or other imaging tests, hospitalisations and specialist consultations) and return to work (table 1). Economic evaluations (cost effectiveness) are the subject of another review currently underway. In line with rapid review methodology, outcome definitions may be refined on consultation with the literature.19
Search strategy
On consultation with an information specialist, we will develop search strategies separately for each practice. We will search Medline, EMBASE, the Cochrane Central Register of Controlled Trials and Epistemonikos from their inception up to a maximum of 6 months prior to submission of the article for publication. We will also check reference lists of reviews and retrieved articles for additional studies, and we will perform citation searches on key articles. Since this rapid review aims to synthetise the evidence based on published studies, we would not search the grey literature. Medical subject headings (MeSH) and text word terms will be used and Boolean operators will be applied to combine them. If studies are written in other languages than those spoken by the research team (English, French, German and Arabic) and are judged as relevant based on the abstract, Canadian linguistic healthcare agencies will be consulted for translation (http://www.jhsb.ca/fr/acces-linguistique/banque-interpretariat). An example of a search strategy for a specific practice is presented in table 2.
Selection process
We will manage all citations with EndNote software (V.X8.2, Clarivate Analytics, 2014). We will identify and remove duplicates using electronic and manual screening. To ensure reliability when selecting studies for a given practice, all reviewers will assess a series of 100 titles in rounds until acceptable agreement has been achieved.20 Pair of reviewers (MB and LM, and CC and PAT) will then independently screen all identified records using titles, abstracts and full texts using Covidence software. Any disagreement will be resolved through discussion between reviewers and a senior author (JP) will be consulted if necessary. Included and excluded studies will be described in a PRISMA flow chart.35
Data extraction and management
Two pairs of experienced reviewers (MB and LM, and CC and PAT) will work independently to extract data using a standardised data extraction form piloted on five studies by each reviewer as recommended by the Cochrane Collaboration.20 Inconsistencies in data extraction will be resolved by discussion between the two reviewers, and, if consensus is not reached, with a senior author (JP). Extracted data will include information on study design, setting and year, characteristics of the study population (age and sex, injury mechanism, severity and type of injury, and associated injuries), intervention(s), comparator(s), outcome(s) and measures of effect. When information is available in figures only, we will abstract graphical data using computer-assisted software (Plot Digitizer).36 Furthermore, we will contact study authors with up to three email attempts when information is unclear or unavailable.
Quality assessment
Pairs of reviewers will independently critically appraise methodological quality for systematic reviews using the Measurement Tool to Assess Systematic Reviews version 2 (AMSTAR-2)37 and the risk of bias for original studies using the Cochrane revised tool for RCTs (RoB2)38 and the risk of bias in non-randomised studies of interventions (ROBINS-I)39 tool for observational studies. Risk of bias will be categorised as low, moderate, high and unclear.
Synthesis
For each practice, we will report the number of studies according to their design, sample sizes, methodological quality (systematic reviews) or risk of bias (original studies), and effect estimates for primary and secondary outcomes. We will use a tabular and graphical (forest plot) approach to facilitate knowledge transfer to stakeholders.
Statistical analyses
If, for a given practice, more than two original studies with the same outcome are identified, we will conduct meta-analysis using random effects models. We will use Review Manager40 to calculate pooled weighted mean differences (continuous data) or risk ratios (binary data) and 95% CIs. If the number of studies is sufficient, we will conduct sensitivity analyses restricted to studies at low risk of bias for primary outcomes. We will assess heterogeneity using the I2 index.
Credibility of evidence
For practices with published meta-analyses or original studies allowing meta-analyses, we will evaluate credibility of evidence using previously published criteria.41 42 These criteria class evidence from meta-analyses into five categories: convincing (class I), highly suggestive (class II), suggestive (class III), weak (class IV) and non-significant (NS), based on the statistical significance of pooled and original study estimates, sample size, heterogeneity and bias. For example, to be judged convincing, the evidence must exist from both observational studies and RCTs, and measures of association should be of same direction, statistically significant at p≤0.001 and free from bias. While to be judged NS, evidence from observational studies or RCTs is enough to conclude that a substantial effect is unlikely based on the magnitude and the significance level.41
Potential limitations
This rapid review has some limitations. Although we aim to select studies that use the most robust methodology to evaluate the effect of low-value practices, for some practices we may identify no evidence or only low-level evidence. Nonetheless, research gaps could be identified by documenting the type of study designs used and methodological quality/risk of bias. Given our rapid review design, we will not search the grey literature. However, we do not anticipate that this will lead us to miss any high-level evidence.
Potential impact
This rapid review is the first to evaluate the evidence on low-value care in orthopaedic injuries. Our evidence synthesis will be presented to key stakeholders to inform discussions and increase awareness on low-value care. Considering the high volume of patients who sustain orthopaedic injuries annually, the reduction of low-value practices in this population has the potential to free up an important quantity of resources and more importantly, to optimise outcomes in patients who need to receive specialised treatments. Healthcare services quality and efficiency could be greatly improved.
Ethics and dissemination
Ethics approval is not required as original data will not be collected. Findings related to the rapid review should be available in May 2020 (7 months from study onset in September 2019). They will be disseminated in a peer-reviewed journal, at national and international scientific meetings and to clinical and policy stakeholders (Choosing Wisely Canada, Trauma Association of Canada, Orthopaedic Trauma Association, American College of Surgeons—Committee on Trauma, Institut national d’excellence en santé et en services sociaux).
Patient and public involvement
No patient or public representatives will be involved in this study.
References
Footnotes
Twitter @BrubMlanie1, @Moore
Contributors MB contributed to the elaboration of keywords and the search strategy, drafted the manuscript and approved the final version of the manuscript. LM led the development of the protocol and drafted the manuscript with the first author. She acts as guarantor for the rapid review. SL contributed to the development of PICOS questions, revised the manuscript and approved the final version. IF contributed to the elaboration of keywords, the search strategy and the data extraction form, revised the manuscript and approved the final version. ML and JP contributed to the identification of low-value injury care, development of PICOS questions, critically revised the manuscript and approved the manuscript. JL contributed to the identification of low-value injury care, revised the manuscript and approved the final version. SP and GB contributed to the identification of low-value injury care, critically revised the manuscript and approved the final version. PAT and CC contributed to the data extraction form development, critically revised the manuscript and approved the manuscript.
Funding This research was supported by the Canadian Institutes of Health Research (Foundation grant, #353374).
Competing interests None declared.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.