Objective To determine the cost-effectiveness of arthroscopic surgery in addition to non-operative treatments compared with non-operative treatments alone in patients with knee osteoarthritis (OA).
Design, setting and participants We conducted an economic evaluation alongside a single-centre, randomised trial among patients with symptomatic, radiographic knee OA (KL grade ≥2).
Interventions Patients received arthroscopic debridement and partial resection of degenerative knee tissues in addition to optimised non-operative therapy, or optimised non-operative therapy only.
Main outcome measures Direct and indirect costs were collected prospectively over the 2-year study period. The effectiveness outcomes were the Western Ontario McMaster Osteoarthritis Index (WOMAC) and quality-adjusted life years (QALYs). Cost-effectiveness was estimated using the net benefit regression framework considering a range of willingness-to-pay values from the Canadian public payer and societal perspectives. We calculated incremental cost-effectiveness ratios and conducted sensitivity analyses using the extremes of the 95% CIs surrounding mean differences in effect between groups.
Results 168 patients were included. Patients allocated to arthroscopy received partial resection and debridement of degenerative meniscal tears (81%) and/or articular cartilage (97%). There were no significant differences between groups in use of non-operative treatments. The incremental net benefit was negative for all willingness-to-pay values. Uncertainty estimates suggest that even if willing to pay $400 000 to achieve a clinically important improvement in WOMAC score, or ≥$50 000 for an additional QALY, there is <20% probability that the addition of arthroscopy is cost-effective compared with non-operative therapies only. Our sensitivity analysis suggests that even when assuming the largest treatment effect, the addition of arthroscopic surgery is not economically attractive compared with non-operative treatments only.
Conclusions Arthroscopic debridement of degenerative articular cartilage and resection of degenerative meniscal tears in addition to non-operative treatments for knee OA is not an economically attractive treatment option compared with non-operative treatment only, regardless of willingness-to-pay value.
Trial registration number NCT00158431.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Strengths and limitations of this study
This randomised trial-based economic evaluation prospectively collected clinical effectiveness and cost measures, including indirect patient-reported costs, and directly elicited utility scores from patients over a 2-year follow-up with minimal loss to follow-up or crossovers.
Our estimation of cost-effectiveness over a range of willingness-to-pay values, investigation of patient subgroups, and analysis of uncertainty suggests that arthroscopy is not cost-effective compared with non-operative care, as the additional costs of surgery are not offset by decreases in other direct or indirect costs associated with knee OA.
These results add important economic data to the existing clinical evidence refuting the value of arthroscopic debridement and resection of degenerative knee tissues.
The present results do not describe the cost-effectiveness of knee arthroscopy beyond 2 years of surgery; however, previous research consistently shows that any small additional benefits observed with arthroscopic surgery for degenerative knee conditions diminish by 1 year, suggesting it is unlikely for arthroscopy to become cost-effective as time progresses.
As the present study was designed to evaluate the cost-effectiveness of arthroscopy for patients with knee OA, conclusions about the cost-effectiveness of one non-operative treatment compared with another (including sham), or among patients without radiographic signs of OA should not be drawn from the present data.
Osteoarthritis (OA) of the knee is a leading cause of disability and healthcare use globally, and the substantial economic burden is expected to grow.1 ,2 Knee OA is a progressive condition that affects the whole joint, including degenerative changes to the menisci, bone and hyaline articular cartilage.3 ,4 Clinical practice guidelines for managing knee OA consistently recommend non-operative therapies as first-line treatments,5–9 yet recommendations are less clear for the additional role of arthroscopic surgical interventions such as trimming meniscal tears to a stable rim (ie, partial resection), smoothing articular surfaces (ie, debridement) and removing loose bodies and/or osteophytes; procedures that are still widely used to treat these degenerative joint changes.
We previously conducted a randomised controlled trial evaluating the effectiveness of arthroscopic surgery in addition to optimised physical and medical therapy among patients with symptomatic, radiographic knee OA over a 2-year period.10 Results showed that arthroscopy provided no additional benefit beyond 3 months from surgery. Similarly, additional randomised trials involving different intervention strategies and increasingly restrictive eligibility criteria have also evaluated arthroscopic surgery for degenerative changes in the knee. These trials include arthroscopy compared with sham surgery in patients with moderate-to-severe radiographic OA,11 arthroscopic partial meniscectomy compared with physical therapy and exercise in patients with mild-to-moderate radiographic OA,12 ,13 and arthroscopic partial meniscectomy compared with non-operative management14 ,15 or to sham surgery16 in patients with degenerative meniscal tears and no radiographic evidence of OA. Meta-analyses of the existing evidence conclude that the additional benefit observed after arthroscopy compared with non-operative interventions is limited in time and absent at 1–2 years after surgery.17 ,18
Despite this evidence, arthroscopic knee procedures are still commonly performed. While administrative data suggest rates of arthroscopy for knee OA are declining, the number of procedures performed annually remains high and the rate of arthroscopies to treat meniscal tears, a common feature of knee OA,3 has remained the same or increased.19–26 Accordingly, the role of arthroscopic surgery for treating degenerative knee conditions remains highly debated.27–29
Although studies demonstrating a lack of clinical effectiveness may suggest an economic evaluation is unnecessary, many authors strongly caution against abandoning the procedure, stating the improvements observed after surgery despite being similar to non-operative treatments or to sham treatments are clinically important and considered cost-effective nonetheless.27 ,28 ,30–32 Therefore, it is clear that evidence regarding the cost-effectiveness of knee arthroscopy would be valuable and analysis of the existing trial-based economic data is warranted. The purpose of the present study was to determine the cost-effectiveness of arthroscopic surgery in addition to non-operative treatments compared with non-operative treatments alone in patients with knee OA.
Randomised controlled trial
The present data were collected as part of our previously reported single-centre, randomised controlled trial.10 Patients with symptomatic, radiographic knee OA were randomly assigned to knee arthroscopy in addition to optimised physical and medical therapy, or to optimised physical and medical therapy only. Patients were evaluated at baseline and 3, 6, 12, 18 and 24 months after the initiation of treatment. The protocol was approved by our institution's research ethics board, and all participants gave written informed consent.
Optimised physical and medical therapy included a 1 h physical therapy session once a week for 12 consecutive weeks, an individualised home exercise programme, and education from the local Arthritis Society.33 Patients reviewed their medical treatment plans with their orthopaedic surgeon, optimised according to an evidence-based treatment algorithm consistent with published guidelines.34
Patients in the surgery group received arthroscopy within 6 weeks of randomisation. The specific surgical procedures have been previously described.10 Patients followed the same optimised physical and medical therapy programme as those in the non-operative group, beginning within 7 days following surgery.
We conducted our cost-effectiveness analyses using two separate patient-reported outcomes as our measure of effectiveness. First, we used the Western Ontario McMaster Osteoarthritis Index (WOMAC) total score at the 2-year follow-up (the primary outcome from the randomised trial). Total scores can range from 0 to 2400, with higher scores indicating increased pain and stiffness, and decreased physical function.35–37 We rescaled the scores so that a higher number indicated a better outcome. Published data suggested similar patients typically have a total WOMAC score of 1000 points.38 We considered a 20% improvement from this score (about 200 points) as clinically important.10
Our second effectiveness measure was quality-adjusted life years (QALYs).39 ,40 We calculated QALYs using the Standard Gamble technique.41 The Standard Gamble is a health utility measure, with scores ranging from 0.0 (death) to 1.0 (perfect health). QALY is calculated as the product of the utility score and the duration of the corresponding health state. We report QALY over the 2-year study time period.
We used the average procedure cost from the Ontario Case Costing Initiative42 to obtain the direct costs of each procedure including equipment, operating room costs, and laboratory or other medical tests during the procedure. We used the current surgeon billing fee for each procedure listed in the Ontario Schedule of Benefits.43
We recorded the number of physical therapy sessions attended for each patient. We used the rate per session provided by a local physical therapy clinic. We also recorded any medication use, including both over-the-counter and prescription pain or anti-inflammatory drugs, hyaluronic acid injections or other medical treatment for knee OA. Unit costs for drugs were obtained from the Ontario Drug Benefit Formulary.44 Patients reported the amount paid for any aids purchased for the study knee, such as orthotics, crutches or braces.
Other healthcare costs
At each of the 3, 6, 12, 18 and 24 months of follow-up visits, we recorded healthcare resource use associated with the study knee including inpatient hospitalisations, physical therapy, medication use (prescription and over-the-counter), assistive devices, employment time lost, and homemaking or volunteer time lost.
We estimated the total cost for each patient over the entire study period. All costs are presented in 2014 Canadian dollars.
We conducted a cost-effectiveness analysis from both the Canadian healthcare payer and societal perspectives. The payer perspective includes direct costs covered by the publicly funded system, including hospital, procedure-related, clinician and provider time, tests, procedures or surgeries, and medications for patients on disability or aged 65 years and older. In addition to the healthcare system costs, the societal perspective also includes any out-of-pocket costs to the patient (such as physical therapy, medication or assistive devices not covered by the provincial insurance plan), and indirect costs such as time involved with appointments, and time off employment, homemaking or caregiving activities as a result of the intervention.
Net benefit regression
The net benefit regression (NBR) framework45 provides an estimate of cost-effectiveness by considering the incremental cost and effect on an intervention in addition to the maximum acceptable willingness-to-pay (WTP) per unit of health gain; in this case, WTP refers to the amount one is willing to spend for an additional improvement on the WOMAC score, or for an additional QALY gained. An intervention is cost-effective if the incremental net benefit (INB) is greater than zero.
We conducted two separate NBR models, the first using the WOMAC total score, and the second using QALYs as the measure of effectiveness. The WTP value was varied between $0 and $100 000. Although we anticipated that the randomised allocation of participants would result in an equal distribution of baseline characteristics between groups, the NBR method provides a means to adjust for any potentially confounding factors and therefore allows greater statistical efficiency and provides a more precise estimate of the INB.
We included the following covariates in our models: baseline WOMAC score, baseline utility (for the QALY model), radiographic severity of knee OA (Kellgren-Lawrence grade 2, or greater than 2), age and body mass index. Significant covariates from our regression model were also included as interaction terms.
Statistical uncertainty was characterised using 95% CIs, and visually displayed using the cost-effectiveness plane, and cost-effectiveness acceptability curves (CEAC).46 We used non-parametric bootstrapping to draw 1000 incremental cost-effectiveness ratio (ICER) estimates from the original sample, and plotted them on the cost-effectiveness plane. The CEAC demonstrates the probability of cost-effectiveness at various WTP values.
We repeated the two subgroup analyses performed in the original trial, among the two groups of patients that were hypothesised to derive greater benefit from surgery: (1) patients with less severe radiographic disease (KL grade 2), and (2) patients reporting mechanical symptoms of catching and/or locking.10
ICER, incremental cost-utility ratio and sensitivity analysis
We also considered the value of arthroscopy by calculating the ICERs. Further, we conducted a sensitivity analysis by using either extreme of our CI surrounding the mean difference in WOMAC scores and QALY to estimate ICER and incremental cost-utility ratio (ICUR) values that assumed the highest possible treatment effect observed in our sample, favouring either added arthroscopy or non-operative treatments only.
A total of 168 patients were included (88 arthroscopy group and 80 non-operative group; figure 1). Baseline characteristics of the study participants were similar between groups (table 1). Patients allocated to the arthroscopy group received debridement of degenerative articular cartilage (97%), partial resection of degenerative meniscal tears (81%), excision of osteophytes (9%) and removal of loose bodies (14%). Non-operative treatment included medical therapy (non-steroidal anti-inflammatory drugs, acetaminophen, chondroitin sulfate or glucosamine, hyaluronic acid injection), physical therapy and bracing. There were no significant differences in non-operative treatment between groups (table 1).
There was a statistically significant difference between groups in mean costs from both the healthcare payer and societal perspectives (table 2). The mean difference between groups in WOMAC scores at 24 months was small (favouring the surgery group) and not statistically significant (mean difference=15.69 (−198.58 to 166.98), p=0.87). The mean difference between groups in QALY scores was also small (favouring the non-operative treatments only group) and not significantly different (mean difference=−0.02, 95% CI −0.09 to 0.13, p=0.72; table 2).
Net benefit regression
Model 1: WOMAC
The INB was negative for all WTP values, from both the healthcare payer and societal perspectives, indicating that the addition arthroscopic surgery is not cost-effective compared with non-operative treatments only (table 3).
Model 2: QALY
When using QALYs as the outcome, the INB estimate was also negative at all WTP values, further suggesting that the addition arthroscopic surgery is not cost-effective compared with non-operative treatments only (table 3).
Arthroscopy was also not cost-effective in terms of both WOMAC and QALY in the subgroup of patients with less severe disease (Kellgren-Lawrence grade 2) and patients reporting mechanical symptoms of catching and/or locking from both cost perspectives at all values of WTP.
ICER, ICUR and sensitivity analysis
The ICER was $140.94 (societal), or $120.83 (payer) per one-point improvement on the 2400 point WOMAC total score, translating to $28 188 (societal) and $24 166 (payer) for a clinically important improvement (200 points). The ICUR was equal to −$110 569 (societal) or −$94 792.50 (payer) per QALY gained, where the negative value indicates paying more for a worse outcome (ie, the added surgery is dominated by non-operative treatments only).
The results of our sensitivity analysis using either extreme of our CIs suggested that, from the societal perspective, to achieve a clinically important improvement of 200 WOMAC points, either: (1) assuming the added surgery results in an improvement over non-operative treatments only (167 WOMAC points), the cost is an additional $2648, or (2) assuming non-operative treatments result in an improvement over added surgery (−199 WOMAC points), the ICER is −$2230, resulting in paying more to achieve a worse outcome. Additionally, for QALY, the sensitivity analysis suggests either: (1) an ICUR of $17 010, where surgery costs an additional $16 961 per QALY gained, or (2) an ICUR of −$24 571 where surgery costs more and is less effective.
The 95% CIs around our estimate of INB get wider as the WTP value increases, suggesting that the more one is willing to pay, the greater the uncertainty surrounding the cost-effectiveness.
The uncertainty is also visually displayed on the cost-effectiveness plane (figure 2). Although the majority of the bootstrapped estimates suggest a greater improvement in WOMAC score for the added surgery group, very few represent a clinically important improvement (200 points; figure 2A); whereas for QALY, about 60% of the ICUR estimates favour a greater improvement for the non-operative treatments only group (figure 2B). In both cases, there is no uncertainty surrounding the cost (surgery always costs more); therefore, decision makers face the risk of paying more for a treatment with considerable uncertainty that it will result in improved outcome.
The probability of cost-effectiveness given this uncertainty is visually displayed in the CEAC (figure 3). This suggests that even if decision makers are willing to pay $2000 or more for a one-point improvement on the WOMAC total score (figure 3A; translating into $400 000 to achieve a clinically important difference), or $50 000 or more for an additional QALY (figure 3B), there is less than a 20% probability that added surgery is cost-effective compared with non-operative care only.
The results of the present analysis suggest that arthroscopic debridement and partial resection of degenerative knee tissues performed in addition to optimised physical and medical therapy for patients with knee OA is not cost-effective compared with optimised physical and medical therapy only, from both a healthcare payer and societal perspective. This conclusion is driven by the finding that although there is statistical uncertainty about which treatment is more effective (ie, in our sample a small improvement could favour either treatment), the additional cost of surgery is not offset by decreases in other healthcare costs, either direct or indirect, associated with knee OA. Specifically, there were no differences between groups in the use of non-operative treatments, and a greater proportion of patients in the surgery group reported taking time off work at the 3-month follow-up.
Strengths of the present economic evaluation include data collected from a prospective randomised trial with frequent assessments over a 2-year follow-up and minimal loss to follow-up or crossovers.10 This enabled a rigorous trial-based economic evaluation with prospective collection of effectiveness and cost measures (including indirect patient-reported costs), and the direct measurement of utility scores from our study patients to calculate QALYs. Further, using the NBR framework allowed us to include potential interaction terms, explore patient subgroups and evaluate the data for influential outliers to provide us with a clearer understanding of the cost-effectiveness than would have been possible by only looking at the incremental ratios.45
Limitations of this trial-based economic analysis may include the inability to determine long-term cost-effectiveness beyond 2 years of follow-up. However, previous research consistently shows that any small additional benefits observed with arthroscopic surgery for degenerative knee conditions diminish by 1 year;10–14 ,16 therefore, we suggest it is unlikely for arthroscopy to become cost-effective as time progresses. Reports of increased risk for OA47–49 and earlier joint replacement50 after meniscectomy should also be considered when evaluating long-term cost-effectiveness. As the present study was designed to evaluate the cost-effectiveness of arthroscopy in addition to non-operative care for patients with radiographic knee OA (KL grade ≥2), results should be generalised accordingly. Conclusions about the clinical and cost-effectiveness of the various non-operative treatments, and the cost-effectiveness of arthroscopy for patients without radiographic knee OA, should not be drawn from the present data. Additionally, the present sample does not include persons suspected by the surgeon based on physical examination and history to have a traumatic bucket handle meniscal tear (ie, acute knee injury, swelling, acute loss of knee extension). Unlike degenerative meniscal tears, bucket handle tears are not common in knee OA and form a different patient population. Importantly, the present results are generalisable to the many patients with degenerative knees receiving knee arthroscopy.24–26 Notably, operative data from our trial suggest that, as anticipated, more than 80% of patients had degenerative meniscal tears that were partially resected.
Some suggest that arthroscopic debridement and resection is beneficial for appropriately selected patients with knee OA, such as those with minimal radiographic changes and symptoms consistent with a torn meniscus. Approximately, half of our sample would be classified by accepted criteria as having mild OA (Kellgren-Lawrence grade 2). Approximately, half of our sample reported symptoms of catching and/or locking. We reported in our original trial no added benefit of surgery among the subgroup of patients with mild OA, or among the subgroup of patients with symptoms of catching and/or locking. Similarly, the present results suggest that arthroscopy is also not cost-effective for those subgroups of patients compared with non-operative management. The lack of clinical effectiveness in those subgroups is consistent with meta-analysis of the randomised trials evaluating arthroscopic partial meniscectomy in the degenerative knee,17 including a sham controlled trial in middle-aged patients with degenerative meniscal tears in the absence of radiographic knee OA.18
To our knowledge, this is the first trial-based economic evaluation to evaluate the cost-effectiveness of knee arthroscopy in addition to non-operative treatment strategies. Lubowitz and Appleby32 reported the total procedure costs for a range of arthroscopic procedures and the change in utility score before and after surgery; however, they did not compare arthroscopic surgery to other interventions. Alternatively, Losina et al30 built a probabilistic state-transition model to evaluate the cost-effectiveness of arthroscopic surgery over a 10-year life span for patients with knee OA. The model compared immediate arthroscopic surgery, physical therapy and delayed arthroscopic surgery (patients electing to undergo surgery after 3 months of physical therapy). The clinical and economic input parameters were derived from a previous randomised trial12 (including crossovers from physical therapy to surgery) using patient-reported outcomes up to 6 months following treatment, and from large cohort studies in the USA to determine rates of progression of OA. The authors conclude that physical therapy alone is unlikely to be cost-effective and suggest further research is required to determine the cost-effectiveness of immediate arthroscopy or arthroscopy following a course of physical therapy. Although differences in study design, treatment protocols and settings may contribute to their findings, that study contrasts the present results in which there were no differences in patient-reported outcomes, healthcare resource use following treatment or productivity losses between groups over a 2-year follow-up.
Several factors likely contribute to the continued frequent use of arthroscopic debridement and resection of degenerative knee tissues for knee OA.26 The unnecessary use of MRI to diagnose degenerative meniscal tears, early referral to orthopaedic surgeons, vested interests and the evident placebo effect of surgery all likely contribute to high patient and clinician expectations and demand for the procedure. The variable increases in rates of arthroscopy among different regions and previously observed shifts in practice after publication of research findings suggest that knowledge translation activities can affect knee arthroscopy usage.19–26 We suggest that such activities should include cost-effectiveness data in addition to clinical effectiveness data and target patients, all clinicians involved in their care, as well as policymakers.
The preponderance of evidence suggests that arthroscopic debridement in the degenerative knee is not superior to sham surgery, provides no sustained clinical benefit over non-operative treatments and is associated with potential harms.17 In addition to the lack of clinical effectiveness, the present results suggest that arthroscopic debridement of degenerative articular cartilage and resection of degenerative meniscal tears in addition to non-operative treatment for knee OA is not an economically attractive treatment option compared with non-operative treatment only.
Contributors All authors had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. TBB, JRG, BGF, RL, KW and PF were involved in study concept and design. JDM, WI, JSH and TBB were involved in analysis and interpretation of data. JDM, TBB, WI and JSH drafted the manuscript. JDM, TBB, WI, JSH, JRG, BGF, RL, KW and PF were involved in revision of manuscript.
Funding This research was undertaken, in part, thanks to funding from the Canadian Institutes of Health Research, The Ontario Ministry of Research and Innovation, and The Canada Research Chairs Programme.
Competing interests All authors have completed the ICMJE uniform disclosure form at http://www.icmje.org/coi_disclosure.pdf and declare: support from The Canadian Institutes of Health Research for the submitted work; TBB reports grants from Canada Research Chairs Program, during the conduct of the study; grants from The Canadian Institutes of Health Research, grants from The Arthritis Society, grants from Arthrex Inc, outside the submitted work; JRG reports grants from The Canadian Institutes of Health Research, grants from The Arthritis Society, grants from Arthrex Inc, outside the submitted work; KW reports grants from Arthrex Inc, outside the submitted work; RL reports personal fees from Arthrosurface, personal fees from Smith & Nephew, personal fees from DePuy, grants from Smith & Nephew, grants from DePuy, outside the submitted work; BGF reports grants and personal fees from AbbVie, personal fees from Actogenix, personal fees from Akros, personal fees from Albireo, grants and personal fees from Amgen, grants and personal fees from Astra Zeneca, personal fees from Avaxia Biologics, personal fees from Avir Pharma, personal fees from Baxter Healthcare Corp, personal fees from Biogen Idec, personal fees from Boehringer-Ingelheim, grants and personal fees from Bristol-Meyers Squibb, personal fees from Calypso Biotech, personal fees from Celgene, personal fees from Elan/Biogen, personal fees from EnGene, personal fees from Ferring Pharma, grants and personal fees from Roch/Genetech, personal fees from GiCare Pharma, personal fees from Gilead, personal fees from Given Imaging, personal fees from GSK, personal fees from Ironwood Pharma, grants and personal fees from JnJ/Janssen, personal fees from Kyowa Kakko Kirin Co Lt, personal fees from Lexicon, personal fees from Lilly, personal fees from Lycera Biotech, personal fees from Merck, from Mesoblast Pharma, grants and personal fees from Millenium, personal fees from Nektar, personal fees from Nestles, personal fees from Novartis, personal fees from NovoNordisk, grants and personal fees from Pfizer, personal fees from Prometheus Therapeutics & Diagnostics, personal fees from Protagonist, grants and personal fees from Receptos, personal fees from Salix, personal fees from Shire, personal fees from Sigmoid Pharma, personal fees from Synergy Pharma Inc, personal fees from Takeda, personal fees from Teva Pharma, personal fees from TiGenix, grants and personal fees from Tillotts, grants and personal fees from UCB, personal fees from Vertex Pharma, personal fees from VHsquared Ltd, personal fees from Warner-Chilcott, personal fees from Wyeth, personal fees from Zealand, personal fees from Zyngenia, outside the submitted work.
Ethics approval The study was approved by the Health Sciences Research Ethics Board at The University of Western Ontario.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Potential for data sharing can be discussed with study investigators.