Undetermined impact of patient decision support interventions on healthcare costs and savings: systematic review
BMJ 2014; 348 doi: https://doi.org/10.1136/bmj.g188 (Published 23 January 2014) Cite this as: BMJ 2014;348:g188
- Thom Walsh, postdoctoral fellow1,
- Paul James Barr, postdoctoral fellow1,
- Rachel Thompson, postdoctoral fellow1,
- Elissa Ozanne, associate professor2,
- Ciaran O’Neill, professor 3,
- Glyn Elwyn, professor12
- 1Dartmouth Center for Health Care Delivery Science, Dartmouth College, 37 Dewey Field Road, Hanover, NH 03755, USA
- 2Dartmouth Institute for Health Policy and Clinical Practice, Dartmouth College, 35 Centerra Parkway, Lebanon, NH 03766, USA
- 3School of Business and Economics, National University of Ireland, Galway, Ireland
- Correspondence to: G Elwyn glynelwyn{at}gmail.com
- Accepted 8 January 2014
Abstract
Objective To perform a systematic review of studies that assessed the potential of patient decision support interventions (decision aids) to generate savings.
Design Systematic review.
Data sources After registration with PROSPERO, we searched 12 databases, from inception to 15 March 2013, using relevant MeSH terms and text words. Included studies were assessed with Cochrane’s risk of bias method and Drummond’s quality checklist for economic studies. Per patient costs and projected savings associated with introducing patient decision support interventions were calculated, as well as absolute changes in treatment rates after implementation.
Eligibility criteria Studies were included if they contained quantitative economic data, including savings, spending, costs, cost effectiveness analysis, cost benefit analysis, or resource utilization. We excluded studies that lacked quantitative data on savings, costs, monetary value, and/or resource utilization.
Results After reviewing 1508 citations, we included seven studies with eight analyses. Of these seven studies, four analyses predicted system-wide savings, with two analyses from the same study. The predicted savings range from $8 (£5, €6) to $3068 (£1868, €2243) per patient. Larger savings accompanied reductions in treatment utilization rates. The impact on utilization rates was mixed. Authors used heterogeneous methods to allocate costs and calculate savings. Quality scores were low to moderate (median 4.5, range 0-8 out of 10), and risk of bias across the studies was moderate to high (3.5, range 3-6 out of 6), with studies predicting the most savings having the highest risk of bias. The range of issues identified in the studies included the relative absence of sensitivity analyses, the absence of incremental cost effectiveness ratios, and short time periods.
Conclusion Although there is evidence to show that patients choose more conservative approaches when they become better informed, there is insufficient evidence, as yet, to be confident that the implementation of patient decision support interventions leads to system-wide savings. Further work—with sensitivity analyses, longer time horizons, and more contexts—is required to avoid premature or unrealistic expectations that could jeopardize implementation and lead to the loss of already proved benefits.
Registration PROSPERO registration CRD42012003421.
Introduction
There has been increasing interest in implementing patient decision support interventions. They definitely help inform decisions, and patients tend to opt for more conservative treatment choices.1 Evidence from randomized trials shows that these interventions increase patients’ knowledge, produce more accurate expectations, and lead to treatment choices that are more congruent with patients’ informed preferences.1 There is, in short, an ethical imperative to support their use in practice.2 There have also been claims that they have the capacity to generate healthcare savings,3 4 but these are less well substantiated, although prominent in many commentaries.
This combination of known benefits and potential savings has led to prominence in healthcare policy: shared decision making and the use of decision support interventions for patients are cited as promising developments in the Affordable Care Act (ACA). In the United Kingdom, the Advancing Quality Alliance (AQuA) claimed that the use of such decision support interventions could lead to “potential savings to the NHS [National Health Service]. . .”5 In addition NHS England has taken responsibility for the implementation of shared decision making in NHS care since April 2013.6 One of their key messages for commissioners was that “given informed choice, many patients choose less radical treatment, which may result in savings.”6 In 2010, NHS Direct claimed that patient decision support interventions would save the NHS money by ensuring “more efficient use of resources.”7
Estimated savings from the implementation of patient decision support interventions have attracted considerable attention. In 2008, the Lewin Group in the United States estimated savings to Medicare of $9bn (£5.5bn, €6.6bn) if they were implemented for 11 common healthcare procedures.8 A report from the Agency for Healthcare Research and Quality (AHRQ) in 2013 claimed “significant reductions in surgery rates and overall health care costs.”9 A 2009 systematic review of the impact of patient decision support interventions examined 86 published randomized trials and summarized the evidence by saying that these interventions lead to patients choosing less “discretionary” surgery but that the effects on costs and resource use were inconclusive.1
The evidence that these tools act to inform and enable patients to determine the likelihood of benefit versus harm is clear and well proved.1 The same review is cautious about their impact on cost.1 We performed a detailed systematic review of a wide range of studies to assess the potential of patient decision support interventions to generate savings, given that premature or unrealistic expectations could jeopardize wider implementation and lead to the loss of the already proved benefits.
Methods
To be eligible for inclusion, we considered studies that evaluated interventions designed to “help people make specific and deliberative choices among options (including the status quo) by providing (at the minimum) information on the options and outcomes relevant to a person’s health status and implicit methods to clarify values.” We considered all primary peer reviewed studies, including randomized controlled trials and economic evaluations as well as experimental and quasi-experimental designs utilizing a comparison group. We excluded studies that lacked quantitative data on savings, costs, monetary value, and/or resource utilization.
We searched databases from their inception to 15 March 2013 using Medical Subject Headings (MeSH) and keywords in three domains: patient decision support intervention/decision aid; patient; and cost. Databases included Medline, CINAHL, Cochrane Central, Campbell Collaboration, Embase, Business Source Complete, EconLit, Centre for Reviews and Dissemination: NHS Economic Evaluations Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment (HTA), and Web of Science. We also checked bibliographies of included studies for relevant studies.
The electronic search strategy we used for Medline is provided in appendix table A. Strategies used for other databases are available on request. Titles and abstracts were screened by one researcher (TW), 10% were screened by a second (PJB), and disagreements were resolved by discussion. After piloting the process, two researchers (TW, PJB) used a standardized data extraction process.10
The Center for Reviews and Dissemination and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) recommend the use of checklists to appraise study quality.11 Three researchers (TW, PJB, CO’N) assessed the quality of economic evaluations in the included studies using Drummond’s 10 item checklist; items were recorded as being present or absent (score=1 or 0).10 12 Two researchers (TW and PJB) assessed risk of bias using Cochrane’s six item checklist; items were recorded as low risk (score=0), indeterminate or high risk (score=1).13 Disagreements were resolved by discussion.
For each study, we examined the savings or additional spending that followed implementation of patient decision support interventions, the costs associated with delivering such interventions, and rates of treatment utilization in both the control and intervention groups. Because savings are purported to be associated with changes in treatment utilization, we calculated absolute differences in utilization after the implementation of decision support interventions and projected a potential impact on utilization rates per 100 patients exposed. Currency data were converted to US dollars on June 15 of the article’s publication year. Where studies had more than one decision support intervention group, we extracted data that enabled the most accurate estimates of the impact of delivering a decision support interventions alone.
Results
The initial search yielded 1508 records, with 1352 remaining after we removed duplicates. Inter-rater reliability during the screening process, assessed with Cohen’s κ, was substantial (>0.7), as defined by Landis and Koch.14 Nine papers proceeded to full text review. During full review, it became apparent that two of these nine papers were not studies of patient decision support interventions, leaving seven studies. In total, seven studies with eight analyses moved to appraisal and data extraction (figure⇓).15 16 17 18 19 20 21 22
Six studies were randomized trials in outpatient settings; three from the UK and one each from the Netherlands, Finland, and the US.16 17 18 19 20 21 One study, from the US, utilized a pre-post observational design,15 and one paper was a subanalysis of a previously reported randomized controlled trial22 (table 1)⇓. Sample sizes ranged from 112 to 60 185 patients. There were differences in the methods utilized to deliver decision support interventions: two studies mailed the interventions to patients and two studies mailed the interventions to patients then followed up with face-to-face interviews when the patient arrived at the clinic. Two studies used interactive videodiscs throughout to deliver decision support; the authors noted CD-ROMs and internet technology became available near the conclusion of the trials and these changes would have decreased resource requirements.17 18 The study by Wennberg and Marr21 and the subsequent subanalysis by Veroff and colleagues22 used health coaches to contact eligible individuals by phone to discuss their diagnoses, review care instructions, provide motivation for recommended behavioral changes, and offer decision support. The Wennberg and Marr study did a comparison between different levels of outreach consisting of three attempted telephone coaching interactions in one arm versus an enhanced care arm consisting of five attempted interactions—that is, there was no group that did not receive decision support.21
Characteristics of studies included in review of patient decision support interventions (DESI)
Four of the eight analyses reported significant savings after the introduction of patient decision support interventions; savings ranged from $8 to $3068 per patient.15 16 21 22 The remaining analyses did not find significant savings (table 2⇓). We describe these four studies below.
Economic analyses in review of patient decision support interventions (DESI)
Kennedy and colleagues reported significant potential savings for the UK healthcare system of $725 per patient after implementation of decision support intervention for women with menorrhagia.16 The authors calculate a total cost per patient of $21 to deliver the decision support intervention, which included the cost of the booklet, videotape, and 20 minutes of nursing time. They calculated the fixed intervention costs, however, by using a hypothetical scenario that involved projecting the use of the decision support intervention to all women in England and Wales aged 25-52 with uncomplicated menorrhagia.16 There was no significant difference in the rate of hysterectomies between the groups.
Arterburn and colleagues reported on a pre-post study that found per patient savings to the healthcare organization of roughly $2000 for individuals with knee osteoarthritis and $3000 for those with hip osteoarthritis.15 Use of patient decision support interventions was one of multiple interventions implemented, including monthly feedback of surgical rates to providers coupled with directives from leadership to decrease utilization rates. No costs were reported for the implementation of the interventions. There was an absolute difference of 12% in surgery utilization between patients with hip osteoarthritis in the control and intervention groups and an absolute difference of 7% for patients with knee osteoarthritis (that is, 12 fewer total hip replacements and seven fewer knee replacements for every 100 patients in the intervention group). Forty one percent of patients with hip osteoarthritis and 28% of patients with knee osteoarthritis in the intervention group actually received a decision support intervention. Paradoxically, treatment rates were 44% higher (for hip replacement) and 103% higher (for knee replacement) among the patients who actually received a decision support intervention.15
In 2010, Wennberg and Marr reported savings to the payer of healthcare services of $8 per member per month, accompanied a decrease in hospitalizations—namely, 13% in the usual care versus 12% in the enhanced care group.21 The reported cost of the intervention was $2 per individual per month; the method and variables used to calculate the costs, however, were not provided. The percentage of patients at risk for surgical intervention who were contacted by a health coach was 6.3% for the usual care group and 22.2% for the enhanced care group. Eleven percent in the control group and 41% in the enhanced group received a patient decision support intervention.
In 2013, Veroff and colleagues22 performed a subanalysis of the data first reported by Wennberg and Marr in 2010.21 The effect of the enhanced coaching intervention was larger in this subanalysis, with savings of $23 per member per month and 9.9% fewer elective surgeries. The costs associated with delivering the intervention were reported to be less than $5 per person per month. Of the patients with conditions that meant they were likely to have to make a decision about elective surgery, 7.5% in the usual care group and 22.8% in the enhanced care group were ultimately contacted by phone. Ten percent of people in the usual care group and 32% in the decision support intervention group received videos to assist them in shared decision making.22
This subanalysis made the same comparison between usual care, consisting of three attempted telephone calls versus enhanced support consisting of five calls. Both analyses were based on 174 120 individuals. The number of patients facing decisions about elective surgery reported by Wennberg and Marr in 2010 was 18 000 versus 60 000 reported by Veroff in 2013. In the subanalysis, Veroff and colleagues used a different and broader categorization of preference—sensitive conditions (D Veroff, 2013, personal communication). Only patients facing surgical decisions were eligible for the Wennberg and Marr study.
Overall, we found a high degree of heterogeneity in the methods used to evaluate costs and savings. In general, the quality of the economic analyses in the studies was low to moderate: values ranged from 0 to 7 with a median of 5 (appendix table C). Among the four analyses with significant savings, quality scores ranged from 0 to 7 out of 10.15 16 21 22 The trial of van Peperstraten and colleagues had a score of 7 but did not report significant savings.19
Across the analyses reporting costs, the estimated cost per patient of developing, disseminating, and implementing patient decision support interventions ranged from $2 to $400 per patient.15 16 17 18 19 20 21 22 Some estimates were based on the costs of printing materials, while others included estimates of resource use, staff time, and adjustments for altered workflow. The time horizon for data collection of costs and savings varied from three to 24 months. Authors performed sensitivity analyses in two studies.16 20 Incremental cost effectiveness ratios were not calculated.
Three of the four studies that reported significant savings also had the highest risk of bias. The analysis by Arterburn and colleagues had a risk of bias score of 6 out of 6,15 the analysis by Kennedy and colleagues had a score of 3,16 the Wennberg and Marr analysis had a score of 4,21 and the subanalysis by Veroff and colleagues had a score of 5.22 The risk was highest across studies for selection, detection, and reporting biases. Three of the four analyses that had the lowest scores for risk of bias found no significant savings17 18 20 (table 1⇑). Three of the eight analyses did not describe their randomization sequence and allocation concealment. Missing data can bias results. Six analyses provided reasons for missing data, and there was often insufficient detail to be able to rule out selective reporting. There was also insufficient disclosure of funding sources and potential conflicts of interest (appendix table B).
Discussion
Principal findings
Of seven studies and eight analyses that focused on the possible savings associated with the use of decision support interventions for patients, four found significant cost savings. These four analyses, however, were of low to moderate quality and had high risk of bias. The analyses that did not find savings had higher quality scores and less risk of bias. It is important to note that none of the studies found increased spending associated with the use of patient decision support interventions. When screening for these studies, we found over 500 commentaries that were positive about the potential impact of these tools on spending, but we could not identify many empirical studies that provide definitive evidence for these views. While it is reasonable to argue from the existing evidence that patients will likely choose less intervention and become risk averse when better informed,1 23 24 25 it is not yet clear whether this effect will lead to savings at a system level. In short, in the small number of available studies, the quality of economic assessment is moderate and the risk of bias is high.
Results in context
Several themes emerged across the included studies. There is no agreed method for cost allocation when patient decision support interventions are developed and used. Comparisons are difficult, and there is a need for detail in the description of resource utilization, workflow alterations, and costs. The included studies lacked detail to allow generalization. Some studies, however, were undertaken before the availability of the internet, which provides low cost methods of information dissemination.
Longer follow-up periods are required, given the age range of patients and the conditions under investigation. A decision to forgo surgical intervention for heavy menstruation could be revisited later, with a different outcome. A two year follow-up period does not capture this possibility. Neither does the one year follow-up by Wennberg and Marr and Veroff capture the overall effects of patient decision support interventions on decisions regarding joint replacement procedures.21 22 Data from the Spine Patient Outcomes Research Trial show that after first viewing decision support interventions, 24% of patients who then elected for non-operative care eventually had surgical intervention during the four year study period.26
The implementation of patient decision support interventions is often accompanied by the use of other interventions. Arterburn and colleagues report the effects of decision support interventions while a number of additional efforts were simultaneously used, including provider education regarding variation in treatment rates, feedback to providers about their treatment rate compared with others within Group Health, and legislative efforts in Washington State to promote the use of decision support interventions.15 The intervention in the Wennberg and Marr21 study consisted of telephone contact by coaches to educate patients about their diagnosis, encourage healthier behaviors, and supply them with decision support interventions. Because of concurrent interventions like these, it is not clear whether the decision support interventions alone or the cluster of interventions were responsible for the effect.
One of the studies reported showed increased spending associated with use of patient decision support interventions, the others did not. Savings would depend on delivering decision support interventions to eligible patients, and this is known to be difficult.27 Most authors do not report the proportion of patients given decision support interventions. Arterburn and colleagues report that 41% of patients with hip osteoarthritis and 28% of patients with knee osteoarthritis in the intervention group received a decision support interventions.15 Paradoxically, treatment rates were 44% higher (for hip replacement) and 103% higher (for knee replacement) among the patients who actually received a decision support intervention, raising the possibility of increased rather than reduced spending had the distribution of decision support interventions been more successful. Other studies did not report this data.
Strengths and weakness of our study
We have attempted to avoid the limited relevance of reviews that include only randomized trials by including studies that have used other designs, but in doing so, the heterogeneity of comparisons increased. Strengths of this review include the prospective registration with PROSPERO; inclusive search terms; a well developed, tested, and reproducible search strategy; and adherence to review guidelines (PRISMA).
Our results add to the findings of the most recent Cochrane Review of randomized trials of decision support interventions for patients. Costs and savings were secondary outcomes assessed in four of the 86 studies reviewed by Stacey and colleagues,1 in which they stated that the evidence was inconclusive. Our systematic review captured those four trials plus three additional studies and one additional subanalysis published since 2009. The inclusion of non-randomized designs allowed us to capture analyses that are frequently cited by policy documents in the US. Furthermore, we assessed the quality of the economic analyses and the risk of bias for each analysis using recognized criteria.10 13
We acknowledge that the absence of evidence for savings does not mean we have evidence of an absence of savings, nor do our findings argue against the usefulness of these tools – we believe that there is a strong ethical imperative to share decisions with patients whenever possible.2 Better economic analyses are needed that detail cost allocation methods and use longer time horizons.10 Dynamic economic models, together with sensitivity analyses around key assumptions, might have promise while also allowing non-healthcare costs to be factored, like absenteeism, which are likely to be more prominent considerations for patients than providers. More comprehensive models might reduce the risk of inferring societal savings based on findings from a partial economic assessment in isolated local research trials.
Conclusion
We conclude that the current evidence does not allow us to make definitive statements about whether, when, and why patient decision support interventions could lead to savings. We caution against making claims of significant savings associated with future use, such as those made by the Lewin Group,8 AHRQ,9 and NHS bodies.5 6 7 Promise of significant savings risks failure to meet expectations and can jeopardize implementation efforts. There is undisputed added value in ensuring that patients are better informed by use of tools such as patient decision support interventions, and there is a tendency for patients to choose more conservative treatments, but so far there is insufficient evidence to be confident that the implementation of these tools will lead to system-wide savings.
What is already known on this topic
-
The use of patient decision support interventions as a means to generate healthcare savings has been widely advocated, but the extent and quality of evidence is unclear
What this study adds
-
A few studies provide evidence of savings but, overall, the risk of bias is high and economic assessments are of moderate quality and over short time periods.
Notes
Cite this as: BMJ 2014;348:g188
Footnotes
-
We thank Anne Winter and Albert G Mulley for their comments and advice and Tom Mead, biomedical librarian, for his assistance with our search.
-
Contributors: GE initiated the study and is guarantor. All authors conducted the search, data extraction, analysis, synthesis of the results, and drafting of the article.
-
Funding: This study was funded by the Dartmouth Center for Health Care Delivery Science. CO’N was supported by an HRB Research Leaders Award 2013 (RL/2013/16).
-
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
-
Ethical approval: Not required.
-
Declaration of transparency: The corresponding author affirms that this manuscript is an honest, accurate, and transparent account of the study being reported: no important aspects of the study have been omitted.
-
Data sharing: No additional data available.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/.