Article Text
Abstract
Objectives To undertake an economic analysis assessing the cost-effectiveness of a single dose of oral dexamethasone compared with placebo for the relief of sore throat.
Design A UK-based, multicentre, two arm, individually randomised, double blind trial.
Setting and population Adults (≥18 years) with acute sore throat and painful swallowing judged to be infective in origin, recruited and randomised in primary care. Intervention: a single dose of 10 mg oral dexamethasone compared with placebo given at primary care visit.
Main outcome Incremental cost-effectiveness ratios (ICERs), cost per quality-adjusted symptom resolution using the EuroQol-five dimensions-five levels instrument, were estimated as part of a cost–utility analysis performed on an intention-to-treat cohort adopting a health payers perspective.
Results Differences in health-related quality of life (HRQoL) over 7 days from baseline and at 24 hours in the dexamethasone compared with the placebo group (2.9% and 2.5% higher, respectively) were observed. After controlling for the baseline HRQoL imbalances, the economic impact of the intervention was not statistically significant: the quality-adjusted life year difference was −0.00005 (95% CI −0.0002 to 0.00011) equivalent to a loss in HRQoL of a half hour in the dexamethasone group. The average cost per patient associated in the dexamethasone and placebo groups in the basecase analysis was £73 and £69, respectively. In the basecase probabilistic analysis, the mean ICER was −£6440 (95% CI −£132 151 to £126 335) and the median ICER was −£304 (IQR-£5816 to £3877); suggesting considerable uncertainty.
Conclusions and relevance The economic burden associated with sore throat is substantial and was estimated at £2.35 billion to the healthcare services payer based on reported resource use and 2015 UK unit costs. There is considerable uncertainty regarding the cost-effectiveness of a single dose of oral dexamethasone as a treatment strategy and therefore insufficient evidence to support its use in clinical practice.
Trial registration number ISRCTN17435450; Post-results.
- cost-utility analysis
- primary care
- sore throat
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The analysis undertaken provides the first detailed account of the cost of sore throat in the UK.
The study collected a wide range of demographic, clinical, quality of life and resource use data using a trial-specific daily patient diary which permitted an extensive exploration of uncertainty in scenario and subgroup analyses.
Both health services payer and societal perspectives were assessed in the economic evaluation.
In contrast to previous research highlighting no clinical differences across delayed prescription and no treatment strategies, this analysis suggests that clinical and non-clinical benefits of the delayed prescription in addition to the dexamethasone need to be explored further.
Reported resource use for healthcare services payer perspective analysis was cross-checked with a follow-up patient survey and medical record review and as such where no resource use was identified for each patient across the data sources, the assumption of zero resource use for that category is justifiable but potentially leading to some bias in cost estimates.
Introduction
An estimated £400 million annually is spent on consultations and lost productivity associated with sore throat alone in the UK.1 2 Almost 1 in 10 registered UK patients will see their general practitioner (GP) every year with sore throat.3 Ninety-one per cent of those diagnosed with tonsillitis will receive antibiotics, as will half of those recorded as ‘sore throat’ or ‘pharyngitis’.4 National Institute for Health and Care Excellence (NICE) and International guidance recognises the limited evidence for benefit of antibiotics in its advice to avoid prescriptions in the majority of patients5 6; however, prescribing rates remain disproportionately high even though patients attend mainly due to anxiety over symptoms.7 A key driver for patients to attend with a sore throat is the severity of their symptoms, so affective symptomatic treatment may help reduce patient reliance on antibiotic. Furthermore where antibiotics are used for streptococcal infections more rapid clinical improvement is also plausible with steroids,8 which could facilitate shorter courses of antibiotics, which would improve both prescribing and the overall economic burden of sore throat. Further, negative externalities associated with overprescribing antibiotics, predominantly the increasing issue of antimicrobial resistance9 could also be moderated. The Treatment Options without Antibiotics for Sore Throat (TOAST) trial10 addressed whether or not oral corticosteroids provide clinical and cost-effective benefits through symptom relief of sore throat. The findings of the trial highlighted no clinical impact of a single dose of oral dexamethasone compared with placebo for resolution of symptoms at 24 hours; however, at 48 hours there was a significant improvement for patients receiving the intervention.11 The cost-effectiveness analysis alongside the TOAST trial assessed the costs and benefits of a single dose of 10 mg oral dexamethasone compared with placebo for the symptom relief of sore throat.
Methods
Intervention
TOAST was a multicentre, two-arm, individually randomised, double blind trial comparing a single dose of 10 mg oral dexamethasone with identical placebo in adults aged between 18 and 70 years1 inclusive, presenting to primary care with acute sore throat. Recruitment took place in 42 primary care clinics in England from April 2013 to February 2015. The intervention period assessed was 7 days postpresentation and participants were followed up for 28 days to assess resource use and adverse events. A subgroup of patients in each trial arm received a delayed prescription for antibiotics at the discretion of the GP and randomisation was stratified by this decision. Further details on trial design are published elsewhere. 6
Outcome measure
The cost-effectiveness analysis assessed quality-adjusted symptom resolution over the 7-day trial duration and estimated median time to complete resolution of symptoms and the corresponding utility gains measured by the EuroQol-five dimensions-five levels (EQ-5D-5L) index. These outcomes informed the construction of a quality-adjusted life year (QALY) used in the cost–utility analysis. The EuroQol instrument has five domains (mobility, self-care, activities, pain/discomfort and anxiety/depression) and five response levels ranging from no problems to severe problem.12 This health-related quality of life (HRQoL) instrument was administered to all participants at baseline and completed on each day of the 7-day patient diary. Each of the five dimensions in the EQ-5D-5L version is scored from 1 (no problem) to 5 (extreme problems), generating a profile (eg, 11 245) that can be used to calculate a single index score (range −0.281 to 1.000).13 The EQ-5D instrument also generates a self-rating of HRQoL scored from 0 to 100 employing a Visual Analogue Scale; this was used in scenario analyses. Quality-adjusted symptom resolution at 24 and 48 hours were also reported.
Resource use
Primary care resource utilisation was recorded in a trial patient diary for the first 7 days of the trial and was complemented by a follow-up survey sent to those with incomplete patient diaries. A primary care patient medical record review for the period from day 1 to day 28 (trial follow-up period) was also undertaken which recorded primary and secondary care contacts related to sore throat including serious adverse events (SAEs) related to the condition. SAEs included in the analysis were those classified as such by the trial protocol; and detailed in the main trial paper.11 Resource use included the following: visits and telephone calls to the GP; visits and telephone calls to nurses; out-of-hours calls and visits; pharmacy visits; calls to helpline ‘111’; accident and emergency (A&E) visits; hospitalisations and various types of reported medication including prescribed antimicrobials and over-the-counter (OTC) medications.
Unit costs
Total and average costs were estimated for the intervention, antibiotic usage (up to and including day 7), OTC medication usage (for days 0–7), health resource use/medication across the trial period (for days 1–28), SAEs and patient productivity losses associated with sick days reported (for work and education) and inability to carry out usual activities. Unit costs, presented in the (online supplementary file 1), were obtained from a number of sources including, Personal Social Services Research Unit (PSSRU),14 British National Formulary,15 Boots Chemist16 and the National Health Service Electronic Tariff Database17 and are reported in UK currency. Productivity losses were costed using average wage rates for those employed and minimum wage rates for students.18 All cost estimates were reported in 2015 GBP using appropriate adjustments for prices retrieved where necessary.19 Disaggregated average cost estimates reported were based on the full cohort in the intention-to-treat (ITT) analysis assuming non-responders had zero costs.
Supplemental material
TOAST trial patient characteristics
Analysis
Patient characteristics and reported resource use were summarised by trial arm. The primary economic analysis was conducted on an ITT basis and adopted the healthcare services payer perspective (HSP) which included the cost burden to the HSP only. Given the short-term duration of the trial, neither costs nor benefits were discounted. For the HSP the prescription administrative charge, normally applied to employed, working-age adults only in the UK,20 associated with the antimicrobial was not incorporated into the cost analysis as this was considered an out-of-pocket (OOP) expense borne by the patient; this was not considered as a contribution to the HSP either, that is, reducing the net cost of care per person to the HSP, as the prescription administrative charge is not applied to everyone and the full amount may not be recouped by the HSP.21 In the scenario analyses, a societal costing perspective (SCP) was also adopted reflecting the overall economic burden of the dexamethasone relative to the placebo. This included productivity losses due to sick days, that is, reported time off due to missed work or education and reported inability to carry out usual activities, and OOP expenses. Further scenarios assessed subgroups based on patient characteristics. The subgroup who highlighted they were current smokers at the time of the trial were assessed in a scenario analysis due to the extra healthcare burden smokers have relative to non-smokers.22 Descriptions of all 20 analyses are presented in the (online supplementary table A2).
Quality-adjusted life year (QALY) analysis
Each element of costs and outcomes was reported separately, consistent with a cost–consequence analysis; the resource use reported was for the full ITT cohort (ie, no missing resource use data) and the HRQoL data reported in the disaggregated format was for complete cases, that is, n=337; 60% of the full cohort. Missing HRQoL data were assessed and classified as missing at random (see online supplementary appendix figure A1).16 Multiple imputation analysis was performed for missing outcome data (40%) in the ITT cohort using a number of imputations (n=60) greater than the proportion of missing data.23 The range of covariates included in the multiple imputation analysis along with a more comprehensive presentation of methods is presented (see online supplementary appendix table A3). The trial and follow-up duration was 28 days in total and for consistency it was assumed that HRQoL was unchanged from day 7 to day 28 using the last value brought forward technique.24 The average utility from baseline reported across the 28 days, calculated using area under the curve was considered 1/13th of a QALY. Baseline variation in outcomes was adjusted for incorporating multiple regression and seemingly unrelated regression techniques which estimated the baseline imbalance taking into account costs and effects.16 25 QALYs exhibited a non-normal distribution (see online supplementary appendix tables A4–A5) and bootstrapping techniques using 1000 iterations were applied in Microsoft Excel.26 The differences in EQ-5D-5L from baseline (day 0) at each day, that is, days 1–7 were estimated and results from the complete case analysis (n=337) and the ITT analysis (n=565) are presented in the (online supplementary appendix tables A4–A5). Cost–utility analysis was undertaken and incremental cost-effectiveness ratios (ICERs) were estimated and reported for the basecase analysis and all scenario analyses. ICERs were probabilistic for the basecase analysis and deterministic for the series of scenarios estimated. The analysis was undertaken in Stata V.14.1.27 A cost-effectiveness plane and cost-effectiveness acceptability curve (CEAC) were constructed based on the bootstrapped sample means and net monetary benefit (NMB) was also assessed against a range of willingness to pay thresholds up to £100 000.28 NICE willingness to pay threshold of £20 000 was adopted as a decision rule to assess cost-effectiveness.27
Cost analysis
Cost–utility analysis (deterministic models)
Results
The ITT cohort (n=565) had 288 in the dexamethasone group and 277 in the placebo group; descriptive statistics are presented in table 1. The mean age of participants was 37 years and 75% were women. There was no significant clinical difference in median time to complete symptom resolution across trial arms with both displaying complete symptom resolution by day 4; however, there was a significant difference in symptom resolution at 48 hours.11 The changes in HRQoL over the 7 days highlight larger differences at baseline and at 24 hours with the dexamethasone group reporting 2.9% and 2.5% higher utility scores, respectively (see online supplementary appendix figures A3–A4). Differences start to diminish (<1.5%) from day 2 onwards. Table 2 highlights the differences in estimated QALYs for the imputed ITT cohort. After controlling for the baseline imbalances in HRQoL, the impact of the intervention was negative but not statistically significant: the QALY gain was −0.00005 (95% CI −0.0002 to 0.00011) equivalent to a loss in HRQoL of a half hour for the dexamethasone relative to the placebo group. Unadjusted differences in HRQoL for the ITT and complete case cohorts are presented (see online supplementary appendix figures A4–A5).
For the subgroup who received the delayed prescription based on clinical need, a statistically significant benefit was evidenced after baseline imbalances were adjusted for resulting in an approximate HRQoL gain of 13.6 hours relative to the control group. For the subgroup who did not receive the prescription, the dexamethasone group indicated a significant QALY loss of approximately 13 hours relative to the placebo group. For the patient group who reported that they were current smokers a significant QALY gain from the dexamethasone of 0.0029, equivalent to 1 day was evidenced. At 48 hours where a significant difference in the risk ratio of symptom resolution at 48 hours in favour of the dexamethasone (RR 1.31 (95% C, 1.02 to 1.68; p=0.03)) was observed, the significant QALY gain approximated to 3.7 hours for the current smokers subgroup.
The average cost per patient associated with the dexamethasone and placebo groups in the basecase analysis adopting a HSP was £73 and £69, respectively. Table 3 highlights total costs for the categories included in the economic evaluation. Average costs were higher across both trial arms for the subgroup who did not receive the delayed prescription relative to the subgroup who did (£24 and £18 higher in the placebo and dexamethasone groups, respectively) driven by higher health service utilisation; however, no statistically significant impact on costs across these subgroups for the HSP was found. For the SCP, including the cost associated with inability to carry out usual activities (Scenario I), the average cost per patient was £126 and £134 for the dexamethasone and placebo groups, respectively. This suggests a cost saving of £7 per patient to society. For the subgroup who received the delayed prescription, there was a negligible SCP reduction in the dexamethasone group of −£0.18; however, for those who did not receive the delayed prescription the SCP reduction for the substantial at −£12 signalling strong evidence of cost savings from the use of oral dexamethasone compared with placebo.
In the deterministic basecase analysis (table 4), the ICER was negative at −£81 400 due to the size and sign of the incremental effectiveness. In the basecase probabilistic analysis, the mean ICER was −£6440 (95% CI −£132 151 to £126 335) and the median ICER was −£304 (IQR: −£5816 to £3877); suggesting there is considerable uncertainty around this estimate. Several societal scenarios highlighted the potential for cost savings; however, due to outcome variability, there is insufficient evidence to suggest the dexamethasone is cost-effective. The cost-effectiveness plane (figure 1) presents a visual representation of the spread of the variation in cost and effect pairs for the basecase probabilistic analysis emphasising the wide variation in effectiveness. Due to this uncertainty, the CEAC (see online supplementary appendix figure A5) suggests the probability of cost-effectiveness is 47.9% at a £20 000 willingness to pay threshold. The mean NMB was £1.80 (SD: £351) at a £20 000 willingness to pay threshold with a 43.5% probability of the dexamethasone yielding a net benefit.
Cost-effectiveness plane.
Discussion
The analysis undertaken provides the first detailed account of the cost of sore throat in the UK estimating that on average, costs of treating sore throat to the HSP are approximately £69 per patient and to society £134. With approximately 340 million consultations annually in the UK29 and 1 in 10 due to sore throat,4 the economic burden is estimated at £2.35 billion (or £4.56 billion to society) based on UK unit costs. The average cost difference was £4.07 (higher in the dexamethasone group): the dexamethasone group cost differential was £5.04, that is, the cost to the HSP of the single dose of oral dexamethasone. Therefore, from the HSP, there is insufficient evidence to suggest the intervention is cost-effective and there is some evidence to suggest the intervention may be producing a negative impact on HRQoL across the whole cohort.
Strengths and limitations of the study
The study collected a wide range of demographic, clinical, QoL and resource use data using a trial-specific daily patient diary which permitted an extensive exploration of uncertainty in scenario and subgroup analyses. Subgroup analysis indicated that for those who received the delayed antibiotic prescription and the dexamethasone versus those who received the delayed prescription and the placebo, the effect on HRQoL was positive and significant and therefore the resulting ICERs were cost-effective at £4950 per QALY gain. In contrast the placebo subgroup not given the delayed prescription had a significantly negative effect. GPs selected patients who were perceived to be in greater clinical need for the delayed prescription sub-arm of the trial; as this subgroup may have had increased severity of symptoms relative to their counterparts, they had more scope to improve from a clinical and HRQoL perspective which in part may explain the variation in HRQoL for the subgroups. Additionally, the average costs of those in the ‘no delayed prescription’ subgroup who received intervention or placebo were 30% and 45% times higher, respectively, than those in the comparative subgroup who received the delayed prescription. Cost differences observed across subgroups were primarily driven by higher reported health service use contacts across the trial and follow-up periods: 210% increase in the ‘no delayed prescription’ subgroups overall and 157% and 286% higher for the intervention and placebo arms, respectively. Caution is needed in interpreting this variation as the trial was not powered for subgroup analysis of resource use and response rates were low. Previous research did not find any clinical differences across delayed prescription and no treatment strategies30; however, our findings suggest that the clinical and non-clinical benefits of the delayed prescription in addition to the dexamethasone need to be explored further.
Although only a slight reduction in antibiotic usage was observed in the intervention arm relative to the placebo, that is, 3% less reported use for the delayed prescription subgroup, we feel the range of budgetary, clinical and environmental benefits of reducing antibiotic usage need to be explored further given the evidence highlighted in this study.
When assessing the impact of the dexamethasone on those who reported being current smokers (n=103, equally distributed between trial arms), there was a significant increase in HRQoL from baseline suggestive of cost-effectiveness for smokers: ICER £6533. Due to higher risk of prolonged symptoms compared with previous smokers or non-smokers, this intervention may provide an interactive anti-inflammatory perhaps akin to effects in patients with exacerbations of chronic obstructive pulmonary disease, primarily caused by smoking.
Adoption of a SCP highlighted cost savings for the intervention relative to the control group. The main driver of difference in the range of scenarios adopting a SCP was the cost associated with missing work or education due to sickness. However, there were also differences in reported OTC medication usage across trial arms and subgroups that may influence recovery.
The study is not without its limitations. Missing data were an issue as the main tool for data collection was a patient completed diary at each day of the trial follow-up: HRQoL over the 7 days was 60% complete and the resource use reported in diaries was 62% complete. The initial response rate was much lower and a protocol amendment which allowed the use of incentives for patients who returned diaries was introduced. Reported resource use for HSP analysis was cross-checked with a follow-up patient survey and medical record review and as such where no resource use was identified for each patient across the data sources, the assumption of zero resource use for that category is justifiable but potentially leading to some bias in cost estimates. However, EQ-5D-5L data were collected from the patient survey only and missing data were considerable at 40%. Although robust multiple imputation techniques were applied to impute values, it is recognised that the range of covariates used to impute missing data may not reflect the degree of heterogeneity across the patient cohort and therefore some bias may remain in terms of the resource use and outcomes reported versus those that were not. If the imputation model was mis-specified, the imputation estimates could have some degree of bias.31 Due to the high uncertainty around observed HRQoL estimates across both arms, however, the limitations associated with multiple imputation are not cause for concern. In the analyses adopting a SCP, self-reported data on time unable to engage in usual activities and OTC medications purchased were not imputed for those with missing data and assumed zero for non-responders. The total cost burden to society is more than likely underestimated as a result and the SCP cost difference across both arms may not be as representative as the HCP cost difference.
Further limitations include the interpretation of the subgroup analyses given the small sample sizes and limitations of the data outlined. The findings based on the subgroup analyses should be interpreted with caution and need to be assessed with appropriately powered trials. However, the subgroup analyses give greater understanding of the wide variation in outcomes observed.
Conclusions and policy implications
In conclusion, sore throat has a substantial economic burden on healthcare delivery systems with this study estimating the economic burden from a HCP in the UK at £2.35 billion annually. More effective strategies for assessing and providing rapid symptom relief could reduce the cost burden as well as improve clinical and HRQoL outcomes. The findings of this study suggest there is considerable uncertainty in relation to the effectiveness and HRQoL benefit of dexamethasone for sore throat and therefore insufficient evidence to suggest cost-effectiveness or its adoption as a viable treatment strategy. However, there was evidence suggestive of potential benefits in several subgroups which could be investigated further in follow-up trials.
Acknowledgments
The authors would like to acknowledge the full TOAST study team for their input: M Voysey, J Cook and J Allen, of Nuffield Department of Primary Care Health Sciences, University of Oxford, and K Harman of Department of Medicine, University of Southampton.
References
Footnotes
RMB and JW are joint first authors.
Contributors All authors contributed to: the conception and design of the TOAST trial analysis including guidance on the health economic evaluation; the drafting and revising of this manuscript; approval of the final version of the manuscript and are accountable for all aspects of the work presented. Each author has particular areas of expertise as follows: applied economic evaluation leads–RMB and JW (joint first authors), statistical analysis: SJ, NW and RP, project management, project conception, design and clinical lead:GH, clinical leadership and guidance, interpretation and policy interpretation: ADH, MT, CH, PL and MM. His research presents an honest, accurate and transparent account of the economic evaluation of the TOAST UK study; no relevant aspects of the study have been omitted and the wide range of scenario analyses addresses both the clinical heterogeneity and variability in structural assumptions.
Funding This paper presents independent research funded by the National Institute for Health Research School for Primary Care Research (Project number 172).
Disclaimer The views expressed are those of the authors and not necessarily those of the NIHR, the NHS or the Department of Health.
Competing interests None decalred.
Patient consent Not required.
Ethics approval The research protocol was approved by the National Research Ethics Committee South Central (12/SC/0684).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement There is no additional data available for this study.
Collaborators Voysey M, Cook J, Allen J, Harman K