Objectives While multiple studies have demonstrated variations in the quality of cancer care in the USA, payers are increasingly assessing structure-level and process-level measures to promote quality improvement. Hospital-acquired adverse events are one such measure and we examine their national trends after major cancer surgery.
Design Retrospective, cross-sectional analysis of a weighted-national estimate from the Nationwide Inpatient Sample (NIS) undergoing major oncological procedures (colectomy, cystectomy, oesophagectomy, gastrectomy, hysterectomy, lung resection, pancreatectomy and prostatectomy). The Agency for Healthcare Research and Quality Patient Safety Indicators (PSIs) were utilised to identify trends in hospital-acquired adverse events.
Setting Secondary and tertiary care, US hospitals in NIS
Participants A weighted-national estimate of 2 508 917 patients (>18 years, 1999–2009) from NIS.
Primary outcome measures Hospital-acquired adverse events.
Results 324 852 patients experienced ≥1-PSI event (12.9%). Patients with ≥1-PSI experienced higher rates of in-hospital mortality (OR 19.38, 95% CI 18.44 to 20.37), prolonged length of stay (OR 4.43, 95% CI 4.31 to 4.54) and excessive hospital-charges (OR 5.21, 95% CI 5.10 to 5.32). Patients treated at lower volume hospitals experienced both higher PSI events and failure-to-rescue rates. While a steady increase in the frequency of PSI events after major cancer surgery has occurred over the last 10 years (estimated annual % change (EAPC): 3.5%, p<0.001), a concomitant decrease in failure-to-rescue rates (EAPC −3.01%) and overall mortality (EAPC −2.30%) was noted (all p<0.001).
Conclusions Over the past decade, there has been a substantial increase in the national frequency of potentially avoidable adverse events after major cancer surgery, with a detrimental effect on numerous outcome-level measures. However, there was a concomitant reduction in failure-to-rescue rates and overall mortality rates. Policy changes to improve the increasing burden of specific adverse events, such as postoperative sepsis, pressure ulcers and respiratory failure, are required.
- Patient Safety Indicators
- Cancer surgery
- Preventable Adverse Events
- Patient Safety Indicators
- Quality Improvement
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
- Patient Safety Indicators
- Cancer surgery
- Preventable Adverse Events
- Patient Safety Indicators
- Quality Improvement
Variations in the quality of surgical oncology care in the USA remain unclear.
Payers are increasingly assessing the structure-level and process-level measures to promote quality improvement.
Hospital-acquired adverse events are one such measure and we examine their national trends after major cancer surgery.
Over the past decade, there has been a substantial increase in the national frequency of potentially avoidable adverse events after major cancer surgery, but there was also a concomitant reduction in the failure-to-rescue rates and overall mortality rates.
Patients treated at lower volume hospitals experienced both a higher frequency of potentially avoidable adverse events and failure-to-rescue rates.
Policy changes to improve the increasing burden of specific adverse events, such as postoperative sepsis, pressure ulcers and respiratory failure, are required.
Strengths and limitations of this study
This is the largest study to assess the quality of oncological surgical care in a nationally representative cohort of US patients.
Validated Agency for Healthcare Research and Quality Patient Safety Indicators (PSIs) were utilised to identify trends in hospital-acquired adverse events.
Inherent to the retrospective analyses of large administrative datasets, this study is limited by potential biases due to the case-mix and miscoding.
While PSIs have been shown to perform well as screening tools from an epidemiological perspective (overidentification and few false-negatives), concerns related to high false-positive rates exist.
There has been much interest in assessing the downstream effects and complexities of the contemporary delivery of healthcare. However, observational studies examining preventable adverse events are confounded by the loss of information when administrative data are abstracted from patient records. Recently, several initiatives have been directed to improve consistency, relevance and fidelity in the process of transforming clinical data into administrative datasets and subsequent practice-changing results. Following a landmark study by Iezzoni et al1 on computerised algorithms to identify quality-of-care disparities in administrative datasets, the Agency for Healthcare Research and Quality (AHRQ) developed a standardised system for accrual and reporting of unintended hospital-acquired adverse events, termed patient safety indicators (PSIs).2 Subsequently, Zhan and Miller3 examined the relationship between multiple process-level, setting-level and outcome-level measures and adverse events identified using the AHRQ's PSI system, and reported substantial but variable effects on the healthcare system.
Nonetheless, there is a paucity of studies evaluating the burden of preventable adverse events4 and this is particularly true for major surgical oncology care in the USA. Multiple studies have demonstrated that significant variation exists in cancer incidence rates5 and in access to quality cancer care,6 ,7 but variations in the actual quality of surgical oncology care remain unclear.
Hence, we undertook a national assessment of the quality of major surgical oncology care within a standardised framework of preventable adverse events to examine trends in patient safety within the USA. We also evaluated the prevailing hypothesis8–10 explaining the volume–complication–mortality relationship, which states that higher mortality rates for patients undergoing surgery at low-volume hospitals are preferentially explained by higher failure-to-rescue rates (ie, mortality after a hospital-acquired adverse event), rather than a higher incidence of such adverse events in the first place.
The Nationwide Inpatient Sample (NIS) consists of an array of longitudinal hospital inpatients datasets as part of the Healthcare Cost and Utilization Project. It was established by AHRQ and functions through a Federal-state affiliation. It is the largest publicly accessible all-payer inpatient database.11 The database consists of discharge information from eight million inpatient visits and patients covered by multiple insurance types (including Medicare, Medicaid, private insurance and uninsured patients) are represented.
We relied on hospital discharges for patients undergoing one of eight major cancer surgeries in the USA between 1999 and 2009. The major oncological surgeries consisted of colectomy, cystectomy, oesophagectomy, gastrectomy, hysterectomy, pneumonectomy/lobectomy, pancreatectomy and prostatectomy. Oncological indications were selected based on International Classification of Diseases-9 (ICD-9) clinical modification diagnostic codes. These particular procedures were chosen based on procedure volume and care was taken to include cancer surgeries involving different organ systems across a range of surgical specialties.
Patient and hospital information
Patient characteristics evaluated included age at inpatient hospitalisation, race, gender, insurance characteristics and comorbidities. Regarding race, patients were classified as White, Black, Hispanic and Other (Asian or Pacific Islander, Native American). Regarding insurance characteristics, patients were categorised based on the primary payer: Medicare, Medicaid, Private insurance (Blue Cross, commercial carriers, private HMO's and PPO's) and other insurance types (including uninsured patients). Charlson Comorbidity index (CCI) was derived according to Charlson et al,12 and adapted according to the previously defined methodology of Deyo et al.13 Median household income of the patient's ZIP code of residence, as derived from the US Census, was used to define socioeconomic status and patients were divided into quartiles:<$25 000, $25 000–$34 999, $35 000–$44 999 and ≥$45 000. Hospital information examined included hospital location (urban vs rural) and region (Northeast, Midwest, South and West), as defined by the USA Census Bureau14 and academic teaching status as derived from the AHA Annual Survey of Hospitals. Hospital volume was categorised into volume quartiles as described previously.15
The AHRQ PSIs were used to identify potentially preventable hospital-acquired adverse events. For the PSI project, AHRQ commissioned experts from the Evidence-based Practice Center at the University of California San Francisco and Stanford University and from the University of California Davis to evaluate the existing literature and help develop an evidence-based approach for improving patient safety.2 The objective of this project was to facilitate the identification, quantification and reporting of preventable hospital-acquired adverse events from routinely collected administrative information. The process of identification of PSI included initial literature analysis of previously reported patient safety problems, organised peer review of chosen PSIs, structured review of ICD-9 codes for each PSI and, finally, empirical analysis of each PSI and feedback from multidisciplinary teams (physicians and specialists, nurses, pharmacists and coding and experts).2 The complete set of PSIs utilised is displayed in the appendix and is available on the AHRQ website.16 The list includes various preventable adverse events that have been shown to have reasonable accuracy and validity as indicators for enhancing quality improvement and patient safety.
Proportions, frequencies, means, medians, SD and IQRs were obtained for each variable. National trends in the frequency of PSI events, failure to rescue (defined as mortality after a PSI event), and in-hospital mortality were also analysed as the estimated annual percentage change (EAPC), based on the linear regression methodology described by Anderson et al.17 Logistic regression models were used to examine predictors of PSI events, and to examine the effect of PSI events on multiple outcomes-level measures, including in-hospital mortality, excessive charges (≥75th centile of inflation-adjusted charges for each individual procedure) and prolonged length of stay (≥75th centile of each individual procedure). Subsequently, we examined the volume–complication–mortality relationship in overall and procedure-specific analyses to study the relationship between mortality at low-volume hospitals and failure-to-rescue rates. Generalised estimating equations were used in each multivariable analysis to adjust for clustering among hospitals.18 All analyses were two-sided, and significance was defined as p<0.05 and performed using the R statistical package (R foundation for Statistical Computing, V.2.15.1).
The baseline demographic characteristics of our cohort of patients >18 years old undergoing one of eight major cancer procedures in the USA between 1999 and 2009 (n=2 508 917) are shown in table 1. A weighted estimate of 324 852 patients experienced ≥1-PSI event (12.9%). Patients with ≥1-PSI event were more likely to be older, be women, have higher CCI, participate in Medicare, have lower socioeconomic status, and be treated at lower volume non-academic hospitals when compared with patients who did not experience any hospital-acquired preventable adverse events.
The national trends in PSI rates, overall mortality rates and failure-to-rescue rates in patients undergoing major cancer surgery in the USA are depicted in figure 1. While a steady increase in the frequency of PSI-events after major cancer surgery has occurred over the last 10 years (EAPC 3.5%; 95% CI 2.8% to 4.1%; p<0.001), a concomitant decrease in failure-to-rescue rates (EAPC −3%; 95% CI −3.4% to −2.6%; p<0.001) and overall mortality (EAPC −2.3%; 95% CI −2.7% to −1.9%; p<0.001) was noted.
While there was a significant increase in overall PSI event rates over the course of the study, substantial heterogeneity was noted in terms of individual PSIs (figure 2A–C). Substantial increases were noted in the annual incidence of postoperative sepsis (EAPC 14.1%, 95% CI 12.0% to 16.2%; p<0.001), pressure ulcer (EAPC 13.4%, 95% CI 10.2% to 16.6%; p<0.001) and respiratory failure (EAPC 5.6%, 95% CI 4.8% to 6.4%; p<0.001), while significant advances were made in the prevention of anaesthetic complications (EAPC −17.5%, 95% CI −27.6% to −7.5%; p=0.008), hip fractures (EAPC −8.9%, 95% CI −13.6% to −4.3%; p=0.005) and transfusion reactions (EAPC −7.9%, 95% CI −13.1% to −2.8%; p=0.001) in the perioperative period.
Results of a multivariable logistic regression model predicting the odds of ≥1-PSI event after major cancer surgery are shown in table 2. These factors included: female gender (vs male, OR 0.88, 95% CI 0.86 to 0.90; p<0.001), Black race (vs Caucasians OR 1.17, 95% CI 1.13 to 1.21; p<0.001), higher CCI (≥3 vs 0, OR 1.38, 95% CI 1.34 to 1.42; p<0.001), Medicaid (OR 1.45, 95% CI 1.39 to 1.52) and Medicare insurance (OR 1.16, 95% CI 1.13 to 1.19; p<0.001), lower median household income (4th quartile vs 1st quartile, OR 0.92, 95% CI 0.89 to 0.95; p<0.001) and surgeries at lower volume hospitals (4th quartile vs 1st quartile, OR 0.76, 95% CI 0.74 to 0.78; p<0.001).
The occurrence of ≥1-PSI event had significant multivariable effects on specific outcome-level measures after major cancer surgery (table 3). Patients who suffered from ≥1-PSI event experienced higher rates of in-hospital mortality (OR 19.38, 95% CI 18.44 to 20.37), prolonged length of stay (OR 4.43, 95% CI 4.31 to 4.54) and excessive hospital charges (OR 5.21, 95% CI 5.10 to 5.32).
We also assessed the effect of hospital volume on the incidence of PSIs and failure to rescue (table 4). In the overall analysis of patients undergoing any of the eight procedures, very high-volume hospitals (4th quartile) had both a lower PSI event rate and lower failure-to-rescue rates. However, this relationship was procedure-specific: for colectomy, oesophagectomy, lung resection, pancreatectomy and prostatectomy, very high-volume hospitals had both lower PSI event rates and lower failure-to-rescue rates. For gastrectomy, very high-volume hospitals did not have lower PSI event rates but they did have lower failure-to-rescue rates; for hysterectomy, very high-volume hospitals had higher PSI event rates, but had lower failure-to-rescue rates; for cystectomy, very high volume-hospitals had lower PSI event rates and a trend towards lower failure-to-rescue rates.
Recently, it has been estimated that the annual cost of medical errors is over 17 billion dollars19 and there have been a slew of newer initiatives over the last decade to incentivise better quality care. In 2008, Medicare announced that it would restrain the ability of hospitals to get reimbursed for ‘reasonably preventable events’: avoidable medical errors ranging from pressure ulcers, falls and transfusion of incompatible blood to anaesthetic complications, deep vein thrombosis and foreign bodies left in the body of patients during surgery. These and other initiatives are designed to place the burden of responsibility for such hospital-acquired adverse events squarely on hospitals and physicians.20 While these initiatives have been met with stiff objection from hospital administrations, the Centers for Medicaid and Medicare Services (CMS) has been consistent in its position that accountability for such events should rest with hospitals and not with the taxpayer.20 The Affordable Care Act of 2010 has added newer dimensions to these quality-improvement initiatives, with reimbursement likely to be dependent on both adherence to standards of care and the perceptions of patients with regard to hospital performance as measured by surveys.21
A rational approach to improving accountability for substandard care should begin with identifying the true burden of hospital-acquired adverse events. This would be particularly useful in identifying specific adverse events that warrant special attention by payers like CMS and in preferential allocation of resources by hospitals due to the growing temporal burden of such events.
In the current study, we report contemporary trends in the frequency of hospital-acquired adverse events after major surgical oncology care in the USA. Our study has a number of novel findings. First, we report a gradual increase in the national frequency of hospital-acquired adverse events after major cancer surgery over the last decade. This is important as it represents a decline, albeit small and gradual, in the quality of surgical oncology care at the national level, as measured by the primary prevention of PSI events. The increase may be attributed to changes in case-mix, including an ageing population. Conversely, the emergence of multiresistant bacteria may contribute to the recorded trends.22 ,23 Second, a simultaneous decrease in failure-to-rescue rates was observed, which may indicate that while primary prevention of hospital-acquired adverse events has deteriorated, the early recognition and timely management of these complications may have improved in the last decade. These findings may explain the significant annual reduction in mortality for patients undergoing major cancer surgery. Nonetheless, alternate explanations include refinements in coding practices, which may have led to better recognition and recording of non-lethal adverse events, thereby resulting in an apparent decrease in mortality rates. Third, significant heterogeneity in the temporal dynamics of specific hospital-acquired adverse events was noted. While marked and worrisome increases were recorded in the frequency of postoperative sepsis, pressure ulcers and respiratory failure, advances were made in the prevention of anaesthetic complications, transfusion-related complications and hip fractures. Thus, we identify numerous setting-level and process-level measures where resources need to be refocused for further improvement in the quality of surgical oncology care.
We also examined the volume-complication-mortality dynamic in patients undergoing major cancer surgery, as it applies to potentially preventable hospital-acquired adverse events (PSI). There is a well-established body of evidence describing the volume-mortality relationship in patients undergoing major cancer procedures and other surgeries. Dudley et al24 examined patients undergoing 1 of 11 diverse procedures (ranging from coronary angioplasty to oesophageal cancer surgery) in California and concluded that 602 deaths could have been prevented annually by transferring patients from low-volume to high-volume hospitals. Birkmeyer et al25 reported that Medicare patients treated at very high-volume hospitals experienced up to a 12% difference in absolute mortality for certain procedures relative to patients treated at very low-volume hospitals. However, the underlying mechanisms explaining the volume-mortality relationship have not been elucidated clearly. Silber et al26 first introduced the concept of ‘failure-to-rescue’ in a seminal report that evaluated patients undergoing cholecystectomy or transurethral prostatectomy. They concluded that overall mortality was related to both hospital-level and patient-level factors, while adverse events were related to patient-level factors at admission (severity of illness). However, failure-to-rescue was preferentially associated with hospital-level factors, and thus the underlying dynamics for failure-to-rescue were different than that for overall mortality and adverse events. The current hypothesis8 regarding the volume-complication-mortality relationship is that lower volume hospitals experience higher mortality rates not because of higher complication rates, but due to lower failure-to-rescue rates. Ghaferi et al10 demonstrated that high-volume and low-volume hospitals enrolled in the National Surgical Quality Improvement Program had similar complication rates but different failure-to-rescue rates for multiple procedures. In a subsequent analysis9 of patients undergoing gastrectomy, pancreatectomy or oesophagectomy, similar results were demonstrated. However, in the current study, very high-volume hospitals (4th quartile vs 1st quartile) had both lower PSI event rates and lower failure-to-rescue rates. Importantly, the volume-complication-mortality relationship, as it applies to PSI events, appears to be procedure-specific and heterogeneous, with the current hypothesis not accounting for multiple individual major cancer surgeries, namely colectomy, oesophagectomy, lung resection, pancreatectomy and prostatectomy. This is an important point: CMS currently focuses its quality-improvement initiatives on complication rates, and explicit demonstration that lower failure-to-rescue rates and not higher complication rates underlying the substandard care at low-volume hospitals may require a reconsideration of these initiatives. Our findings indicate that the prevailing hypothesis may need to be re-evaluated, at least for patients undergoing major cancer surgery. In fact, for patients undergoing hysterectomy, this relationship is reversed, with patients at very high-volume hospitals experiencing higher PSI event rates and lower failure-to-rescue rates. The underlying reason for this finding is not clear. Previous studies27 have questioned the impact of hospital volume on hysterectomy outcomes and reported that surgeon volume trumps hospital volume as the predominant factor underlying the volume–outcomes relationship for hysterectomy. While the inclusion of surgeon volume may alter these findings, the higher rates of adverse events in patients undergoing hysterectomy at very high-volume hospitals may need to be re-examined in future reports.
Our study is not without limitations. The drawbacks of using administrative data are well known,28 including limitations regarding risk-adjustment and miscoding. While PSIs have been shown to perform well as screening tools from an epidemiological perspective (overidentification and few false-negatives), problems related to high false-positive rates exist, with most validation studies reporting positive predictive values of between 43% and >90%.29 ,30 While it is clear that these drawbacks limit the use of PSIs to make reimbursement decisions or to compare hospitals, it is unclear how it affects the implications of our study, where it was used as a screening tool to identify adverse events.29 ,30 Second, morbidity and mortality events in NIS are characterised based on the index admission, and subsequent readmissions, while relevant, are not recorded. This may have resulted in under-recognition of the true burden of adverse events, mortality and charges after the initial cancer surgery. Third, while the heterogeneity identified in the volume–complication–mortality relationship is a key finding in the present report, our study design does not allow for the identification of the underlying mechanisms explaining these results. It is also important to emphasise that, in contrast to the previously cited studies where the overall complication rates were examined, we evaluated potentially preventable hospital-acquired events only. Previous investigators have shown that this restricted definition has limitations since not all deaths are accounted for in a given population sample31; alternatively, these drawbacks may not apply to studies focusing on patient safety using PSI as a quality-of-care measure. Hence, while it may not be illogical to expect lower volume hospitals to provide substandard care secondary to both higher rates of preventable adverse events and higher failure-to-rescue rates, it is certainly possible that a majority of hospital-acquired complications are an inevitable result of procedure complexity and patient comorbidities (and not just a failure of setting-level prevention measures). Consequently, while more rigorous patient care pathways might explain the lower incidence of preventable adverse events and subsequent mortality in higher volume hospitals, for the majority of (non-preventable) adverse events, the incidence rates would be the same regardless of hospital volume with lower failure-to-rescue rates preferentially explaining the low mortality rates of higher volume hospitals. Further investigation of these findings is required to test these possibilities and to fully understand the underlying dynamics of the volume–mortality relationship.
Over the past decade, there has been a substantial increase in the national frequency of potentially avoidable hospital-acquired adverse events after major cancer surgery, with a detrimental effect on numerous outcome-level measures. However, there was a concomitant reduction in failure-to-rescue rates and, consequently, overall mortality rates. Policy changes and resource reallocation to improve the increasing burden of specific adverse events, such as postoperative sepsis, pressure ulcer and respiratory failure, are required.
SS and FR contributed equally.
Contributors SS, FR and Q-DT conceived the idea of the study and were responsible for the design of the study. SS and FR contributed equally. SS, VQT and FR performed the data analyses. VQT produced the tables and graphs. JDS and MS provided input into the data analysis. MS was responsible for the acquisition of the data and M-KG, H-JT, PR, SPK, JCH, PIK, JN, MS and MM contributed to the interpretation of the results. The initial draft of the manuscript was prepared by SS and FR and then circulated repeatedly among all authors for critical revision. All authors have read and approved the final manuscript.
Funding This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None.
Ethics approval An institutional review board waiver was obtained in accordance with institutional policy when dealing with population-based de-identified data.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.