Background: The Charlson Score is a particularly popular form of comorbidity adjustment in claims data analysis. However, the effects of certain implementation decisions have not been empirically examined.
Objective: To determine the effects of alternative data sources and lookback periods on the performance of Charlson scores in the prediction of mortality following hospitalization.
Subjects: A representative sample of 1,387 elderly patients hospitalized in 1993, drawn from the Medicare Current Beneficiary Survey (MCBS). Three years of linked Medicare claims and survey instruments were available for all patients, as was 2-year mortality follow-up.
Statistical methods: Nested Cox regression and comparisons of areas under the Receiver Operating Characteristic (ROC) curve were used to evaluate ability to predict mortality.
Results: Compared with a 1-year lookback involving solely inpatient claims, statistically and empirically significant improvements in the prediction of mortality are obtained by incorporating alternative sources of data (particularly 2 years of inpatient data and 1 year of outpatient and auxiliary claims), but only if indices derived from distinct sources of data are entered into the regression distinctly. The area under the ROC curve for 1-year mortality predication increases from 0.702 to 0.741 (P = 0.002). Furthermore, these improvements in explanatory power obtained whether one also controls for Charlson scores based on self-reported health history and/or secondary diagnoses from the claim for the index hospitalization itself. Finally, claims-based comorbidity adjustment performs comparably to survey-derived adjustment, with areas under the ROC curve of 0.702 and 0.704, respectively.
Conclusions: The widespread practice of comorbidity adjustment in pre-existing administrative data sources can be improved by taking more complete advantage of existing administrative data sources.