Type I Error Rates from Mixed Effects Model Repeated Measures Versus Fixed Effects Anova with Missing Values Imputed Via Last Observation Carried Forward

Abstract

Treatment effects are often evaluated by comparing change over time in outcome measures. However, valid analyses of longitudinal data can be problematic when subjects discontinue (dropout) prior to completing the trial. This study compared the Type I error rates from a likelihood-based repeated measures analysis (MMRM) to a fixed-effects analysis of variance where missing values were imputed using the last observation carried forward approach (LOCF). Comparisons were made in 32 scenarios, with 3000 simulated data sets per scenario. The null hypothesis of no difference between treatments in mean change from baseline to endpoint was true in all data sets. Subject dropout was introduced to generate ignorable and nonignorable missingness.

Pooled across all scenarios, the Type I error rates for MMRM and LOCF were 5.85% and 10.36%, respectively. Type I error rates in the 32 scenarios ranged from 5.03% to 7.17% for MMRM, and from 4.43% to 36.30% for LOCF. In 19 of the 32 scenarios, MMRM yielded a Type I error rate that was at least 1.00% closer to the expected rate of 5.00% than the corresponding rate from LOCF.

Greater inflation of Type I error in LOCF resulted from greater bias in estimates of mean change from baseline to endpoint and unduly small standard errors that were a consequence of failing to account for the uncertainty of imputation. The superior control of Type I error by MMRM suggested that MMRM should replace LOCF as the default primary analysis for longitudinal clinical trials where dropout bias may exist.