Elsevier

Value in Health

Volume 14, Issue 2, March–April 2011, Pages 205-218
Value in Health

Economic evaluation
Model Averaging in the Presence of Structural Uncertainty about Treatment Effects: Influence on Treatment Decision and Expected Value of Information

https://doi.org/10.1016/j.jval.2010.08.001Get rights and content
Under an Elsevier user license
open archive

Abstract

Background

Standard approaches to estimation of Markov models with data from randomized controlled trials tend either to make a judgment about which transition(s) treatments act on, or they assume that treatment has a separate effect on every transition. An alternative is to fit a series of models that assume that treatment acts on specific transitions. Investigators can then choose among alternative models using goodness-of-fit statistics. However, structural uncertainty about any chosen parameterization will remain and this may have implications for the resulting decision and the need for further research.

Methods

We describe a Bayesian approach to model estimation, and model selection. Structural uncertainty about which parameterization to use is accounted for using model averaging and we developed a formula for calculating the expected value of perfect information (EVPI) in averaged models. Marginal posterior distributions are generated for each of the cost-effectiveness parameters using Markov Chain Monte Carlo simulation in WinBUGS, or Monte-Carlo simulation in Excel (Microsoft Corp., Redmond, WA). We illustrate the approach with an example of treatments for asthma using aggregate-level data from a connected network of four treatments compared in three pair-wise randomized controlled trials.

Results

The standard errors of incremental net benefit using structured models is reduced by up to eight- or ninefold compared to the unstructured models, and the expected loss attaching to decision uncertainty by factors of several hundreds. Model averaging had considerable influence on the EVPI.

Conclusions

Alternative structural assumptions can alter the treatment decision and have an overwhelming effect on model uncertainty and expected value of information. Structural uncertainty can be accounted for by model averaging, and the EVPI can be calculated for averaged models.

Keywords

Asthma
Bayesian
Cost-effectiveness analysis
Evidence synthesis
Markov model
Model averaging
Parameterisation
Randomized controlled trial
Structural uncertainty
Treatment
Value of information
WinBUGs

Cited by (0)

Funding: This work was supported by the Medical Research Council (MRC), and was carried out primarily at the MRC Health Service Research Collaboration, Department of Social Medicine, University of Bristol. MJP was supported by an MRC Health Services Research Collaboration Studentship. NJW and AEA were supported by funds from the MRC Health Services Research Collaboration.