Objectives: The aim of this study was to describe a current practical approach of priority setting of health technology assessment (HTA) research that involves multi-criteria decision analysis and a deliberative process.
Methods: Criteria related to HTA prioritization were identified and grouped through a systematic review and consultation with a selection committee. Criteria were scored through a pair-wise comparison approach. Criteria were pruned based on the average weights obtained from consistent (consistency index < 0.2) responders and consensus. HTA proposals are ranked based on available information and a weighted criteria score. The rank, along with additional contextual information and discussion among committee members, is used to achieve consensus on HTA research priorities.
Results: Six of eleven criteria represented > 75 percent of the weight behind committee member decisions to conduct an HTA. These criteria were disease burden, clinical impact, alternatives, budget impact, economic impact, and available evidence. Since May 2006, committees have considered 102 proposals at sixteen biannual in-person advisory committee meetings. These have selected twenty-nine research priorities for the HTA program.
Conclusions: The approach works well and was easy to implement. Feedback from committee members has been positive. This approach may assist HTA and other research agencies in better priority setting by informing the selection of the most important and policy-relevant topics in the presence of a wide variety of research proposals. This may in turn lead to efficiently allocating resources available for HTA research.