Table 3

Alignment of return on investment in quality improvement capacity building assessments

Phillips’ ROI in Training and Improvement Model68The Productive Ward Rapid Assessment69Value of QI Educational Intervention24Common Elements
  • Develop evaluation plan and baseline data

Gather relevant material
  • Collate existing work.

  • Investigate ROI approaches adopted elsewhere.

  • Decide on which perspective we need to address.

  • Clarify the aims and objectives of the improvement initiative.

  • Define the time period for the ROI analysis.

Who Benefits: the value of outcomes depends on the stakeholder perspective.

Timing of Analysis: prospective vs. retrospective

  • Stakeholder perspective of the economic assessment

  • Temporal perspective of the economic assessment

Define the elements of economic appraisalCost Analysis: consider all costs used in service provision.
Discerning Benefits: a tangible measure of value is needed. Determine if changes in purchasing could be attributed to the training program.
Identifying costs
Data Collection
  • Reaction/Satisfaction

  • Learning

  • Application

  • Business impact

Identify data
Obtain improvement evidence
Identifying benefits
Identifying intangible benefits that will not be included in the ROI estimation
Isolate Effects of ProgramDiscerning % attribution to each measureDiscerning attribution
Data Analysis
  • Convert data to monetary value

  • Return in investment

  • Identify intangible benefits

Produce ROI impact assessment
  • Insert data into ROI calculator.

  • Report an overall ROI result.

  • Report costs and benefits to each organization/sector.

Calculate the ROIROI calculations
  • Include an assessment of the risks.

  • Articulate any assumptions made.

Assess the Sensitivity to changes in assumptionsSensitivity Analysis