Table 3

Alignment of return on investment in quality improvement capacity building assessments

Phillips’ ROI in Training and Improvement Model68	The Productive Ward Rapid Assessment69	Value of QI Educational Intervention24	Common Elements
Planning Develop evaluation plan and baseline data	Gather relevant material Collate existing work. Investigate ROI approaches adopted elsewhere. Decide on which perspective we need to address. Clarify the aims and objectives of the improvement initiative. Define the time period for the ROI analysis.	Who Benefits: the value of outcomes depends on the stakeholder perspective. Timing of Analysis: prospective vs. retrospective	Planning Stakeholder perspective of the economic assessment Temporal perspective of the economic assessment
	Define the elements of economic appraisal	Cost Analysis: consider all costs used in service provision. Discerning Benefits: a tangible measure of value is needed. Determine if changes in purchasing could be attributed to the training program.	Identifying costs
Data Collection Reaction/Satisfaction Learning Application Business impact	Identify data Obtain improvement evidence		Identifying benefits Identifying intangible benefits that will not be included in the ROI estimation
Isolate Effects of Program	Discerning % attribution to each measure		Discerning attribution
Data Analysis Convert data to monetary value Return in investment Identify intangible benefits	Produce ROI impact assessment Insert data into ROI calculator. Report an overall ROI result. Report costs and benefits to each organization/sector.	Calculate the ROI	ROI calculations
Reporting	Include an assessment of the risks. Articulate any assumptions made.	Assess the Sensitivity to changes in assumptions	Sensitivity Analysis