Funnel plots and their emerging application in surgery

Ann Surg. 2009 Mar;249(3):376-83. doi: 10.1097/SLA.0b013e31819a47b1.

Abstract

Objective: To familiarize surgeons with the use of funnel plots as a control tool to assess quality in surgery.

Summary background data: Surgical outcomes are an important component of quality in healthcare delivery. Several control tools have been introduced and tested including the use of graphical tools such as funnel plots. More recently, their application in healthcare to assess quality has become more evident. Ranking in surgical performance has significant limitations, risks, and implications which can be addressed by the use of funnel plots.

Methods: This methodological review explores the principles and existing application of funnel plots within surgery and emphasizes their advantages, limitations, public health implications, and their use to assess the evidence in the literature and potential future applications.

Results: Funnel plots are practical tools, easy to use, and offer the opportunity to statistically define control limits around measurable outcomes, allowing for adjustment of unmeasured factors. This makes them extremely useful for the monitoring of performance in surgery either at a surgeon, institutional, regional, or national level, by means of qualifying aggregated data in reported literature (meta-analysis). Increasing transparency is required in healthcare outcomes and performance, which means that funnel plots will most likely play an increasingly important role as a quality control tool.

Conclusions: More widespread application of funnel plots in surgery will help to overcome some of the existing difficulties in assessing and reporting performance and identifying evidence-based information. The assessment and changes in future healthcare delivery could be partly influenced by further development of funnel plot methodology.

MeSH terms

  • Employee Performance Appraisal
  • General Surgery / standards*
  • Humans
  • Models, Statistical*
  • Outcome Assessment, Health Care
  • Quality Assurance, Health Care
  • Quality of Health Care / standards*
  • Surgical Procedures, Operative / standards
  • Treatment Outcome