Article Text

Evidence-based commissioning in the English NHS: who uses which sources of evidence? A survey 2010/2011
  1. Aileen Clarke1,
  2. Sian Taylor-Phillips1,
  3. Jacky Swan2,
  4. Emmanouil Gkeredakis2,
  5. Penny Mills1,
  6. John Powell1,
  7. Davide Nicolini2,
  8. Claudia Roginski3,
  9. Harry Scarbrough2,
  10. Amy Grove1
  1. 1Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
  2. 2Innovation, Knowledge, and Organizational Networks Research Centre, Warwick Business School, University of Warwick, Coventry, UK
  3. 3NHS South Warwickshire Clinical Commissioning Group, Warwickshire, UK
  1. Correspondence to Dr Aileen Clarke; aileen.clarke{at}warwick.ac.uk

Abstract

Objectives To investigate types of evidence used by healthcare commissioners when making decisions and whether decisions were influenced by commissioners’ experience, personal characteristics or role at work.

Design Cross-sectional survey of 345 National Health Service (NHS) staff members.

Setting The study was conducted across 11 English Primary Care Trusts between 2010 and 2011.

Participants A total of 440 staff involved in commissioning decisions and employed at NHS band 7 or above were invited to participate in the study. Of those, 345 (78%) completed all or a part of the survey.

Main outcome measures Participants were asked to rate how important different sources of evidence (empirical or practical) were in a recent decision that had been made. Backwards stepwise logistic regression analyses were undertaken to assess the contributions of age, gender and professional background, as well as the years of experience in NHS commissioning, pay grade and work role.

Results The extent to which empirical evidence was used for commissioning decisions in the NHS varied according to the professional background. Only 50% of respondents stated that clinical guidelines and cost-effectiveness evidence were important for healthcare decisions. Respondents were more likely to report use of empirical evidence if they worked in Public Health in comparison to other departments (p<0.0005, commissioning and contracts OR   0.32, 95%CI   0.18 to 0.57, finance OR  0.19, 95%CI 0.05 to 0.78, other departments OR 0.35, 95%CI 0.17 to 0.71) or if they were female (OR 1.8 95% CI 1.01 to 3.1) rather than male. Respondents were more likely to report use of practical evidence if they were more senior within the organisation (pay grade 8b or higher OR 2.7, 95%CI 1.4 to 5.3, p=0.004 in comparison to lower pay grades).

Conclusions Those trained in Public Health appeared more likely to use external empirical evidence while those at higher pay scales were more likely to use practical evidence when making commissioning decisions. Clearly, National Institute for Clinical Excellence (NICE) guidance and government publications (eg, National Service Frameworks) are important for decision-making, but practical sources of evidence such as local intelligence, benchmarking data and expert advice are also influential. New Clinical Commissioning Groups will need a variety of different evidence sources and expert involvement to ensure that effective decisions are made for their populations.

  • Health Services Administration & Management
  • Public Health

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode

Statistics from Altmetric.com

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.