You are here

Article Text

Article menu
Medical education and training
Protocol
Understanding the use of the National Early Warning Score 2 in acute care settings: a realist review protocol
  1. Michelle Treacy1,
  2. Geoff Wong2,
  3. Mandy Odell3,
  4. Nia Roberts4
  1. 1Department for Continuing Education, Oxford University, Oxford, UK
  2. 2Nuffield Department of Primary Care Health Sciences, Oxford University, Oxford, UK
  3. 3Critical Care, Royal Berkshire NHS Foundation Trust, London Rd, Reading, UK
  4. 4Bodleian Health Care Libraries, University of Oxford, UK, Oxford, UK
  1. Correspondence to Michelle Treacy; michelle.treacy{at}kellogg.ox.ac.uk

Abstract

Introduction Failure to recognise and respond to patient deterioration in an appropriate and timely manner has been highlighted as a global patient safety concern. Early Warning Scores (EWSs) using vital signs were introduced to address this concern, with the aim of getting the patient timely and appropriate treatment. The National Early Warning Score 2 (NEWS2) is in use across the NHS, and many other settings globally. While patient improvements have been shown, research has identified that the NEWS2 is not always used as intended. Therefore, this review will use a realist approach to understand what the mechanisms are that influence appropriate use (or not) of the NEWS2 in acute care settings, how, for whom and in which contexts. The findings will inform clinicians of what helps and/or hinders appropriate use of the NEWS2 in clinical practice, thus helping to facilitate successful implementation.

Methods and analysis Our realist review will follow Pawson’s iterative six step process: (1) Development of initial programme theory. (2) Searching the literature; an information scientist will develop, pilot and refine the search strategy. A systematic search will be completed, based on subject relevancy on the following databases: Cumulative Index to Nursing and Allied Health Literature (CINAHL), Medline, Embase (OvidSP), Web of Science (Science Citation Index and Social Science Citation), Cochrane Database of Systematic Reviews, Joanna Briggs Institute, Ethos, Proquest Dissertations and Theses Global, and Google Scholar for documents dating from 1997 (date of the first published EWS) to present. To retrieve additional relevant data ‘snowballing’ (finding references and authors by hand, contacting authors, searching reference lists and citation-tracking using Google Scholar) will be used. Inclusion criteria include all documents (including grey literature) that relate to the use of EWSs/NEWS2 in the English language only. Documents set in the paediatric, maternity and primary care settings will be excluded. (3) Selecting documents and quality appraisal. (4) Extracting and organising the data. (5) Synthesising the data. (6) Disseminating the findings. We will recruit a group of stakeholders comprised of experienced clinicians who use the NEWS2 as part of their clinical practice to provide feedback throughout the review. Step 1 has already begun with the development of an initial programme theory. This initial programme theory presents how the NEWS2 is supposed to work (or not), it will now be developed, tested and refined.

Ethics and dissemination Ethical approval is not required for this study as it is secondary research. Dissemination will include a peer-reviewed publication and conference presentations. Findings will also be amplified through social media platforms with user friendly summaries. Our stakeholder group will also contribute to dissemination of findings in their clinical areas and among existing networks.

PROSPERO registration number CRD42022304497.

  • adult intensive & critical care
  • protocols & guidelines
  • quality in health care
  • intensive & critical care
  • medical education & training
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

http://dx.doi.org/10.1136/bmjopen-2022-062154

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • The realist review approach employed will enable us to develop an in-depth understanding of the mechanisms by which the National Early Warning Score 2 works, which can be used to inform its appropriate use.

    • A strength is that we have built in processes to ensure the programme theory and findings are relevant to knowledge users by stakeholder input and drawing on grey literature.

    • Our review may be limited by a second reviewer screening only a random 10% of the included/excluded documents, however, explicit screening criteria arguably helps mitigate selection bias.

    • A realist review will not produce universally transferable findings because these are context dependant; however, it is likely that findings can be extrapolated to settings where similar mechanisms may be operating.

    Introduction

    Background

    Failure to recognise and respond to the deteriorating adult patient in a timely manner has been identified as an international patient safety concern.1–7 Research has shown deficiencies in assessing, recording and acting on abnormal vital signs to prevent critical events, namely unplanned intensive care admissions or death.6 8–10 Despite efforts to address this problem,3–5 11–14 there is evidence that adverse events, are still occurring as a result of failure to recognise and respond to acute deterioration in an effective and timely manner.5 15–17

    Patient deterioration can be defined as a transition from one clinical state to a worse clinical state, thereby increasing the risk of morbidity, prolonged hospital stays, disability, organ dysfunction or death.10 Studies have shown that serious adverse events such as cardiac arrest, admission to intensive care or death are precluded by abnormal vital signs that were not acted on in a timely manner.2 16 18 This is often referred to as a ‘failure to rescue’. Failure to rescue occurs when there is an inadequate or delayed response to clinical deterioration in a hospitalised patient.19 Many efforts, such as the introduction of Early Warning Scores (EWSs), have been introduced to address this growing concern.

    National Early Warning Score

    In 2012, the Royal College of Physicians (RCP) published the National Early Warning Score 2 (NEWS2),20 which has been widely adopted across the National Health Service (NHS). Five years after its introduction, it underwent a review to ensure that it was still fit for purpose, which led to the introduction of the NEWS2.14 Notably, the NEWS2 is sensitive to detecting deterioration in patients with COVID-19.21 22 For the NEWS2 to predict deterioration, accurate assessment of all required vital sign data is key.14 Research has identified that EWSs are often completed inaccurately, with either errors or omissions of vital signs.23–26 These errors lead to patients not being referred for review, resulting in a failure to rescue.26 A key focus of the NEWS2 is to prompt ward staff carrying out vital sign assessment to identify potential deterioration.14 An indication of possible deterioration is meant to trigger increased frequency of monitoring and escalation of care.4 27

    Rapid response teams (RRTs), also referred to as critical care outreach teams or medical emergency teams, comprise of experienced critical care clinicians, proficient in managing patient deterioration.28 These teams were established as a preventive measure against serious adverse events in acute hospitals.9 29 30 Research shows RRTs reduce hospital mortality and cardiopulmonary arrests.31 The NEWS2 needs to be used in conjunction with RRTs or a clinician with core competencies in the care of acutely ill patient to ensure appropriate interventions are made in response to deterioration. 

    Suboptimal use

    The NEWS2 is the most used EWS in use across the NHS and many other settings globally; despite this, there are still concerns regarding the recognition and response to patient deterioration. Research has shown that EWSs are not always used as intended, for example, incorrect assessment of vital signs, miscalculation of scores and/or failure to escalate or respond as per protocol.32–40 A common problem is related to failure to assess respiratory rate,35 39 40 ineffective and poor communication, especially among healthcare workers.41–43 Lack of staff and time have also been shown to negatively affect the use of EWSs.35 40 43 A recent systematic review identified that escalation was largely influenced by perceptions; notably, junior doctors’ perception of threatened deskilling and appearing incompetent due to the presence of RRTs. As clinical experience of healthcare professionals is fundamental in recognising the need for escalation,44 it may be construed that appropriate use of the NEWS2 would improve the recognition and response to patient deterioration. The value of the NEWS2 is dependent on appropriate implementation, appropriate use and an effective clinical response.4 14

    In order to support the appropriate use of the NEWS2 in clinical practice, it is important to consider how the context of the workplace affects (either positively or negatively) its use, so that adjustments can be made to facilitate successful implementation. An abundance of research exists on the reasons why patient deterioration often goes unnoticed or escalated appropriately, however, there is a paucity of literature published on how to improve the use of EWSs, in particular the NEWS2.45–47 Therefore, the gap in evidence this research is seeking to address, is, to better understand how the recognition of and response to patient deterioration can be improved through the appropriate use of the NEWS2. The NEWS2 is a simple tool,20 however, because it relies on various resources and knowledge to ensure appropriate use, it is complex in nature when implemented in the ‘real world’ setting of the NHS. One way to make sense of complex interventions, such as the NEWS2, is to use theory-driven approaches. One such approach designed to make sense of complex interventions is realist reviews.48

    Review aim

    The aim of this realist review is to use the literature to understand what helps or/and hinders the appropriate use of the NEWS2 in the acute setting.

    Objectives

    1. To conduct a realist review on how, for whom and in what contexts the NEWS2 helps (or not) detect patients at risk of deterioration in the acute setting.

    2. To develop a programme theory that explains the role of the NEWS2 in the identification and management of deteriorating patients in the acute setting, how, for whom and in which contexts.

    3. To make recommendations on how best to support the implementation of the NEWS2 in acute settings.

    Review question

    How, when, for whom, why and to what extent is the NEWS2 used in the acute setting to detect and respond to patient deterioration?

    Methods and analysis

    Study design

    Realist approach

    The study uses a realist approach to focus on understanding and unpacking the influence of context on the mechanisms by which an intervention causes outcomes (or not), thereby providing an explanation, as opposed to a judgement about how it works.48 The principal focus of a realist review is ‘to determine what works, for whom, in what circumstances, in what respects and why’.49 The assumption is that an intervention may work well in one context, but then not at all or poorly in another context.50 A realist review aims to address this issue by unearthing and then developing and refining the realist programme theory underlying an intervention. The approach acknowledges that interventions are embodied theories and that within such theories outcomes can be explained by understanding the interaction of context (C), mechanism (M), which determines outcome—hence context +mechanism = outcome (O). The review will identify the various elements of the intervention that change contexts and seek to understand how a change in contexts lead to desired outcomes. These explanations of causation will take the form of context–mechanism–outcome–configurations (CMOCs), which will form the basis of the programme theory to explain the role of the NEWS2 in the identification and management of deteriorating patients in the acute setting, how, for whom and in which contexts.

    Understanding how outcomes (within any intervention) are influenced by contexts and mechanisms allow researchers to understand how programmes result in both intended and unintended outcomes.51 For example, because NHS England52 advocate the use of the NEWS2 in clinical practice; this does not equate to a direct improvement in the recognition and response to patient deterioration. Rather the NEWS2 may be considered a complex intervention that seeks to change the context around its users. It is the interaction between the changed contexts (or not) brought about by the NEWS2 and how users interpret and act on these (the mechanisms) which results in intended and unintended outcomes. This understanding will enable us to identify what influences clinicians’ appropriate use of the NEWS2. In effect, the NEWS2 is a complex intervention as it requires multiple actions and decision making. Clinicians may go through the steps in a variety of ways, however, their actions are restricted and altered by the wider contextual features. In other words, a clinician’s use of the NEWS2 is shaped by the context. The NEWS2 must work within a complex social system and the realist review will combine theoretical understanding with empirical evidence (drawn from a wide range of sources) in order to explain the relationship between contexts, the mechanisms by which it works and the outcomes that are generated.48

    Theoretical explanations produced from the realist review—which take the form of CMOCss are middle-range theories. Middle-range theories involve abstraction but are close enough to the observed data to be incorporated into propositions that permit empirical testing53 yet abstract enough to provide transferable explanations to other situations where the same mechanism may be occurring.54 In this review, the empirical ‘testing’ (confirmation, refutation and refinement) will be against data from research and grey literature. Following current accepted realist review practice there will be no limits on the grey literature screened for inclusion, as it may contribute in various ways of explaining the programme theory.50

    Realist review

    This realist review will go by the process outlined by Pawson55 and will follow the Realist and Meta-narrative Evidence Synthesis: Evolving Standards quality and publication standards.56 The steps and processes for the review are summarised as a flow diagram, adopted from Wong et al57 (see figure 1). This study began on 18 January 2022, the current study status is at initial document screening; the expected date of completion is 31 January 2023.

    Figure 1
    Figure 1

    Flow diagram of the project. Adapted from Wong et al.57 PT, Programme Theory.

    Patient and public involvement

    In order to achieve maximal end-user relevance, consultation with stakeholders throughout the review is strongly advised.50 Therefore, a diverse stakeholder group (maximum of 20); consisting of healthcare assistants, nursing associates, registered nurses, junior and consultant doctors, as well as members of RRTs will be recruited. The stakeholders must use the NEWS2 as part of their practice in the acute setting. The British Association of Critical Care Nurses will be contacted to invite their members to join the stakeholder group. The RCP’s will also be contacted to invite members of the NEWS2 committee to join as stakeholders. Finally, staff at a large district general NHS hospital (where a member of the review team works) will be invited to join as stakeholders. Stakeholders will have the option to join group or individual meetings, held online via a secure platform. The initial programme theory will be shared with stakeholder’s ahead of the meetings and they will be asked for their feedback. During the meetings, electronic notes will be kept and on completion of the review, a compilation of stakeholder’s feedback will be made available to readers. Consultation with stakeholders will be an iterative process throughout the review. A pragmatic approach derived from consultation with stakeholders will be used to prioritise the programme theories chosen to develop. Records of how which theories chosen to develop will be kept and made accessible to readers.58 Stakeholders will also be asked for their feedback on emerging findings as the review progresses,58 and for their advice on how best to disseminate findings.

    Step 1: development of initial programme theory

    Initially, the research question was refined through an exploratory scoping review of the literature and content expertise (from the research team). Once the review question was focused, the initial programme theory was established through discussion among the research team, as well as preliminary reading of primary studies. The initial programme theory presents a simplified and linear explanation of how the NEWS2 is supposed to work and key areas where it may fail to work, thus allowing for the development of CMOCs to explain why success or failure occurs at each step (figure 2). The initial programme theory will now be presented to stakeholders in order to understand if it reflects their experiences and to build on these. Stakeholders will be asked how, why and when they think the NEWS2 works or fails to work in clinical practice. Initial programme theories will be discussed with stakeholders to determine which programme theories seem pertinent to establish a viewpoint on the difficulties of implementation and elucidate the ways in which the intervention may go wrong.

    Figure 2
    Figure 2

    Initial programme theory of how the NEWS2 is supposed to work (or not). HCA, healthcare assistant; NA, nursing associate; NEWS2, National Early Warning Score 2; RN, registered nurse; RRTs, rapid response teams.

    Step 2: searching the literature

    The search process in a realist review needs to retrieve the data necessary to help ‘develop, refine or test,’50 the programme theory. Some exploratory searching has already taken place in step 1 to help the development of the initial programme theory, however, the purpose here is to undertake more comprehensive searches that will find the data needed to develop and confirm, refute or refine the initial programme theory.55 There is no hierarchy of evidence in a realist review, relevancy is crucial.50 55 A realist review is able to synthesise a range of relevant data such as quantitative, qualitative, mixed-method research and systematic reviews as well as grey literature,59 therefore, the search strategy will seek to identify sufficient relevant literature.

    An information scientist (NR) will help develop, pilot and refine the searches. Search terms will be chosen as appropriate, drawing on the specialist knowledge of the review team and stakeholders (see online supplemental file 1 for an example of a provisional search strategy). The following databases will be searched based on subject relevancy, from 1997 (this is when the first EWS was published) to present: Cumulative Index to Nursing and Allied Health Literature (CINAHL), Medline, Embase (OvidSP), Web of Science (Science Citation Index and Social Science Citation), Cochrane Database of Systematic Reviews, Joanna Briggs Institute, Ethos, Proquest Dissertations and Theses Global and Google Scholar. Set inclusion and exclusion criteria will be used to screen the main results from the databases.

    Key inclusion criteria include all documents (including grey literature) that relate to the use of EWSs/NEWS2 in the English language only. Documents set in the paediatric, maternity and primary care settings will be excluded (see table 1 for full criteria). Inclusion/exclusion criteria may be amended following discussion with stakeholders and as the programme theory develops. It is predicted that Google Scholar will likely result in insurmountable hits, therefore, screening will cease after the first one hundred results of each search only. This is justified as we anticipate the exhaustive searches on scientific databases will capture significant ‘relevant’ data. However, if more data are required as the programme theory develops, the scope of screening on Google Scholar will be expanded. To retrieve additional relevant data ‘snowballing’ (finding references and authors by hand, contacting authors, searching reference lists and citation-tracking using Google Scholar) will be used.55 60 The stakeholder group will also be asked if they are aware of any documents or authors that may be relevant to the review.

    View this table:
    Table 1

    Inclusion and exclusion criteria

    Searching is a purposive and iterative process throughout the review. As the programme theory develops, additional searches may be needed to find more relevant data.58 The Preferred Reporting Items for Systematic Reviews and Meta-Analyses style diagrams will be used to report the disposition of the searches carried out.61 MT will do the initial screening against inclusion and exclusion criteria. A member of the supervisory team (GW) will independently screen a 10% random subsample of the documents from searches for consistency. Discrepancies will be resolved through discussion between MT, GW and MO and if needed by voting.

    Step 3: selecting documents and quality appraisal

    Initially the full text of all documents included following initial screening will be read in full and screened against the inclusion criteria. The same consistency check and dispute resolution process as described in step 2 will be used. The next stage is to determine if documents contain relevant data and are of sufficient rigour to be included in the review.55 62 In a realist review, rigour is defined as ‘whether the methods used to generate the relevant data are credible and trustworthy’.62 Pawson’s55 process and publication standards56 for conducting a realist review will be followed and transparently reported, thus providing readers with sufficient information to make judgements about the plausibility and coherence of the programme theory developed.63

    Relevance of data

    MT will read in full all included full-text documents identified through screening for relevance to the initial programme theory. Documents of data that will likely contribute to the programme theory will most certainly have varying trustworthiness, for example some will be from primary research, while others will be from editorial/discussion pieces, which would fall under the evidence hierarchy as ‘opinion’. However, this ‘opinion’ may contribute to programme theory development when used alongside more data to build a coherent argument. Pawson55 refers to these as ‘nuggets’ of wisdom. This is a key difference in the realist approach and what counts as evidence to support theory is based more on judgements about its relevance.

    Trustworthiness of sources

    Given the nature of realist research, where we are seeking data that can help to corroborate, refute or refine an aspect of the programme theory, regardless of where or how the data has come about, it may be relevant. However, as this is research when data is deemed relevant in the first instance, the trustworthiness of the data will be considered. It will be assumed that any empirical data is unlikely to be fabricated and some kind of method has been used to gather the data. However, if no methods have been used to obtain data such as from an opinion piece, it will be treated with scepticism and additional data will be sought from other included documents; this will mean the CMOC in which the ‘less’ trustworthy data is used is supported by additional data from other sources. Where this is not possible, data of limited trustworthiness will be included if it can contribute to the programme theory in some way (ie, a nugget of wisdom). In this instance the plausibly of the arguments used to support the CMOC will be considered.62 Excel spreadsheets will be used to keep a detailed record of all sources used to build the CMOCs and programme theory. A table of all sources that have been drawn on will be transparently reported, along with details about the nature of each source. This information will help the reader to make judgements about the plausibility and trustworthiness of the data used and arguments that underpin the CMOCs and programme theory.

    Plausibility and coherence of the programme theory

    Any claims made on the plausibility of the programme theory will be based on both trustworthiness of data and coherence of arguments underpinning the programme theory. In realist research the coherence of the arguments underpinning the programme theory is used to judge its plausibility. To make judgement on coherence of the programme theory ‘inference to the best explanation’ will be used. Haig and Evers63 explain ‘inference to the best explanation’ means a theory is more likely to have coherence if it offers ‘good’ explanations. Taking this into consideration, we will use the following criteria drawn from ‘inference to best explanation’ to judge the coherence of the programme theory, namely: consilience (the theory’s ability to detail as much as possible of the theory); simplicity (the theory does not require specific assumptions to explain the data, rather the theory is simple) and lastly; analogy (the theory aligns with what is already known including relevant substantive theory).62

    Details on how a decision on rigour was reached will be documented for transparency. A random subsample (10%) of documents MT will have judged as being of relevance and demonstrating rigour, will be checked for consistency by a second member (GW) of the review team. Given that 90% of gathered documents will be determined by MT, it is predicted uncertainty will arise at some point; in these instances further discussion/joint reading by a second reviewer (GW) and/or the wider review team will occur until a decision has been reached.64 This process will be recorded for transparency.

    Step 4: extracting and organising the data

    All documents will be uploaded onto the NVivo QRS International qualitative data analysis tool and again read in full. Analysis will be directed by seeking to interpret and explain why success or failure occurs at each step of using the NEWS2. Initial coding will be informed by the different elements of the initial programme theory, where tentative CMOCs will be developed using inductive and deductive logic. Inductive logic draws conclusions from multiple observations thus it builds theory from observations,51 thus coding in the form of CMOCs will come from analysing the literature.65 Deductive logic starts from theory and examines propositions by determining whether associations match expectations,51 therefore, these are the codes that will be developed from the initial programme theory, stakeholder input and exploratory literature searches.65

    As the data extraction progresses rereading of documents is probable as new concepts will emerge and a certain aspect of one document may contribute to the refined theory across several areas. Stakeholders will be consulted at this point for feedback on the developing programme theory. All data used for initial refinement of programme theory will be recorded for transparency.50 As this step will be done exclusively by MT, to allow for consistency a random subsample (10%) will be reviewed by a second reviewer (GW). Any disagreements will be discussed until resolved and recorded for transparency.65 If needed, MO will be approached to help resolve any remaining disagreement. This process provides an opportunity to check there is consistency among the research team of how the data are being interpreted.

    Step 5: synthesising the data

    Data synthesis will have already begun in parallel with step 4, markedly it is not a linear one document at a time process. A realist logic of analysis will be used to interrogate the data, to develop and test the initial programme theory. To do this, we will move between the data and the process of analysis. The data will already be categorised as per tentative CMOCs, therefore, as we add data to develop, refine and test them, feedback will also be taken on board from the stakeholders to ensure the programme theory is developing in line with the reality of clinical practice. To synthesise the data, MT will follow an iterative process, consisting of analysing examples, refining the programme theory and further searches to test specific elements of the programme theory (as needed). Pawson55 describes synthesis using a realist logic as ‘accumulating explanation’, whereby the reviewer is involved in ‘juxtaposing, adjudicating, reconciling, consolidating and situating the evidence’. To operationalise this and elicit Pawson’s process in more detail, we will follow the steps outlined by Papoutsi et al,66 as presented in box 1.

    Box 1

    A realist logic of analysis66

    Relevance

    • Determine if the data (either some or all) in a document are deemed as relevant, may be of relevance to the programme theory or context–mechanism–outcome–configurations (CMOCs).

    • Establish if there are data that inform the relationship between the C’s, M’s or O’s or the ‘place’ of a CMOC within a programme theory.

    Judgements about trustworthiness and rigour

    • Decide if the data are sufficiently trustworthy to justify amending the programme theory.

    Decisions on trustworthiness will be made as outlined in step 3.

    Interpretation of meaning

    • When a section of the document is deemed to be relevant and trustworthy, determine if it provides data that may be interpreted as a context, mechanism or outcome.

    Interpretations and judgements about CMOCs

    • Identify either the partial or complete CMOC for the data. Then establish if there are data to develop the CMOCs within the said document or in other included documents. If so, identify the relevant data from across all other documents and consider how the CMOC relates to other CMOCs that have been developed.

    Interpretations and judgements about programme theory

    • Establish how the CMOC (either full or partial) relates to the programme theory. Also, within the same said document, judge if there are any data that informs how the CMOC relates to the programme theory.

    • If not, establish if there is any relevant data in other documents, if so which ones and establish if it warrants changing the programme theory.

    To work out what is functioning as a context or mechanism, we will be thinking in configurations. We will initially identify an outcome of interest within the programme theory and then work ‘backwards’ to the mechanism and ultimately the context. We will draw on our interpretations of the data within the included documents to help do this. Mechanisms are often hidden and/or may be difficult to articulate, therefore, retroductive reasoning will be used to infer and elaborate on mechanisms. Retroductive reasoning involves identifying the concealed causal forces that lie behind the uncovered patterns or changes in those patterns.51 This will involve going repeatedly from the data to theory, to refine explanations of outcomes identified. The relationship between contexts, mechanisms and outcomes within individual studies and across different sources will be identified. It is presumed that inferred mechanisms from one document can help explain the way contexts influences outcomes in another document. Data from various sources are likely to be required to develop CMOCs, as it is unlikely that all elements will be present in one document alone.

    Use of substantive theory

    It is important to theorise how specific contexts trigger particular mechanisms and thus outcomes67; use of substantive theory can help with this. In a realist review, substantive theory refers to an established theory operating in different disciplines or domains.51 Thus, by using substantive theory it may help understanding of the evolving CMOC patterns, hence aiding their development and possibly help situate the causal explanation provided by the CMOCs with what is already known from previous research.65 The final work will present the programme theory as refined CMOCs and a narrative explanation of them.

    Ethics and dissemination

    Ethics

    Ethical approval is not required for the study as it is secondary research. Ethical approval is not required for stakeholders as they are not research participants, rather they are engaged and involved with the review design and dissemination.68

    Step 6: disseminating the findings

    The review will identify how the NEWS2 may work well in one context but not another, therefore, implementation may involve alterations in practice or policies based on the setting. The review will uncover the complex and inter-related elements of the programme theory; therefore, stakeholders will be consulted on how best to apply these insights to varied NHS settings and practice. Findings will be published in a peer-reviewed journal. Findings will also be shared at conferences. Studies have identified that registered nurses’ engagement with evidence-based healthcare can be limited,69 70 therefore, seminars will also be held at NHS sites across southeast England (and wider if possible) to share findings. The findings will be key in providing policy makers with insight on how to facilitate successful implementation of the NEWS2 in clinical practice. In addition, for educators who deliver courses in the recognising and responding to patient deterioration, accessible and user-friendly synopses of the findings will be shared with existing networks and on social media platforms.

    Ethics statements

    Patient consent for publication

    References

    1. ↵
      1. National Confidential Enquiry into Patient Outcome and Death
      . Emergency admissions: a journey in the right direction? 2007. Available: https://www.ncepod.org.uk/reports.html
    2. ↵
      1. National Confidential Enquiry into Patient Outcome and Death
      . Inspiring change a review of the quality of care provided to patients receiving acute non-invasive ventilation, 2017. Available: https://www.ncepod.org.uk/reports.html [Accessed 14 Jan 2022].
    3. ↵
      1. Department of Health
      . Comprehensive critical care: a review of adult critical care services, 2000. Available: http://webarchive.nationalarchives.gov.uk/+/http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4006585 [Accessed 10 Jan 2022].
    4. ↵
      1. National Institute for Health and Care Excellence
      . Surveillance report, acutely ill adults in hospital: recognising and responding to deterioration, 2016. Available: https://www.nice.org.uk/guidance/cg50/resources/surveillance-report-2016-acutely-ill-adults-in-hospital-recognising-and-responding-to-deterioration-2007-nice-guideline-cg50-2419022845/chapter/Surveillance-decision?tab=evidence [Accessed 10 Jan 2022].
    5. ↵
      1. National Institute for Health and Care Excellence
      . Acutely ill adults in hospital: recognising and responding to deterioration, 2007. Available: https://www.nice.org.uk/guidance/cg50/resources/acutely-ill-adults-in-hospital-recognising-and-responding-to-deterioration-pdf-975500772037 [Accessed 05 Jan 2022].
    6. ↵
      1. Buist M,
      2. Bernard S,
      3. Nguyen TV, et al
      . Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation 2004;62:137–41.doi:10.1016/j.resuscitation.2004.03.005pmid:http://www.ncbi.nlm.nih.gov/pubmed/15294398
      OpenUrlCrossRefPubMedWeb of Science
    7. ↵
      1. Kause J,
      2. Smith G,
      3. Prytherch D, et al
      . A comparison of antecedents to cardiac arrests, deaths and emergency intensive care admissions in Australia and New Zealand, and the United Kingdom--the ACADEMIA study. Resuscitation 2004;62:275–82.doi:10.1016/j.resuscitation.2004.05.016pmid:http://www.ncbi.nlm.nih.gov/pubmed/15325446
      OpenUrlCrossRefPubMedWeb of Science
    8. ↵
      1. McQuillan P,
      2. Pilkington S,
      3. Allan A, et al
      . Confidential inquiry into quality of care before admission to intensive care. BMJ 1998;316:1853–8.doi:10.1136/bmj.316.7148.1853pmid:http://www.ncbi.nlm.nih.gov/pubmed/9632403
      OpenUrlAbstract/FREE Full Text
    9. ↵
      1. DeVita MA,
      2. Smith GB,
      3. Adam SK, et al
      . "Identifying the hospitalised patient in crisis"--a consensus conference on the afferent limb of rapid response systems. Resuscitation 2010;81:375–82.doi:10.1016/j.resuscitation.2009.12.008pmid:http://www.ncbi.nlm.nih.gov/pubmed/20149516
      OpenUrlCrossRefPubMedWeb of Science
    10. ↵
      1. Jones D,
      2. Mitchell I,
      3. Hillman K, et al
      . Defining clinical deterioration. Resuscitation 2013;84:1029–34.doi:10.1016/j.resuscitation.2013.01.013pmid:http://www.ncbi.nlm.nih.gov/pubmed/23376502
      OpenUrlPubMed
    11. ↵
      1. Australian Commission on Safety and Quality in Health Care, Vital signs
      . The state of safety and quality in Australian health care, 2016. Available: https://www.safetyandquality.gov.au/sites/default/files/migrated/Vital-Signs-2016-PDF.pdf [Accessed 10 Jan 2020].
    12. ↵
      1. Health Information and Quality Authority
      . General guidance on the National standards for safer better healthcare, 2012. Available: https://www.hiqa.ie/sites/default/files/2017-01/Safer-Better-Healthcare-General-Guidance.pdf [Accessed 11 Jan 2022].
    13. ↵
      1. Berwick DM,
      2. Calkins DR,
      3. McCannon CJ, et al
      . The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA 2006;295:324.doi:10.1001/jama.295.3.324pmid:http://www.ncbi.nlm.nih.gov/pubmed/16418469
      OpenUrlCrossRefPubMedWeb of Science
    14. ↵
      1. Royal College of Physicians
      . National early warning score (news): Standarising the assessment of acute illness severity in the NHS, 2007. Available: https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2 [Accessed 11 Jan 2022].
    15. ↵
      1. Scott BM,
      2. Considine J,
      3. Botti M
      . Unreported clinical deterioration in emergency department patients: a point prevalence study. Australas Emerg Nurs J 2015;18:33–41.doi:10.1016/j.aenj.2014.09.002pmid:http://www.ncbi.nlm.nih.gov/pubmed/25441535
      OpenUrlPubMed
    16. ↵
      1. Donaldson LJ,
      2. Panesar SS,
      3. Darzi A
      . Patient-safety-related Hospital deaths in England: thematic analysis of incidents reported to a national database, 2010-2012. PLoS Med 2014;11:e1001667.doi:10.1371/journal.pmed.1001667pmid:http://www.ncbi.nlm.nih.gov/pubmed/24959751
      OpenUrlCrossRefPubMed
    17. ↵
      1. Churpek MM,
      2. Yuen TC,
      3. Edelson DP
      . Predicting clinical deterioration in the hospital: the impact of outcome selection. Resuscitation 2013;84:564–8.doi:10.1016/j.resuscitation.2012.09.024pmid:http://www.ncbi.nlm.nih.gov/pubmed/23022075
      OpenUrlCrossRefPubMed
    18. ↵
      1. Bapoje SR,
      2. Gaudiani JL,
      3. Narayanan V, et al
      . Unplanned transfers to a medical intensive care unit: causes and relationship to preventable errors in care. J Hosp Med 2011;6:68–72.doi:10.1002/jhm.812pmid:http://www.ncbi.nlm.nih.gov/pubmed/21290577
      OpenUrlCrossRefPubMed
    19. ↵
      1. Agency for Healthcare Research and Quality (AHRQ)
      . Patient safety network. patient safety primer: failure to rescue, 2017. Available: https://psnet.ahrq.gov/primers/primer/38/failure-to-rescue [Accessed 10 Jan 2022].
    20. ↵
      1. Royal College of Physicians
      . National early warning score (news): Standarising the assessment of acute illness severity in the NHS, 2012. Available: https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2 [Accessed 11 Jan 2022].
    21. ↵
      1. Kostakis I,
      2. Smith GB,
      3. Prytherch D, et al
      . The performance of the National early warning score and national early warning score 2 in hospitalised patients infected by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Resuscitation 2021;159:150–7.doi:10.1016/j.resuscitation.2020.10.039pmid:http://www.ncbi.nlm.nih.gov/pubmed/33176170
      OpenUrlCrossRefPubMed
    22. ↵
      1. Lalueza A,
      2. Lora-Tamayo J,
      3. de la Calle C
      . The early use of sepsis scores to predict respiratory failure and mortality in non-ICU patients with COVID-19. Rev Clin Esp 2022;222:293–8.doi:10.1016/j.rceng.2020.10.004pmid:http://www.ncbi.nlm.nih.gov/pubmed/35512908
      OpenUrlPubMed
    23. ↵
      1. Credland N,
      2. Dyson J,
      3. Johnson MJ
      . What are the patterns of compliance with early warning track and trigger tools: a narrative review. Appl Nurs Res 2018;44:133–45.doi:10.1016/j.apnr.2018.09.002pmid:http://www.ncbi.nlm.nih.gov/pubmed/30389058
      OpenUrlPubMed
    24. ↵
      1. Al-Moteri M,
      2. Plummer V,
      3. Cooper S, et al
      . Clinical deterioration of ward patients in the presence of antecedents: a systematic review and narrative synthesis. Aust Crit Care 2019;32:411–20.doi:10.1016/j.aucc.2018.06.004pmid:http://www.ncbi.nlm.nih.gov/pubmed/30025983
      OpenUrlPubMed
    25. ↵
      1. Olsen SL,
      2. Søreide E,
      3. Hillman K, et al
      . Succeeding with rapid response systems - a never-ending process: A systematic review of how health-care professionals perceive facilitators and barriers within the limbs of the RRS. Resuscitation 2019;144:75–90.doi:10.1016/j.resuscitation.2019.08.034pmid:http://www.ncbi.nlm.nih.gov/pubmed/31525405
      OpenUrlPubMed
    26. ↵
      1. Treacy M,
      2. Caroline Stayt L
      . To identify the factors that influence the recognizing and responding to adult patient deterioration in acute hospitals. J Adv Nurs 2019;75:3272–85.doi:10.1111/jan.14138pmid:http://www.ncbi.nlm.nih.gov/pubmed/31241199
      OpenUrlPubMed
    27. ↵
      1. Smith D,
      2. Francis JJ,
      3. Aitken LM
      . Developing a complex intervention for deteriorating patients using theoretical modelling (decide study): study protocol. J Adv Nurs 2019;75:2024–35.doi:10.1111/jan.14076pmid:http://www.ncbi.nlm.nih.gov/pubmed/31115082
      OpenUrlPubMed
    28. ↵
      1. McGaughey J,
      2. O'Halloran P,
      3. Porter S, et al
      . Early warning systems and rapid response to the deteriorating patient in hospital: a systematic realist review. J Adv Nurs 2017;73:2877–91.doi:10.1111/jan.13398pmid:http://www.ncbi.nlm.nih.gov/pubmed/28727184
      OpenUrlPubMed
    29. ↵
      1. Lee A,
      2. Bishop G,
      3. Hillman KM, et al
      . The medical emergency team. Anaesth Intensive Care 1995;23:183–6.doi:10.1177/0310057X9502300210pmid:http://www.ncbi.nlm.nih.gov/pubmed/7793590
      OpenUrlPubMedWeb of Science
    30. ↵
      1. Goldhill DR,
      2. Worthington L,
      3. Mulcahy A, et al
      . The patient-at-risk team: identifying and managing seriously ill ward patients. Anaesthesia 1999;54:853–60.doi:10.1046/j.1365-2044.1999.00996.xpmid:http://www.ncbi.nlm.nih.gov/pubmed/10460556
      OpenUrlCrossRefPubMedWeb of Science
    31. ↵
      1. Maharaj R,
      2. Raffaele I,
      3. Wendon J
      . Rapid response systems: a systematic review and meta-analysis. Crit Care 2015;19:254.doi:10.1186/s13054-015-0973-ypmid:http://www.ncbi.nlm.nih.gov/pubmed/26070457
      OpenUrlCrossRefPubMed
    32. ↵
      1. Hands C,
      2. Reid E,
      3. Meredith P, et al
      . Patterns in the recording of vital signs and early warning scores: compliance with a clinical escalation protocol. BMJ Qual Saf 2013;22:719–26.doi:10.1136/bmjqs-2013-001954pmid:http://www.ncbi.nlm.nih.gov/pubmed/23603474
      OpenUrlAbstract/FREE Full Text
    33. ↵
      1. Kolic I,
      2. Crane S,
      3. McCartney S, et al
      . Factors affecting response to national early warning score (news). Resuscitation 2015;90:85–90.doi:10.1016/j.resuscitation.2015.02.009pmid:http://www.ncbi.nlm.nih.gov/pubmed/25703784
      OpenUrlCrossRefPubMed
    34. ↵
      1. Smith DJ,
      2. Aitken LM
      . Use of a single parameter track and trigger chart and the perceived barriers and facilitators to escalation of a deteriorating ward patient: a mixed methods study. J Clin Nurs 2016;25:175–85.doi:10.1111/jocn.13104pmid:http://www.ncbi.nlm.nih.gov/pubmed/26769205
      OpenUrlPubMed
    35. ↵
      1. Odell M
      . Detection and management of the deteriorating ward patient: an evaluation of nursing practice. J Clin Nurs 2015;24:173–82.doi:10.1111/jocn.12655pmid:http://www.ncbi.nlm.nih.gov/pubmed/25039312
      OpenUrlPubMed
    36. ↵
      1. Ward D,
      2. Potter J,
      3. Ingham J, et al
      . Acute medical care. The right person, in the right setting--first time: how does practice match the report recommendations? Clin Med 2009;9:553–6.doi:10.7861/clinmedicine.9-6-553pmid:http://www.ncbi.nlm.nih.gov/pubmed/20095297
      OpenUrlAbstract/FREE Full Text
    37. ↵
      1. Cioffi J,
      2. Conwayt R,
      3. Everist L, et al
      . 'Patients of concern' to nurses in acute care settings: a descriptive study. Aust Crit Care 2009;22:178–6.doi:10.1016/j.aucc.2009.07.001pmid:http://www.ncbi.nlm.nih.gov/pubmed/19726207
      OpenUrlCrossRefPubMed
    38. ↵
      1. Fasolino T,
      2. Verdin T
      . Nursing surveillance and physiological signs of deterioration. Medsurg Nurs 2015;24:397–402.pmid:http://www.ncbi.nlm.nih.gov/pubmed/26863702
      OpenUrlPubMed
    39. ↵
      1. Leuvan CHV,
      2. Mitchell I
      . Missed opportunities? An observational study of vital sign measurements. Crit Care Resusc 2008;10:111–5.pmid:http://www.ncbi.nlm.nih.gov/pubmed/18522524
      OpenUrlPubMed
    40. ↵
      1. Mok W,
      2. Wang W,
      3. Cooper S, et al
      . Attitudes towards vital signs monitoring in the detection of clinical deterioration: scale development and survey of ward nurses. Int J Qual Health Care 2015;27:207–13.doi:10.1093/intqhc/mzv019pmid:http://www.ncbi.nlm.nih.gov/pubmed/25888564
      OpenUrlCrossRefPubMed
    41. ↵
      1. Loftus NW,
      2. Smith D
      . Investigating ward nurses’ responses to deteriorating patients. Nurs Stand 2019;34:76–82.doi:10.7748/ns.2019.e11020
      OpenUrl
    42. ↵
      1. Lydon S,
      2. Byrne D,
      3. Offiah G, et al
      . A mixed-methods investigation of health professionals' perceptions of a physiological track and trigger system. BMJ Qual Saf 2016;25:688–95.doi:10.1136/bmjqs-2015-004261pmid:http://www.ncbi.nlm.nih.gov/pubmed/26453635
      OpenUrlAbstract/FREE Full Text
    43. ↵
      1. Endacott R,
      2. Kidd T,
      3. Chaboyer W, et al
      . Recognition and communication of patient deterioration in a regional Hospital: a multi-methods study. Aust Crit Care 2007;20:100–5.doi:10.1016/j.aucc.2007.05.002pmid:http://www.ncbi.nlm.nih.gov/pubmed/17627836
      OpenUrlCrossRefPubMed
    44. ↵
      1. Chua WL,
      2. See MTA,
      3. Legio-Quigley H, et al
      . Factors influencing the activation of the rapid response system for clinically deteriorating patients by frontline ward clinicians: a systematic review. Int J Qual Health Care 2017;29:981–98.doi:10.1093/intqhc/mzx149pmid:http://www.ncbi.nlm.nih.gov/pubmed/29177454
      OpenUrlPubMed
    45. ↵
      1. Connell CJ,
      2. Endacott R,
      3. Jackman JA, et al
      . The effectiveness of education in the recognition and management of deteriorating patients: a systematic review. Nurse Educ Today 2016;44:133–45.doi:10.1016/j.nedt.2016.06.001pmid:http://www.ncbi.nlm.nih.gov/pubmed/27429343
      OpenUrlPubMed
    46. ↵
      1. Duff B,
      2. Massey D,
      3. Gooch R, et al
      . The impact of a multimodal education strategy (the DeTER program) on nurses’ recognition and response to deteriorating patients. Nurse Educ Pract 2018;31:130–5.doi:10.1016/j.nepr.2018.05.011
      OpenUrl
    47. ↵
      1. Smith D,
      2. Cartwright M,
      3. Dyson J, et al
      . Patterns of behaviour in nursing staff actioning the afferent limb of the rapid response system (rrs): a focused ethnography. J Adv Nurs 2020;76:3548–62.doi:10.1111/jan.14551pmid:http://www.ncbi.nlm.nih.gov/pubmed/32996620
      OpenUrlPubMed
    48. ↵
      1. Pawson R,
      2. Greenhalgh T,
      3. Harvey G, et al
      . Realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy 2005;10 Suppl 1:21–34.doi:10.1258/1355819054308530pmid:http://www.ncbi.nlm.nih.gov/pubmed/16053581
      OpenUrlPubMed
    49. ↵
      1. Rycroft-Malone J,
      2. McCormack B,
      3. Hutchinson AM, et al
      . Realist synthesis: illustrating the method for implementation research. Implement Sci 2012;7:33.doi:10.1186/1748-5908-7-33pmid:http://www.ncbi.nlm.nih.gov/pubmed/22515663
      OpenUrlCrossRefPubMed
    50. ↵
      1. Wong G,
      2. Greenhalgh T,
      3. Westhorp G, et al
      . RAMESES publication standards: realist syntheses. BMC Med 2013;11:21.doi:10.1186/1741-7015-11-21pmid:http://www.ncbi.nlm.nih.gov/pubmed/23360677
      OpenUrlCrossRefPubMed
    51. ↵
      1. The RAMESES II Project
      . Retroduction in realist evaluation, 2017. Available: http://www.ramesesproject.org/media/RAMESES_II_Retroduction.pdf [Accessed 20 Nov 2021].
    52. ↵
      1. NHS England
      . Resources to support the safe adoption of the revised national early warning score (NEWS2), 2018. Available: https://www.england.nhs.uk/2018/04/safe-adoption-of-news2/ [Accessed 20 Jan 2022].
    53. ↵
      1. Merton R
      . On theoretical sociology. five essays, old and new. New York: The Free Press, 1967: 39–72.
    54. ↵
      1. Pawson R
      . The science of evaluation a realist manifesto. London: Sage Publications, 2013: 88–91.
    55. ↵
      1. Pawson R
      . Evidence-Based policy a realist perspective. London: Sage Publications, 2006: 73–121.
    56. ↵
      1. Wong G,
      2. Greenhalgh T,
      3. Westhorp G, et al
      . Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (realist and Meta-narrative evidence syntheses – evolving standards) project. Health Serv Deliv Res 2014;2:1–252.doi:10.3310/hsdr02300
      OpenUrl
    57. ↵
      1. Wong G,
      2. Brennan N,
      3. Mattick K, et al
      . Interventions to improve antimicrobial presCribing of doctors in training: the impact (improving antimicrobial presCribing of doctors in training) realist review. BMJ Open 2015;5:e009059.doi:10.1136/bmjopen-2015-009059pmid:http://www.ncbi.nlm.nih.gov/pubmed/26493460
      OpenUrlAbstract/FREE Full Text
    58. ↵
      1. The RAMESES Project
      . Quality standards for realist synthesis, 2014. Available: http://www.ramesesproject.org/media/RS_qual_standards_researchers.pdf [Accessed 30 Dec 2021].
    59. ↵
      1. Abrams R,
      2. Wong G,
      3. Mahtani KR, et al
      . Understanding the impact of delegated home visiting services accessed via general practice by community-dwelling patients: a realist review protocol. BMJ Open 2018;8:e024876.doi:10.1136/bmjopen-2018-024876pmid:http://www.ncbi.nlm.nih.gov/pubmed/30429150
      OpenUrlAbstract/FREE Full Text
    60. ↵
      1. Greenhalgh T,
      2. Robert G,
      3. Bate P
      . How to spread good ideas: a systematic review of the literature on diffusion, dissemination and sustainability in health service delivery and organisation, 2004. Available: https://www.cs.kent.ac.uk/people/staff/saf/share/great-missenden/reference-papers/Overviews/NHS-lit-review.pdf [Accessed 20 Dec 2021].
    61. ↵
      1. Moher D,
      2. Liberati A,
      3. Tetzlaff J, et al
      . Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097.doi:10.1371/journal.pmed.1000097pmid:http://www.ncbi.nlm.nih.gov/pubmed/19621072
      OpenUrlCrossRefPubMed
    62. ↵
      1. Wong G
      . Data gathering in realist reviews: looking for needles in haystacks. In: Emmel N, Greenhalgh J, Manzano A, et al., eds. Doing realist research. London: Sage Publications, 2018: 131–46.
    63. ↵
      1. Haig B,
      2. Evers C
      . Realist Inquiry in Social Science. London: Sage, 2019: 64–7.
    64. ↵
      1. Duddy C,
      2. Wong G
      . Explaining variations in test ordering in primary care: protocol for a realist review. BMJ Open 2018;8:e023117.doi:10.1136/bmjopen-2018-023117pmid:http://www.ncbi.nlm.nih.gov/pubmed/30209159
      OpenUrlAbstract/FREE Full Text
    65. ↵
      1. Price T,
      2. Brennan N,
      3. Wong G, et al
      . Remediation programmes for practising doctors to restore patient safety: the restore realist review. Health Serv Deliv Res 2021;9:1–116.doi:10.3310/hsdr09110
      OpenUrl
    66. ↵
      1. Papoutsi C,
      2. Mattick K,
      3. Pearson M, et al
      . Interventions to improve antimicrobial prescribing of doctors in training (impact): a realist review. Health Serv Deliv Res 2018;6:1–136.doi:10.3310/hsdr06100
      OpenUrl
    67. ↵
      1. Pawson R,
      2. Manzano-Santaella A
      . A realist diagnostic workshop. Evaluation 2012;18:176–91.doi:10.1177/1356389012440912
      OpenUrlCrossRefWeb of Science
    68. ↵
      1. National Institute for Health Research
      . A brief guide to public involvement in funding applications, 2020. Available: https://www.nihr.ac.uk/documents/a-brief-guide-to-public-involvement-in-funding-applications/24162#Ethical_approval [Accessed 20 Jan 2022].
    69. ↵
      1. Saunders H,
      2. Stevens KR,
      3. Vehviläinen-Julkunen K
      . Nurses' readiness for evidence-based practice at Finnish university hospitals: a national survey. J Adv Nurs 2016;72:1863–74.doi:10.1111/jan.12963pmid:http://www.ncbi.nlm.nih.gov/pubmed/27020797
      OpenUrlPubMed
    70. ↵
      1. Moore F,
      2. Tierney S
      . What and how … but where does the why fit in? the disconnection between practice and research evidence from the perspective of UK nurses involved in a qualitative study. Nurse Educ Pract 2019;34:90–6.doi:10.1016/j.nepr.2018.11.008
      OpenUrl

    Supplementary materials

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Footnotes

    • Twitter @michelletreacy1

    • Contributors MT conceptualised the study. MT designed and wrote the protocol manuscript, GW and MO contributed to the protocol development. GW provided methodological advice and contributed to editing the final version. NR provided document searching advice. All authors read and approved the final manuscript.

    • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests GW is deputy chair of the UK’s National Institute of Health Research Health Technology Assessment Prioritisation Committee: Integrated Community Health and Social Care Panel (A) and a member of Methods Group (A).

    • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.