Article Text

Download PDFPDF

Measuring patient-centred system performance: a scoping review of patient-centred care quality indicators
  1. Maria-Jose Santana1,2,
  2. Sadia Ahmed2,
  3. Diane Lorenzetti1,3,
  4. Rachel J Jolley1,
  5. Kimberly Manalili1,
  6. Sandra Zelinsky1,
  7. Hude Quan1,
  8. Mingshan Lu1,4
  1. 1 Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
  2. 2 Department of Pediatrics, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
  3. 3 Health Sciences Library, University of Calgary, Calgary, Alberta, Canada
  4. 4 Department of Economics, University of Calgary, Calgary, Alberta, Canada
  1. Correspondence to Dr Maria-Jose Santana; mjsantan{at}ucalgary.ca

Abstract

Objectives The shift to the patient-centred care (PCC) model as a healthcare delivery paradigm calls for systematic measurement and evaluation. In an attempt to develop patient-centred quality indicators (PC-QIs), this study aimed to identify quality indicators that can be used to measure PCC.

Methods Design: scoping review. Data Sources: studies were identified through searching seven electronic databases and the grey literature. Search terms included quality improvement, quality indicators, healthcare quality and PCC. Eligibility Criteria: articles were included if they mentioned development and/or implementation of PC-QIs. Data Extraction and Synthesis: extracted data included study characteristics (country, year of publication and type of study/article), patients’ inclusion in the development of indicators and type of patient populations and point of care if applicable (eg, in-patient, out-patient and primary care).

Results A total 184 full-text peer-reviewed articles were assessed for eligibility for inclusion; of these, 9 articles were included in this review. From the non–peer-reviewed literature, eight documents met the criteria for inclusion in this study. This review revealed the heterogeneity describing and defining the nature of PC-QIs. Most PC-QIs were presented as PCC measures and identified as guidelines, surveys or recommendations, and therefore cannot be classified as actual PC-QIs. Out of 502 ways to measure PCC, only 25 were considered to be actual PC-QIs. None of the identified articles implemented the quality indicators in care settings.

Conclusion The identification of PC-QIs is a key first step in laying the groundwork to develop evidence-based PC-QIs. Research is needed to continue the development and implementation of PC-QIs for healthcare quality improvement.

  • patient-centred care
  • quality indicators
  • healthcare quality
  • quality improvement

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

View Full Text

Statistics from Altmetric.com

Strengths and limitation of this study

  • Transparent and rigorous search strategy.

  • Involvement of patient partner in the study.

  • Study informed by a previously published protocol.

  • Search strategy using only English terms.

  • We did not assess the quality of the measures and/or indicators identified.

Introduction 

Patient-centred care (PCC) is one of the six dimensions of healthcare and was formally described by the Institute of Medicine in 2001 as healthcare that respects and responds to the preferences, needs and values of the individual patients throughout all healthcare decisions. 1 PCC is an approach that has become central to policies and programming to improve healthcare efficiencies and address patient safety issues.2

PCC is a model in which healthcare providers are encouraged to partner with patients and families to design and deliver individualised care. PCC models have been linked to positive patient experiences and improved outcomes, such as increased adherence to care and treatment.3–5 In the literature, a PCC approach has been found to benefit patients and healthcare organisations in reducing costs, for instance through decreasing the length of hospital stays and readmission rates.6 7 However, PCC is conceptualised differently among different stakeholders, impacting effective implementation in care settings.8 The adoption of a PCC model requires first, the identification of appropriate indicators to measure the quality of PCC, and second, the assessment of the impact of delivering PCC on healthcare system and patient outcomes.9

Quality indicators are tools that measure system performance and healthcare quality, and demonstrate the extent to which improvement efforts have led to desirable change, or contributed to unintended results.10 As identified from the Agency for Healthcare Research and Quality (AHRQ), a quality indicator consists of a specific aspect of quality being captured, and a method for how concepts of quality are captured (which includes data source, measure type, observable event, specification and risk adjustment).11 While various quality indicators have been developed to measure healthcare safety, effectiveness and access,12 they typically do not incorporate the priorities and experiences of patients and family caregivers. To truly evaluate the impact of patient-centredness, indicators must reflect the patient and family caregiver perspective.

This scoping review aimed to synthesise existing literature on quality indicators used in the evaluation of PCC. This review was guided by the questions: ‘What PC-QIs have been developed to measure patient-centred care?’ ‘How are patient-centred quality indicators defined?’ and ‘ Have existing PC-QIs been implemented and evaluated across various points-of-care settings, processes of care and at the systems level to measure patient-centred care?’ The information gained from this study will inform the development of PCC quality indicators that could be implemented to drive healthcare improvement valued by patients and families.

Methods

We employed a scoping review protocol that was previously published,13 using methodology based on Arksey and O’Malley’s scoping review framework14 and Levac et al’s methodological enhancement.15 We searched the peer-reviewed published and grey literature for either proposed or existing quality indicators that have been developed and/or implemented across various points-of-care settings to measure PCC. For this scoping review, the AHRQ16 definition of a quality indicator was adapted to incorporate a patient and family focus. Specifically, a PC-QI was defined as the unit of measurement of healthcare system, organisational or individual performance, that quantifies patients’ and families’ experiences with the care received and the experience of any individual who needs to contact with healthcare services. In contrast, PCC measures are in the form of a survey, guideline or recommendation.

Data sources and search strategy

In order to identify studies assessing quality indicators for PCC, search strategies were developed that combined terms from two concepts: PCC and PC-QIs (online supplementary file 1). The Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), EMBASE, MEDLINE, PsycINFO, Social Services Abstracts and Social Work Abstracts were searched from inception to May 2017. A search of the Google search engines, and the websites of relevant quality improvement and patient-centric organisations enabled the identification of relevant grey literature. Grey literature searches were conducted in duplicate by both a researcher and patient partner. The reference lists of included studies were also scanned to identify any other studies of relevance.

Supplementary data

Citation management

All references were imported into a custom-written Java software application, Synthesis for reference management and data collection.17 Duplicate citations were removed automatically by the software, with any mismatched duplicates removed manually if detected.

Study selection and data abstraction

To be eligible for inclusion, the study/article had to (1) identify quality indicators for PCC and/or (2) identify PC-QI in performance measurement (eg, validation). The title and abstract of each citation identified was screened for eligibility independently by two reviewers (M-JS and ML). The full text of any abstract selected by either reviewer was retrieved and assessed for eligibility. Any full-text articles for which there was inter-rater discord were reviewed a second time, and final disagreements about study eligibility were resolved through discussion.

Data collection and classification of indicators

A data collection tool was developed and tested on a sample of papers to determine its practicality prior to the full review (online supplementary file 2). Extracted data included study characteristics (country, year of publication and type of study/article), patients’ inclusion in the development of indicators and type of patient populations and point of care if applicable (eg, in-patient, out-patient and primary care).

Supplementary data

All extracted indicators were classified collaboratively by two authors (M-JS and SA) according to a person-centred care framework18 developed by the team and guided by the Donabedian model of quality of care.19 This framework provides a roadmap for healthcare systems to implement and measure PCC at the level of structure (the healthcare system/organisational level), process (the patient-healthcare provider interaction level) and outcome (the patient-health care provider and healthcare systems interaction level).18

Patient involvement

Levac et al recommend the involvement of stakeholders in the scoping review methodology.15 We worked closely with our patient-research partner (SZ) in the design of the study who also aided in the search strategy. Our patient research partner aided in the clarification of research questions as well. The involvement of patient research partners allows for suggestions of additional references as well as the provision of insights beyond those in the literature.15

Results

A total of 36 643 citations were retrieved, and on duplicate removal, a total of 16 173 citations were reviewed at the title and abstract stage for inclusion (figure 1). A total 184 full-text peer-reviewed articles were assessed for eligibility for inclusion; of these, 9 articles were included in this review (figure 1). From the non–peer-reviewed literature, following the title and document review, eight documents met the criteria for inclusion in this study (figure 1). The most common reason for excluding articles (n=15 905) was the absence of indicators for PCC.

Figure 1

Flow diagram for study inclusion. PC-QIs, patient-centred quality indicators.

Article description

Table 1 presents the characteristics of the full-text articles included in the study. The years of publication ranged from 1996 to 2015. Included studies were published in Belgium (n=1), USA (n=2), Canada (n=3), UK (n=4), the Netherlands (n=4) and three sources did not include a country of publication. Sources were varied and included original peer-reviewed research (n=8), guest editorial (n=1), reports (n=4), discussion paper (n=1), working paper (n=1), literature review (n=1) and a website (n=1). The study populations varied in the peer-reviewed literature (eg, cancer, fertility care and home parenteral nutrition, HPN) and no specific populations were identified in the non–peer-reviewed literature.

Table 1

Characteristics of articles on patient-centred quality indicators

What PC-QIs have been developed to measure patient centred care?

From the sources included, a total of 502 ways of measuring PCC were explicitly identified as quality indicators by studies’ authors. However, only 25 were classified as actual indicators by our research team.

PCC measurement varied between articles. While all sources used the term ‘quality indicator’, not all were quantifiable and measurable. Most sources presented quality indicators as guidelines or recommendations for healthcare practitioners. Wensing et al presented indicators as survey items, such as ‘Does the GP pay attention to patients’ needs?’20 Actual indicators were presented as percentages and proportions, and identified from six grey literature sources.21–26 For instance, one study outlined an example of a structure indicator—‘percent of nurses attending education sessions (orientation, organization professional development opportunities) on client-centred care’.25

Study populations included cancer patients (n=2), colonoscopy patients (n=1), HPN patients (n=1), chronically ill (n=1), fertility care (n=1) and assisted living support patients (n=1) (table 1). For the development of PCC measures, 7 studies used focus groups, interviews and/or consensus meetings, 10 studies included patients and family caregivers in the development of PCC measures and 1 article developed measures through the authors’ clinical and research work. Two sources developed ways to measure PCC from patient-reported experience surveys,24 27 and two studies used a framework.25 28

Some studies grouped ways to measure PCC according to domains of PCC that were based on previously defined frameworks or through consensus (eg, access to care, communication and information). Domains identified from the person-centred care framework are categorised according to structure, process and outcome.18 Here table 2 presents examples of measuring PCC classified according to the person-centred care framework,18 and table 3 presents the actual indicators classified according to the same framework.18

Table 2

Examples of patient-centred care (PCC) measurement classified according to the person-centred care framework18

Table 3

Identified PC-QIs from the literature classified according to the person-centred care framework as actual indicators18

How are PC-QIs defined?

The definition of a PC-QI was not clearly articulated in the studies identified (table 4). Ten of the included studies provided no such definition of a quality indicator (table 4). Sources where the definition of a quality indicator was mentioned defined indicators as something to be measured, and developed through consensus (table 4).23 29–31 Of those four sources where the definition of a PC-QI was clear, two included actual indicators.21 23 The National Health Service report described indicators as ‘items that patients, carers and professionals believed were important in achieving the benchmarks of best practice’.22

Table 4

Definition of quality indicator used by authors

Have the existing PC-QIs been implemented and evaluated across various points-of-care settings, processes of care and at the system level to measure PCC?

None of the articles mentioned actual implementation of indicators in the settings for which they were developed. Similarly, many of the sources (15/17) did not evaluate the indicators according to any set criteria. The two studies that did evaluate indicators used two different approaches.28 30 The study by Ouwens et al assessed guidelines for psychometric characteristics and only 26 out of 56 guidelines were found to be reliable.30 The study by Carinci et al used a modified Delphi approach with expert Organization for Economic Co-operation and Development members to rate the PCC measures, using validity, reliability, relevance, actionability, international feasibility and international comparability as the criteria.28 Uphoff et al recommended using the Gol and Grimshaw model for evaluating indicators,31 while a future direction for Zimmerman et al was the evaluation of the indicators.32 The working paper by Kelley and Hurst presented criteria that can be used to select indicators.24 These included the importance of what is being measured (which includes policy importance), scientific soundness and feasibility of the measure.24

Discussion

This review specifically examined existing PC-QIs in the academic and grey literature. PCC has been increasingly adopted by many jurisdictions; however, this review revealed there to be gaps in the conceptualisation of PC-QIs. Out of the 17 articles that met the inclusion criteria, only 9 were peer reviewed, and looked at specific conditions. Additionally, the heterogeneity of the PCC literature relates to the variety of definitions on PC-QIs, and a diverse type of indicators developed for different patient population and care-settings. For instance, all included articles in the review used the term ‘indicator,’ but not all presented actual indicators as defined by the AHRQ.16

The absence of a standard definition of what a PC-QI is in the literature has posed challenges in identifying the literature sources for inclusion in this review. ‘Quality’ means different things to different people, and despite the standard definition of PCC by the Institute of Medicine,1 PCC continues to be operationalised and measured differently.33 Most sources identified in the literature did not explicitly define what a quality indicator is, which may explain the differences in approaches to indicator development. The absence of a definition for quality indicators results in inconsistencies for how an indicator should be presented and also what makes for a good indicator. Previous reviews have also found variability in quality indicator definitions, such as indicators for hip fracture patient care.34 The absence of a standard definition of PC-QIs poses concerns for standardised measurement of PCC, and for implementation of PC-QIs in healthcare settings.

In compliance with quality improvement agencies, quality councils and organisations such as the AHRQ, quality indicators should be presented as a unit of measurement—as a percentage or proportion.16 Our review revealed inconsistencies in the definition of indicators. Only few sources in the non–peer-reviewed literature included PC-QIs as quantifiable units, such as percentages, incorporating a numerator and denominator in the unit of measurement.35 Most of the identified indicators were actually domains included in PCC measures and guidelines. The lack of defined units of measurement impedes comparisons across facilities, and benchmarking, and does not allow for longitudinal evaluation and overall measurement of care that is patient-centred. Without this unit of measurement for PC-QIs, it is difficult to target specific improvements needed for PCC.

The review revealed that when incorporating the patient and caregiver perspective in quality improvement, a difficulty exists in translating perceptions and subjective experiences into standardised objective indicators. Measures of well-being are both necessary and important to incorporating a PCC model of care. The study by Carr et al suggests that perceptions of health and its meaning vary between individuals and across time, as do their experiences and expectations of healthcare.36 In order to capture various perspectives on quality care, it is vital to include patients and families. Including the patient and family perspective is necessary to ensure quality PCC.

Additionally, this review found large variances for domains to categorise approaches to measuring PCC. In an attempt to organise our findings and understand the ways of measuring PCC, we used a previously published person-centred care framework18 to classify them into healthcare quality domains. From this classification, most strategies for measuring PCC were found to relate to domains associated with healthcare processes (eg, cultivating communication). These findings are consistent with the current measurement landscape, for instance trauma indicators,37 and AHRQ PC-QIs38 which mainly assess processes and outcomes. For PCC, structures, such as policies and education programmes can provide an important basis to improve PCC practice.18 39 Structure indicators provide the necessary foundations for the assessment of process and outcome indicators, for instance through creating a PCC culture, supporting the workforce to deliver PCC and providing an accommodating environment for patients.18 In this review, structure indicators were lacking.

Finally, there is scarce evidence in the literature on how to implement indicators for PCC, and how to evaluate their implementation. PCC measurement has, to date, primarily focused on specific disease conditions and healthcare sectors. However, recent initiatives (National Health Service) reveal a more generic approach to measurement (Family and Friend Test).40 In order to create a standardised set of PC-QIs, indicators must be developed across the continuum of care. Santana and Stelfox also found a lack of implementation of indicators in care settings in their review.37 Before indicators are implemented, they must be evaluated according to standard set criteria. What constitutes as a good indicator has been outlined by health quality organisations, such as National Quality Forum. As outlined by the National Quality Forum, quality indicators should be evaluated through a set criterion including importance, scientific acceptability, feasibility, and usability and use.41 Our review did not identify any studies where such evaluations were implemented. In the development and implementation of quality indicators, the guideline set by the National Quality Forum should be adhered to.

The gaps identified in the literature for PC-QIs provide directions for future research. First, there needs to be consensus on a standard definition of PC-QI to guide future measurement of PCC. Second, there is a need to develop a standard set of PC-QIs that could be implemented in various healthcare settings. Third, PC-QIs need to be evaluated according to a set criteria. Finally, PC-QIs need to be implemented across healthcare settings for monitoring and evaluation of PCC.

Strengths and limitations

Our scoping review used robust and transparent methods guided by a protocol previously published,13 and supported by a research librarian with expertise in knowledge synthesis and scoping reviews (DLL). We worked closely with our patient research partner (SZ) in the study design, research questions, search strategy and manuscript preparation.

This review may not have identified all relevant sources in the published and grey literature as we conducted the search using only English terms. As we are following the scoping review methodology, the quality of the studies was not assessed.

Conclusions

In summary, our review is the first to examine the literature pertaining to quality indicators that are patient-centric. Our findings will further the development of validated healthcare tools assessing healthcare quality from a patient-centred approach. Future research should focus on developing and refining PC-QIs that are ready to implement and evaluate following the criteria set forth by the National Quality Forum.41

Acknowledgments

We would like to acknowledge the contributions of Lisa Goodman, who provided support for the grey literature search for this scoping review.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
View Abstract

Footnotes

  • Patient consent for publication Not required.

  • Contributors M-JS conceived the study, and all authors identified key literature to be included in the review. M-JS led the drafting of the manuscript and key discussion points with support from DL, RJJ, SA, ML and KM. SA managed the design of the tables (with feedback from all authors), and management of references. All authors provided important intellectual contribution and guidance throughout the development of the manuscript. HQ, DL, SZ and ML provided guidance on the presentation of the findings and guidance on final revisions. All of the authors contributed to critical review and revisions to the manuscript, agreeing on the final version.

  • Funding M-JS secured funding from the M.S.I Foundation (Grant #886) based in Alberta, Canada. ML acknowledges the support from the Alberta’s Strategy for Patient Oriented Research (SPOR).

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data available.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.