Article Text

Original research
Measuring safety in older adult care homes: a scoping review of the international literature
  1. Stacey Rand1,
  2. Nick Smith1,
  3. Karen Jones1,
  4. Alan Dargan1,
  5. Helen Hogan2
  1. 1Personal Social Services Research Unit, University of Kent, Canterbury, Kent, UK
  2. 2Department of Health Services Research and Policy, London School of Hygiene & Tropical Medicine, London, UK
  1. Correspondence to Dr Stacey Rand; s.e.rand{at}kent.ac.uk

Abstract

Background Safety is a key concern in older adult care homes. However, it is a less developed concept in older adult care homes than in healthcare settings. As part of study of the collection and application of safety data in the care home sector in England, a scoping review of the international literature was conducted.

Objectives The aim of the review was to identify measures that could be used as indicators of safety for quality monitoring and improvement in older adult residential or nursing care homes.

Sources of evidence Systematic searches for journal articles published in English language from 1 January 1970, without restriction to the study location or country, were conducted in Web of Science, Scopus and PubMed on 28 July 2019.

Eligibility criteria Inclusion criteria were: peer-reviewed journal articles; qualitative or quantitative studies of older adult nursing and/or residential care homes; and related to any aspect of safety in care homes, including the safety of healthcare provision in the care home. A total of 45 articles were included after review of the title/abstract or full text against the inclusion criteria.

Charting methods Key information was extracted and charted. These findings were then mapped to the Safety Measurement and Monitoring Framework in healthcare (SMMF), adapted by the research team to reflect the care home context, to determine the coverage of different aspects of safety, as well as potential gaps.

Results and conclusions Systematic searches for journal articles published in English language from 1 January 1970, without restriction to the study location or country, were conducted in Web of Science, Scopus and PubMed on 28 July 2019. Inclusion criteria were: peer-reviewed journal articles; qualitative or quantitative studies of older adult nursing and/or residential care homes; and related to any aspect of safety in care homes, including the safety of healthcare provision in the care home.

A total of 45 articles were included after review of the title/abstract or full text against the inclusion criteria. Key information was extracted and charted. These findings were then mapped to the Safety Measurement and Monitoring Framework in healthcare (SMMF), adapted by the research team to reflect the care home context, to determine the coverage of different aspects of safety, as well as potential gaps.

The findings indicate that there are a range of available safety measures used for quality monitoring and improvement in older adult care homes. These cover all five domains of safety in the SMMF. However, there are potential gaps. These include user experience, psychological harm related to the care home environment, abusive or neglectful care practice and the processes for integrated learning. Some of these gaps may relate to challenges and feasibility of measurement in the care home context.

  • health & safety
  • quality in health care
  • health services administration & management
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The study is an international scoping review of safety indicators used in older adult care homes.

  • The scoping review was limited to measures reported in peer-reviewed literature, so it may not include safety indicators used at local or regional levels, especially in countries that do not have a national minimum dataset for care homes.

  • The psychometric properties and feasibility of data collection of the identified indicators were not evaluated.

Background

Safety is a key concern in older adult care homes. (By the term ‘care home’, we refer to organisations that provide accommodation and 24/7 personal care, eg. support with washing, dressing or taking medicines. It includes institutions staffed by care staff alone (known as residential homes) or with the support of one or more registered nurses on duty (known as nursing homes). Care homes, whether nursing or residential, are widely accepted as distinct from ‘extra care’, which refers to accommodation and on-site care that expects a greater degree of independent living (eg, assisted living facilities or continuing care retirement communities)). In the context of care homes, both residential and nursing care facilities, as in other health and care settings, safety broadly refers to the absence of preventable harm and the minimisation of unnecessary risk of harm to residents. Common types of physical harm in care homes include injuries as a result of falls, dehydration, pressure ulcers, urinary tract or other infections and harm related to failures in medicines management.1 Some of these harms may be a result of comorbidity and frailty of residents, which are risks to be managed by responsive and effective care, while other harms may be directly attributable to poor quality or neglectful care, such as omission of care activities or overtreatment. Likewise, some residents may feel unsafe, especially in adapting to the care home environment, or as a result of the behaviour of other residents,2–5 which are risks to be managed by care practice. They may also experience psychological harm due to avoidable unsafe care practice that is not respectful of personal dignity.

Improving safety is complex. Lessons from healthcare indicate that, although frontline staff are key to identifying problems and solutions, these activities need to be nested in organisations where leadership, culture and processes support quality improvement and where regional or national governance and regulation priorities and incentives are aligned.6 To improve the safety of older adult care homes, it is important to have ways of assessing key aspects of safety informative for quality improvement activity at the individual care home, care home group and regional or national level. Partly because the concept of safety is less well developed in older adult care homes7 compared with healthcare settings,8 patient safety in healthcare and various approaches to its assessment are adopted by social care. In doing so, however, it is important to carefully consider how healthcare settings differ from care home contexts, which then affects how safety is conceptualised and also considered in practice.

By contrast to other care settings, one of the key distinctive aspects of care homes is that they are places where people live. They are not fully institutional yet also do not offer the privacy of ‘home’, even though ‘homeliness’ is valued by residents.9 10 This introduces a tension between creating a ‘homely environment’ and also ensuring that residents are protected from risk of harm, like trip hazards or infection control risks presented by soft furnishings.11 Furthermore, the focus of the care provided is broader than clinical treatment. The purpose of care is to enable a person to live well by enabling choice, supporting everyday activity and maintaining personal dignity and respect for the person.12 13 The delivery of person-centred care focuses on individual preferences, wishes and values, and how to respond to those. There may be tensions between an individual’s preferences and their safety, or the preferences and safety of other residents. Because care homes residents tend to be at greater risk of harm, abuse or neglect, an important consideration in the delivery of care in residential homes is safeguarding, which refers to adults’ rights to live safely, free from harm, abuse and neglect. This is reflected in a sharp focus on safeguarding in this context.

Another consideration is the barriers faced by the care home sector that may make it difficult to embed a culture of reflective learning to drive quality improvement. These barriers vary by country, region or organisation, with differences due to care policy, workforce and cultural or organisational factors. In England, for example, the qualification standards and training opportunities are more limited for the social care workforce compared with the healthcare workforce. Only 68% of the social care workforce hold any form of relevant qualification.14 Therefore, it is arguably more important that the leadership sets the culture of practice, especially as it relates to quality and safety of care, as standards based on prior qualification, training or skills development may not be assumed. Other barriers include the relative isolation of care homes in England, especially for the approximately 30% of nursing homes in England that are not part of a chain or local authority led,15 and the relatively weak links with community healthcare, GPs and other local services. This may make it difficult to access these services on behalf of residents, as well as to work in partnership with those services to deliver good quality and safe care.

A first step towards developing a comprehensive and tailored approach to the assessment of safety in older adult care homes, which reflects the context and needs of the sector, is to understand what aspects of safety are currently measured and how these relate to the key concepts of safety derived from the healthcare setting. This will identify gaps in measurement and also additional context-specific areas where further measures may need to be developed or applied to inform decision making and quality improvement. To this end, a scoping review of international literature was undertaken to identify measures of safety used in older adult care homes.

This scoping review of the international literature was undertaken to identify safety indicators used in older adult care homes, especially those that are likely to inform decision making and quality or safety improvement. These indicators were mapped to the Safety Measurement and Monitoring Framework (SMMF),16 a framework of five dimensions relevant to safety monitoring and measurement (harm, reliability, sensitivity to operations, anticipation and preparedness, integration and learning) derived from the healthcare sector but being increasingly applied in care homes. This approach allowed assessment of how well concepts of safety in care homes mirrored those from healthcare and also any gaps in measurement. It took a broad view of safety measurement for quality improvement across different levels from the individual care home, to group, to regional or national level. The review was the initial phase of a wider National Institute for Health Research-funded study of the assessment of safety in care homes in England. The study will subsequently explore the feasibility and challenges of implementing a more systematic approach to collection and application of safety data in the care home sector in England using qualitative methods.

Methods

This study applied a five-stage framework for scoping reviews.17 Based on the research question (stage 1), systematic searches for articles published in English language, without restriction on location/country, from 1970 to 2019, was conducted in Web of Science, Scopus and PubMed on 28 July 2019 to identify literature on the measurement of safety in care homes and/or the application of safety indicators in research, evaluation of quality improvement within care homes. The search terms were “safety” and “care home” or “nursing home” or “residential home” and refined by ‘indicator’ (see online supplemental file). We chose to focus the searches on ‘safety’, as a more global term than ‘harm’, to capture wider concepts and measures suitable to the person-centred care residents, beyond a clinical or healthcare perspective. ‘Care home’ or ‘nursing home’ or ‘residential home’ were applied as terms recognised internationally to refer to residential adult care facilities. Related terms, like ‘residential facilities’, were not considered as they were too broad and included contexts outside of the scope of the review, like assisted living facilities. The selected time frame (1970–2019) was chosen to consider literature over a longer period to scope any developments in the evidence over that time; however, the majority of articles identified by the searches, and of the articles included in the review presented here, were published since 2000 (stage 2).

The abstract and/or full text of the papers identified through these searches were then each reviewed by two reviewers from the research team (SR, AD, KJ and NS). Articles were included if they were relevant to the care context (ie, nursing or residential care home for older adults) and topic (safety measurement or monitoring, concepts of safety). Only peer-reviewed journal articles were considered; no further quality constraints or evaluation were applied. The definition of safety included all aspects of safety in care homes, including the safety of healthcare provision, as well as the personal care provided by the care home. Both quantitative and qualitative studies, including research to identify or define concepts as an initial step in measure development, were included.

A total of 45 articles were included (see figure 1) (stage 3). The key information from each paper was then extracted into a summary chart format. The fields included author(s), year, study location, study topic, methodology and the safety indicator(s) used or developed (if applicable) (stage 4). Finally, the results were collated and summarised. The five dimensions of safety monitoring and measurement from the SMMF,16 which is a widely recognised framework in healthcare, were reviewed by the research team. The definitions were adapted to reflect the care home context and used as themes to organise the safety measures identified in the literature (stage 5).

Patient and public involvement statement

The development of the research question and study design was informed by advice and feedback from the public patient involvement advisor for the Quality, Safety and Outcomes Policy Research Unit Safety programme of work.

Results

The full results of the review are outlined in table 1. The identified indicators are summarised in table 2, which outlines each of the identified measures against the five dimensions in the SMMF in healthcare.16 The findings are further described below with regard to each of the five dimensions: (1) has care been safe in the past; (2) are systems and processes of care reliable; (3) is care safe today; (4) will care be safe in the future; and (5) is the organisation/system responding and improving?

Table 1

Literature review findings

Table 2

Measures of safety

Has care been safe in the past?

The review identified that commonly used indicators of physical harm in care homes include pressure ulcers, falls, diarrhoeal disease, scabies, malnutrition, dehydration, incontinence, unplanned weight change, urinary tract infections, catheterisation, decline in activities of daily living, experience of pain and mortality.18–35 Psychological harm indicators include an individual’s sense of self, belonging and connectedness, comfort and security, emotional distress, privacy, respect and autonomy, and dignity.36–39

Are systems, processes and behaviour reliable?

This aspect of safety asks whether the systems, processes and delivery of care, which includes the behaviour and attitude of care staff, offer reliability in keeping residents safe from risk of harm. In the care home context, this includes unsafe or inadequate care that may lead to physical harm. This may be measured as the rate of omission of safety critical care activities, like ambulation, turning, feeding, personal hygiene or surveillance.40 The quality of information held in care records, which is used to guide the delivery of care, may also be considered as an indicator of process reliability,41 and a number of medication-related measures were identified as indicators of the failure of safety-critical processes: for example, incidence of inappropriately prescribed medicines,42–44 medication errors,45 psychotropic prescribing for people with dementia,46 medication review rates and failure to use medication.47

The reliability of the system of a care home has also been conceptualised in terms of its physical environment. Whether there is adequate lighting and ventilation, for example, may influence the risk of falls or infectious respiratory disease. The physical environment also needs to facilitate infection control procedures and other safety critical processes but also be sufficiently ‘homely’ to prevent psychological harm. The reliability of the care home environment may also interact with behaviours within the system: for example, the design and use of space may affect space for privacy or inability to protect residents from intrusive noise, as well as also how care is delivered by staff in the space. In three of the studies, aspects of the physical environment of care homes or its social/functional use were considered as safety indicators.36 38 39

Is care safe today?

Approaching the question of whether care is safe now from the residents’ perspective is a well-established approach in care home contexts. Indeed, feeling safe has been identified as a key aspect of care home quality.48 One approach asks residents to describe qualitatively how safe they feel. More common though is to measure how safe residents feel quantitatively. The quantitative approaches often place the safety indicator within a wider set of questions, some of which may be related to safety, but also focus, more generally, on user experience and/or quality of life. An example of a resident-reported indicator of safety is from the Adult Social Care Outcomes Framework (ASCOF) in England, which solely focuses on user-reported safety without any further harm-related safety indicators.49 The ASCOF domain of safeguarding adults includes two indicators: (1) ASCOF 4A, an overarching measure of the proportion of people who use services (including care homes) who feel safe and (2) ASCOF 4B, the proportion of people who report services have made them feel safe. ASCOF 4A is measured using one of the eight items from the Adult Social Care Outcomes Toolkit (ASCOT), a social care-related quality of life instrument (ASCOF 1A).50–52 Focusing on the residents’ perspective on safety can be found in other tools too, including the Dutch national indicator set, the Consumer Quality Index53 54 and the Consumer Experience tool, which forms part Australian Aged Care Quality Agency audit process to capture residents’ experience of care quality.55

Will care be safe in the future?

In asking whether care will be safe in the future, the review identified safety indicators that relate to organisational and wider contextual factors, including staffing and safety culture within individual or groups of care homes, as well as wider systems-level factors, such as the funding of long-term care systems,56 for-profit care57 and market-level factors,58 that influence future risk of harm within an individual home or the residential care sector.

The literature review identified the skill, experience and number of care home staff per resident as potential indicators. These factors are related to the incidence of both care deficiencies and harm-related safety indicators.57 59 Other studies focused on patient safety culture (PSC) and/or the quality of the workplace environment as safety indicators. PSC refers to a combination of individual and group values, perceptions, attitudes, competencies and behaviours that influence an organisation’s safety management style.60 The PSC measures identified in the literature review include the Occupational Health and Safety Council Safety Climate Questionnaire,61 the Nursing Home Survey on Patient Safety Culture,58 62 which is an adapted version of the Hospital Survey on Patient Safety Culture,28 63 64 and the Alberta Context Tool, which captures a range of quality and safety-related contextual factors.30 65 Studies have found that PSC is lower in nursing homes than in hospitals, with lower levels of learning from errors, less open communication and a blaming or punitive culture among staff.28

These workplace-level indicators may be important, as it has been found that work environment influences resident safety outcomes more than the traits of individual care staff.66 They may also be important sources of additional information to support the interpretation of harm-based indicators: for example, it has been found that good PSC is related to lower reporting of some harm-based safety indicators58 but higher reporting of others (eg, report of falls), likely due to more accurate reporting and/or differences in care practice, for example, reduced use of restraints.63

Are we improving and responding?

The literature on measuring safety in care homes referred to various measures included in national datasets for quality monitoring and improvement. Examples include the National Prevalence Measurement of Quality of Care (the ‘LPZ’), which is collected annually in the Netherlands29 and the Resident Assessment Instrument Minimum Data Set 2.0, which has been adapted and applied to national-level quality monitoring of care facilities in Canada.67 The US Agency for Healthcare Research Quality collects and reports indicators of harm as part of the Minimum Data Set 3.0 for nursing homes19 68 and the Brazilian National Health Surveillance Agency (‘ANVISA’) requires monthly reporting of indicators.18 The principle of this approach is to monitor overall safety and quality with a systems-level view. To translate these data into the improvement of the quality and safety, however, it is important to consider the steps required in practice.

Studies looking at this area have identified some common essential elements that enable learning in the care home context. This includes local and specific measurement, either at the unit of the whole care home and/or staff team led by the same leader, or at the resident level, that is linked to staff learning via intentional activities, like networking,20 69 and also supported by clinical expertise and quality improvement methods within the team.21 While these elements are commonly found in healthcare teams, as they review and learn from safety incidents, they are not usually commonplace in the care home context.28

Discussion

A scoping review was undertaken to identify safety indicators used in older adult care homes from the international literature. How these relate to the key concepts of safety derived from healthcare settings was determined by mapping onto the the five dimensions of safety in the SMMF.16

In reviewing the literature, there are a wide range of potential measures already available, but there are also some potential gaps and challenges related to data collection and application in the care home context. Measures of past harm identified in the literature have mirrored those used in clinical settings and are dominated by measures of physical rather than the psychological harm. This may not adequately reflect the person-centred focus of care in care home settings and the potential for harm from care delivered in a way that does not respect a person’s dignity or personal preferences. Similarly, the assessment of reliability of systems, processes and behaviours has focused on safety critical processes, such as ambulation. One could argue that freedom from psychological harm and a safe, but homely, physical environment should play a more significant role in safety assessment when the care environment represents ‘home’ for its residents. The qualities of ‘homeliness’, with access to individualised space and personalised décor, and also relationships with other residents contribute to a sense of (in)security and (not) feeling safe.10

Social care tends to place a greater emphasis on the views and experience of people, which reflects its aim of promoting the quality of life.50 Using residents’ views and self-reported outcome measures should, therefore, be an integral part of understanding and measuring safety. This approach, however, presents a challenge. The prevalence of cognitive impairment among care home residents often precludes the use of traditional data collection methods for self-report measures.70–75 The use of proxy report by care staff and/or family carers, as in the care home version of ASCOT,12 76 may also be problematic due to potential bias, even if it may be preferable to systematic exclusion from data collections.77–79 Further research on safety data collection methods in care homes is required to adequately address these concerns. A gap also exists in adequately capturing information on the incidence of abusive or neglectful care practice. There are complex issues as to whether, and how, such sensitive data might be reliably collected through resident report, staff report (self or colleague) and/or staff observation.

To date, there is relatively little evidence of learning in practice from safety metrics within care home staff teams, especially learning that directly involves care workers and managers. There is also limited insight into potential barriers to learning presented by care sector conditions (eg, staffing levels, employment conditions and the professional status of care workers) and ways to adapt practice-based processes in light of these contextual differences. Improvement targeted at either systems level or organisational level is also relatively underdeveloped in the care home sector. Such monitoring is likely to require a dual individual organisational perspective, since measures of contextual factors, including PSC, offer important contextual evidence to guide the interpretation of individual-level harm-based indicators, as well as the ways in which an organisation is led and responds to safety challenges.

Wider systems-level factors are generally considered in the literature as influences on safety, rather than as measures of safety. This approach acknowledges the influence of such factors on care home safety and quality; however, it also implies that these wider factors are beyond the scope of quality improvement interventions. The extent to which policy and funding models influence the quality and safety of care remains a gap in the literature. Further evidence could establish the degree of influence of these factors, as well as suitability as safety indicators to understand, guide and improve safety at a systems level.

A limitation of this study is that its approach focused on measures found in the international peer-reviewed literature. It is possible that indicators used in practice were omitted, especially in countries, like England, that do not have a national minimum dataset for care homes and where fragmented local practice is unlikely to be reported in peer-reviewed literature. Further investigation of safety measurement and improvement within care homes and consortia, and undertaken by adult social care quality monitoring teams, safeguarding managers, commissioners and other stakeholders within local authorities or regional bodies in England, would contribute to the evidence base. This is the next phase of work of the study of which this scoping review is part. An evaluation of the psychometric properties of indicators (ie, reliability, validity and ability to differentiate between good and poor quality care) would also be a useful contribution. There are also important considerations as to whether it is feasible to routinely collect the required data in the resource-constrained residential home environment. Further work is needed before measurement systems are in place that can fulfil these criteria.

In summary, this scoping review has identified safety indicators collected and used in older adult care homes from the international literature. These indicators have been evaluated and analysed against the SMMF16 to identify gaps and areas where adaptation may be required to adequately capture safety in the context of older adult care homes. Some of the key contextual differences and challenges have been considered.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors All authors contributed to the study design and development of the research question. SR, AD, NS and KJ developed and refined the search strategy, reviewed the articles and summarised the findings. SR drafted the manuscript, with review and approval by all coauthors. We would also like to acknowledge and thank Anica Alvarez Nishio, the Public Patient Involvement advisor for the Safety programme of Quality, Safety and Outcomes Policy Research Unit, for her contribution to the study.

  • Funding This work was supported by the National Institute for Health Research Policy Research Programme, grant number PR-PRU-1217-20702.

  • Disclaimer This research was funded by the National Institute for Health Research (NIHR) Policy Research Programme, conducted through the Quality, Safety and Outcomes Policy Research Unit (QSO-PRU), PR-PRU-1217-20702. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement No data are available.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.