Background Evidence about the impact of systematic nursing surveillance on risk of acute deterioration of patients with COVID-19 and the effects of care complexity factors on inpatient outcomes is scarce. The aim of this study was to determine the association between acute deterioration risk, care complexity factors and unfavourable outcomes in hospitalised patients with COVID-19.
Methods A multicentre cohort study was conducted from 1 to 31 March 2020 at seven hospitals in Catalonia. All adult patients with COVID-19 admitted to hospitals and with a complete minimum data set were recruited retrospectively. Patients were classified based on the presence or absence of a composite unfavourable outcome (in-hospital mortality and adverse events). The main measures included risk of acute deterioration (as measured using the VIDA early warning system) and care complexity factors. All data were obtained blinded from electronic health records. Multivariate logistic analysis was performed to identify the VIDA score and complexity factors associated with unfavourable outcomes.
Results Out of a total of 1176 patients with COVID-19, 506 (43%) experienced an unfavourable outcome during hospitalisation. The frequency of unfavourable outcomes rose with increasing risk of acute deterioration as measured by the VIDA score. Risk factors independently associated with unfavourable outcomes were chronic underlying disease (OR: 1.90, 95% CI 1.32 to 2.72; p<0.001), mental status impairment (OR: 2.31, 95% CI 1.45 to 23.66; p<0.001), length of hospital stay (OR: 1.16, 95% CI 1.11 to 1.21; p<0.001) and high risk of acute deterioration (OR: 4.32, 95% CI 2.83 to 6.60; p<0.001). High-tech hospital admission was a protective factor against unfavourable outcomes (OR: 0.57, 95% CI 0.36 to 0.89; p=0.01).
Conclusion The systematic nursing surveillance of the status and evolution of COVID-19 inpatients, including the careful monitoring of acute deterioration risk and care complexity factors, may help reduce deleterious health outcomes in COVID-19 inpatients.
- health informatics
- health & safety
- quality in health care
- infectious diseases
- respiratory infections
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
We performed a multicentre cohort study with a large sample of patients with COVID-19.
This novel research assessed the impact of the risk of acute deterioration and broader contributors to care complexity on outcomes of patients with COVID-19.
We did not evaluate other clinical measures such as the age-adjusted Charlson Comorbidity Index or patient laboratory values.
The results of this study only apply to adult wards and intermediate care inpatients.
The risk of acute deterioration was measured using VIDA, an early warning system not yet fully implemented in all hospital wards.
Along with climate change and financial crises, pandemics are a major global risk in the 21st century. A 2019 report stated that, in the last decade, the WHO had tracked 1483 epidemic events, including severe acute respiratory syndrome (SARS), Middle East respiratory syndrome, Ebola and other epidemic-prone diseases, considered harbingers of a new era of high-impact, potentially fast-spreading outbreaks.1
The potential threat became real in December 2019, when a severe acute respiratory infection caused by the new coronavirus SARS-CoV-2 first began to spread in Wuhan (China).2 3 The WHO described the ‘Wuhan pneumonia’ as an outbreak of potential danger on 31 December, and as an outbreak of global concern on 31 January. This coronavirus disease (named COVID-19) was declared a global pandemic in February 2020.
Patients with COVID-19 frequently require hospital admission as they may rapidly develop severe potentially life-threatening complications, such as acute respiratory distress syndrome (ARDS), sepsis, major thromboembolic events or cardiac injury, requiring intensive care.3–5 Recent studies have found overall in-hospital mortality rates for COVID-19 inpatients ranging from 15% to 28%.3 6–8 Therefore, early recognition of patient deterioration and escalation of treatment to reduce the risk of progression to critical complications is a significant issue that may impact patient and organisational outcomes. Screening for acute deterioration implies nursing surveillance, data collection, interpretation and recognition of changes in patients’ status, prioritisation of patients’ problems and decision-making on the interventions needed in order to curb the cascade towards adverse events (AEs) and death.9
According to the WHO, ‘patients hospitalized with COVID-19 require regular monitoring of vital signs and, where possible, utilization of early warning scores that facilitate early recognition and escalation of treatment of the deteriorating patient.’10 Early warning systems have become an important component of managing inpatient care, and are a clinical decision-making support stratification tool used to prevent poor health outcomes.11–13 Previous studies suggested the need for adaptation of these systems to each context.14 According to these recommendations, several evidence-based algorithms have been developed and used to identify and act on initial or impending acute deterioration among hospitalised patients in a timely fashion. In the context of this study, a nursing surveillance improvement programme named VIDA (the Catalan acronym for Surveillance and Identification of Acute Deterioration) was first implemented in 2013 and, through a multidisciplinary approach, has evolved into an early warning score system that is used on a daily basis to assist clinical decision-making.
It has been reported that patients hospitalised with COVID-19 have a substantial rate of chronic conditions that may affect the complexity of medical and nursing care provision and patient health outcomes.15 Nevertheless, care complexity individual factors (CCIF) are related to multiple comorbidities and mental-cognitive and psychosocial patient features, which in turn are also associated with increased healthcare needs during hospitalisation and with selected health outcomes.16–18
Only a few studies in COVID-19 inpatients have explored the use of acute deterioration risk stratification11 19 and to date, none has assessed CCIF as predictors of poor health outcomes. The aim of this study was to determine the association between the risk of acute deterioration (as measured using the VIDA early warning system), CCIF and unfavourable outcomes in patients hospitalised with COVID-19.
Setting and study design
A retrospective cohort study was carried out at seven public hospitals in Catalonia, Spain: three tertiary metropolitan facilities, three urban university centres and one community hospital. All patients with a medical diagnosis of COVID-19 infection admitted to a ward or intermediate unit for COVID-19 or other causes from 1 to 31 March 2020 with a completed hospital minimum data set report were recruited retrospectively and followed up during hospitalisation until discharge or death. Patients directly admitted and discharged from intensive care units (ICU) were excluded because the VIDA early warning system is not used in the ICU. Patients who remained hospitalised after the recruitment end date were also excluded as the hospital minimum data set was not available.
We defined the primary endpoint as a composite of unfavourable outcomes including in-hospital mortality or AEs, not present on admission and occurring thereafter during hospitalisation.
Patient and public involvement
Patients were not involved in the design, conduct or reporting of this study.
Information regarding the demographic and clinical characteristics, continuity of care (discharged to another facility), high-tech hospital (referral centre that provides tertiary care for either open-heart surgery or major organ transplants or both), length of hospital stay (LOS) and patient severity and mortality risk was collected from the hospital minimum data set and the clinical data warehouse of the Catalan Institute of Health. Patient severity and risk of mortality were based on the All Patient Refined Diagnosis-Related Group (APR-DRG), which categorises both measures from low (level 1) to extreme (level 4). Severity and mortality risk were dichotomised in this study into low risk (levels 1–2) and high risk (levels 3–4).20 All variables were collected during hospitalisation.
The VIDA score (acute deterioration risk stratification) automatically classifies patients into five groups according to patient progress data: no risk (level 0), low risk (level 1), moderate risk (level 2), high risk (impending complication if not stabilised) (level 3), manifested complication initial status (level 4). Levels 2–4 create an alert in the electronic health records and require action in response to clinical recommendations. These recommendations are standardised for each context and involve intensifying the surveillance of the patients’ status and notifying the medical team. The health team (nurse and specialist) are responsible for the final clinical decision-making. For the purposes of this study, the VIDA score was classified as mild (levels 1–2) or high (levels 3–4) risk. Patients were classified according to the highest VIDA score obtained during their hospitalisation. Patient progress data were extracted from anonymised electronic health records whenever they were e-charted, and included: respiratory rate (breaths per minute), oxygen saturation (%), temperature (°C), mental status (level of awareness: 1=aware and orientated, >1=disturbed mental status, including disorientation, acute confusion, and so on), pulse (cardiac rate, beats per minute) and systolic and diastolic blood pressure (mm Hg) (online supplemental file 1).
CCIFs were classified into five domains: (1) mental-cognitive, (2) psychoemotional, (3) sociocultural, (4) developmental, and (5) comorbidity/complications, as described in previous studies.16 18 Each CCIF domain is structured into factors and specifications. Patients were considered to fall within any CCIF domains if they presented at least one factor or specification during their hospitalisation. These CCIF factors and specifications were obtained from the nursing assessment e-charts as structured data based on the Architecture, Terminology, Interface, Knowledge terminology20 (online supplemental file 2).
The main endpoint was a composite of unfavourable outcomes including in-hospital mortality and AEs during hospitalisation. The in-hospital mortality counted the number of patients with COVID-19 dying while in a ward. The AEs included ICU transfer, hospital-acquired infections (HAI) and potentially avoidable critical complications (ACC) during hospitalisation. ICU transfer was defined as the number of patient episodes with effective bed change from a general ward to an intensive care area. HAI included the number of episodes of ward patients who developed catheter-related bloodstream infection, urinary catheter-related infection, aspiration pneumonia and/or sepsis. ACC accounted for the number of episodes of ward patients who experienced a cardiac arrest, shock, thromboembolic event, acute respiratory failure, ARDS, myocardial injury, liver injury and/or kidney failure, not present on admission.
Descriptive analysis of data using percentage frequencies, median and IQR was performed to determine demographic and clinical characteristics and patient outcomes. For categorical variables, a comparative analysis for detecting significant differences between groups was carried out using the χ2 test or Fisher’s exact test when one or more cells had an expected frequency of 5 or less. For continuous variables, the Student’s t-test or Mann-Whitney U test was used depending on the results of the Kolmogorov-Smirnov normality test. A logistic regression model of all clinical factors potentially associated with unfavourable outcome measures (AEs and in-hospital mortality) was performed including the VIDA score, clinically relevant CCIF and other potential confounders: sex, hospital level and LOS. All potential explanatory variables included in the multivariate analysis were subjected to a correlation matrix for analysis of collinearity. The discriminatory power was evaluated by the area under the receiver operating characteristic curve (AUC). The results of the multivariate analysis were reported as OR and 95% CIs. We also performed an adjusted analysis to compare unfavourable outcomes in patients admitted to wards with and without the VIDA system. Statistical analysis was performed using the SPSS software package V.25.0 (SPSS). P values <0.05 were considered statistically significant.
During the study period, 1838 patients were hospitalised with COVID-19, of which 1176 met the inclusion criteria (figure 1). The frequency of unfavourable outcomes was 42.8% (506 patients). The in-hospital mortality rate was 19.6% (232 patients), and almost 41% (481 patients) experienced an AE while in a ward (2.7% transferred to ICU; 2.5% HAI; 40% ACC). Acute respiratory failure, ARDS, acute kidney failure, urinary catheter-related infection, sepsis and thrombotic events were the most frequent AEs.
The baseline characteristics of patients with an unfavourable and favourable outcome are compared in table 1. Hospitalised patients with COVID-19 who had an unfavourable outcome were more often male, older and had one or more underlying chronic conditions (75.5%), mostly arterial hypertension or congestive heart failure, and diabetes or chronic kidney disease. Furthermore, they had a longer LOS and a high risk of severity or mortality (APR-DRG 3–4). Conversely, patients admitted to high-tech hospitals presented a lower frequency of unfavourable outcomes.
Among the 806 patients in wards where the VIDA early warning system was in use, most patients with unfavourable outcomes experienced a high risk of acute deterioration (41.7% in patients with unfavourable outcomes vs 9.1% in patients with favourable outcomes).
Comorbidity, sociocultural and developmental domains were the most frequent CCIF domains identified in the studied sample. Mental-cognitive and psychoemotional domains were less frequent. Patients with unfavourable outcomes exhibited a higher frequency of chronic disease, position impairment, anatomical and functional disorders, communication disorders, old age (>75 years) and mental status impairment, when compared with patients with favourable outcomes. The median CCIF was also higher in patients with unfavourable outcomes (5 [IQR: 4–6] vs 4 [IQR: 3–5]) (table 1).
Association of outcomes with risk of acute deterioration and care complexity factors
The outcomes of 806 patients with low, mild or high risk of acute deterioration are compared in table 2. The frequency of unfavourable outcomes was almost 38% in patients with mild risk and almost 80% in those at high risk of acute deterioration (p<0.001). Similarly, the frequency of in-hospital mortality and AEs rose with increasing VIDA score and was around 60% and 80%, respectively, in patients with a high risk of acute deterioration (p<0.001). Acute respiratory failure, acute kidney failure and ICU transfer were the most frequent AEs.
Among the 1176 patients analysed in this study, those with four or more CCIFs experienced unfavourable outcomes (p<0.05) (table 2).
Table 3 shows an adjusted analysis of health outcomes in 486 patients with a high risk of mortality (APR-DRG 3–4). In-hospital mortality was more frequent in patients admitted to wards where VIDA was not used (52.5% vs 41.3%, p<0.05). Conversely, the frequency of AEs was slightly higher in patients admitted to wards using VIDA (p<0.05).
Risk factors associated with unfavourable outcomes
The results of the multivariate analysis for risk of acute deterioration (as measured using the VIDA score) and CCIF potentially associated with unfavourable outcomes, in-hospital mortality and AEs are summarised in table 4.
After adjustment for potential confounders, the analysis showed that a high risk of acute deterioration was an independent factor associated with unfavourable outcomes, in-hospital mortality and AEs in COVID-19 inpatients. Furthermore, chronic disease, mental status impairment and LOS were risk factors associated with unfavourable outcomes. Conversely, high-tech hospital admission was a protective factor against unfavourable outcomes. The AUC was 0.81 (95% CI 0.78 to 0.84).
Chronic disease, mental status impairment, old age and male sex were independent risk factors associated with in-hospital mortality in the studied COVID-19 inpatients (AUC 0.91, 95% CI 0.88 to 0.93). Finally, risk factors independently associated with AEs were chronic disease, mental status impairment, old age and LOS, whereas high-tech hospital admission was a protective factor against AEs (AUC 0.80, 95% CI 0.77 to 0.83). The AUCs of the three outcomes analysed were >0.80, showing a fair discriminatory power.
In this study of a large cohort of hospitalised patients with COVID-19, the frequency of in-hospital mortality and AEs was around 60% and 80%, respectively, in patients scored as at high risk of acute deterioration. In-hospital mortality was higher in wards not using the VIDA early warning system. The majority of patients had four or more care complexity factors identified. The risk factors independently associated with unfavourable outcomes included chronic disease, mental status impairment, LOS and a high risk of acute deterioration. High-tech hospital admission was a protective factor against unfavourable outcomes.
Our findings are consistent with previous COVID-19 reports that found a similar frequency of in-hospital mortality and AEs.3 21 In addition, 37% of patients developed respiratory complications (acute respiratory failure or ARDS) during hospitalisation. This value is within the range reported in a previous study (29%–42%).3
The results of this study show that a high risk of acute deterioration is a significant risk factor for unfavourable outcomes, as a composite measure for in-hospital mortality and AEs in COVID-19 inpatients. Although previous studies have stressed that early warning systems are predictors of in-hospital mortality and health outcomes,22 23 only a few have evaluated warning score systems in COVID-19 inpatients.11 19 These latest studies showed a fair discrimination with adverse outcomes, illustrating that evaluating the risk for acute deterioration in the COVID-19 hospital population is a priority for healthcare organisations.19
In-hospital mortality was more frequent in patients admitted to wards where registered nurses (RN) were not using the VIDA early warning system. In this regard, other studies have shown that the use of early warning systems reinforces collaboration among the multidisciplinary team, and promotes the early identification of clinical deterioration.24 Similarly, previous studies have reported lower mortality and fewer AEs when systematic nursing surveillance of patient status and progress is part of the daily routine.9
Chronic conditions and mental status impairments were the CCIFs independently associated with unfavourable outcomes. Previous reports have shown that chronic diseases were more frequent among deceased patients with COVID-1915 and that ageing was a potential risk factor associated with mortality.6 Although our study did not identify age as a risk factor associated with a composite unfavourable outcome, we acknowledge that old age was an independent risk factor associated with mortality and AEs. Furthermore, our findings are also consistent with other studies demonstrating that mental status impairment is associated with hospital-acquired complications,25 including sepsis.4
The majority of patients had four or more CCIFs. Our findings are consistent with other studies that identified a significant rate of chronic conditions in patients with COVID-1915 along with various organisational issues that may impact care complexity and health outcomes.26 Previous studies have demonstrated the association of CCIF and health outcomes,16 with an average of two CCIFs per patient. In our study of COVID-19 inpatients, the average number of CCIFs was 4. These results are probably related to the transmissibility of this condition, which requires droplet and contact precautions; the public health measures of population confinement for pandemic management, which prevent patients’ relatives from visiting them in person, resulting in a lack of family caregiver support during hospitalisation; and the frequency of chronic diseases in the studied sample. The organisational adaptation of hospitals to this pandemic context and the required isolation precautions have been associated with poor outcomes in prior studies.27 28
We also found that LOS was associated with unfavourable outcomes, consistent with previous studies that associated AEs with increased healthcare costs due to longer hospital stays.29 Finally, high-tech hospital admission was a protective factor against unfavourable outcomes. High-tech hospitals usually have better nurse to patient ratios than urban or community facilities. In this sense, several recent studies in the same study setting concluded that on average, hospital ward patients require 5.6 hours of RN care per patient-day, while the average of available RN hours per patient-day is 2.4, and that RN understaffing is a structural issue.26 30 Nevertheless, to the best of our knowledge, no study on nurse staffing and COVID-19 inpatient outcomes has been published. Similarly, clinical leaders and healthcare managers have a key role to play in rapidly adapting organisations to the new reality. Fast and effective decision-making and managerial responses in crisis situations with high levels of uncertainty are essential both immediately and in the short term; however, they should be accompanied by planning and executing mid-term and long-lasting improvements that positively impact patient, professional and organisational outcomes, such as structural RN understaffing.26
The strengths of this study include its multicentre approach, cohort design and large sample size. It is the first study evaluating the association of the risk of acute deterioration, along with care complexity factors, with outcomes of patients with COVID-19. Importantly, we identify the importance of a range of contributors to care complexity, including psychosocial and mental-cognitive factors. In addition, the VIDA early warning system was developed as an evidence-based algorithm using a multidisciplinary approach, based on previous studies that highlighted the importance of adapting surveillance and screening systems to the organisational and cultural context.14
This study is not exempt from limitations. First, the VIDA score and CCIF data were comprehensively collected from the clinical data warehouse of the Catalan Institute of Health and all patients included had a completed nurse chart in the patient electronic health record, but we were still reliant on proper compliance with electronic record keeping and the collection of administrative data. This is acknowledged as a significant limitation since voluntary completion of patient electronic documentation during the initial weeks of the first wave of COVID-19 in our country might have been negatively influenced by the rising hospital burden, the understandable prioritisation of direct patient care, as well as the physical and emotional stress experienced by bedside healthcare professionals. Second, regarding the study selection criteria, patients directly admitted and discharged from the ICU were excluded, since no early warning system was in use in the critical care setting at the outset of the pandemic in our study area. In this sense, the results of this study only apply to adult ward and intermediate care inpatients. Third, it should be noted that of the 1176 patients included, only 806 were hospitalised in wards with a fully implemented VIDA system. Therefore, patients admitted to wards without the VIDA system did not have data available on risk of acute deterioration (VIDA score). This is a significant limitation. The VIDA system was under development in hospitals belonging to the Catalan Institute of Health during the data collection period. Therefore, future studies should corroborate the current results in centres where VIDA has been fully implemented. However, due to the high number of daily admissions, the patients’ unplanned assignment to the different wards (with or without the VIDA system) means that the patients’ clinical characteristics were similar between wards with and without the VIDA system. Fourth, although an unpublished face validity study has demonstrated the effectiveness of the VIDA early warning system, full evaluation of its psychometric properties is still pending. To minimise the potential effect of this limitation, we conducted an adjusted analysis performed with 486 patients with a similar higher risk of mortality (APR-DRG 3–4), comparing those admitted to wards using VIDA with those being treated in units with no VIDA early warning system. The results show that in-hospital mortality was more frequent in patients admitted to wards where VIDA had not yet been implemented. This result should be interpreted with caution because this analysis only included patients with a high risk of mortality and could have been influenced by other variables such as the differences in sample sizes. Finally, we acknowledge as a potential limitation that other clinical measures such as the age-adjusted Charlson Comorbidity Index or patient laboratory values were not assessed. Selected laboratory values such as lactate, ferritin or calciferol have been studied as indicators of COVID-19 prognosis and severity. Combining point-of-care laboratory data with clinical data from nurses’ observations and judgements on patient complexity factors, status and progress would probably result in an improved system for the early detection and prevention of critical complications and other unfavourable outcomes in COVID-19 inpatients.
The risk of acute deterioration and CCIF is associated with outcomes of patients with COVID-19. The rate of unfavourable outcomes rose with increasing risk of acute deterioration as measured using the VIDA score. The risk factors independently associated with poor health outcomes were chronic disease, mental status impairment, LOS and high risk of acute deterioration. High-tech hospital admission was a protective factor against unfavourable outcomes. The systematic nursing surveillance of patients at risk of acute deterioration and the assessment of CCIF may help reduce deleterious health outcomes in adult COVID-19 inpatients.
Contributors All authors had full access to all study data and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: JA, MGS, MEJU. Coordination team: MEJU. Acquisition of data: JA, MTP, MMLJ, EZP, TCN. Analysis and interpretation of data: JA, MGS, EJM. Drafting of the manuscript: JA, MGS, EJM, MEJU. Critical revision of the manuscript for important intellectual content: MTP, MMLJ, HRF, EZP, TCN, JC. Statistical analysis: JA, MGS. Administrative, technical and material support: MMLJ, HRF. Study supervision: MEJU, JC.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Patient consent for publication Not required.
Ethics approval This study was approved by the Clinical Research Ethics Committee of the Bellvitge University Hospital (reference 158/20). Informed consent was waived due to the study’s retrospective design. Ethical and data protection protocols related to anonymity and data confidentiality (access to records, data encryption and archiving of information) were complied with throughout the study.
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement All data relevant to the study are included in the article or uploaded as supplemental information.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.