Article Text
PDF
Abstract
Objectives This study aimed to evaluate whether use of a discharge criteria tool for nursing assessment of patients in Post Anaesthesia Care Unit (PACU) would enhance nurses’ recognition and response to patients at-risk of deterioration and improve patient outcomes.
Methods A prospective non-randomised pre–post intervention study was conducted in three hospitals in Australia. Participants were adults undergoing elective surgery before (n=723) and after (n=694) implementation of the Post-Anaesthetic Care Tool (PACT).
Results Nursing response to patients at-risk of deterioration was higher using PACT, with more medical consultations initiated by PACU nurses (19% vs 30%, P<0.001) and more patients with Medical Emergency Team activation criteria modified by an anaesthetist while in PACU (6.5% vs 13.8%, P<0.001). There were higher rates of analgesia administration (37.3% vs 54.2%, P=0.001), nursing assessment of pain and documentation of ongoing analgesia prior to discharge (55% vs 85%, P<0.001). More adverse events were recorded in PACU after introduction of the PACT (8.3% vs 16.7%, P<0.001). The rate of adverse events after discharge from PACU remained constant (16.5%), but the rate of cardiac events (5.1% vs 2.6%, P=0.021) and clinical deterioration (8.7% vs 4.3%, P=0.001) following PACU discharge significantly decreased, using the PACT. Despite the increased number of patients with adverse events in phase 2, healthcare costs did not increase significantly. Length of stay in PACU and length of hospital admission for those patients who had an adverse event in PACU were significantly reduced after implementation of the PACT.
Conclusion This study found that using a structured discharge criteria tool, the PACT, enhanced nurses’ recognition and response to patients who experienced clinical deterioration, reduced length of stay for patients who experienced an adverse event in PACU and was cost-effective.
- surgery
- health Economics
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
This study examined the real-time impact of nursing care, for the recognition and response to patient deterioration in the Post Anaesthesia Care Unit.
The prospective design identified processes relating to nursing management not captured in the medical record.
The sourcing of some data obtained from patients’ medical record and organisational datasets was a limitation of the study. For most variables, including key outcome variables, the frequency of missing data was less than 1%.
There may be factors external to the implementation of the Post-Anaesthetic Care Tool that increased or decreased surgical risk; however, this quasi-experimental study design was practical and effective health services research.
Background
Surgery is an integral part of healthcare throughout the world, with an estimated 234 million operations performed annually.1 Studies in industrialised countries have shown a death rate after surgery of 0.4% to 4.0% and a rate of major complications of 3% to 17%.2–6 Approximately 40% of in-hospital complications are associated with surgery and 15% of surgical patients will experience at least one complication,7 such as bleeding, infection, cardiac and/or respiratory problems (congestive cardiac failure and pulmonary oedema); these being the most commonly occurring events.8 Hospital costs for surgical patients experiencing a complication are substantially higher than for patients without a complication.9 10
The intensive observation of patients in PACU by nurses can result in the early detection of complications and adverse events.11 These adverse events include clinical deterioration, unresolved pain, unplanned admission to intensive care, prolonged hospital stay, disability or death. Postoperative deterioration occurs frequently, with a reported rate of 20% in PACU and 17% on the wards12 and 20% of patients who experienced clinical deterioration in PACU required medical review.13 The early recognition of clinical deterioration and timely response can reduce the incidence or severity of postoperative complications, mortality and length of hospital stay.14
Aims
The aims of this study were to evaluate whether use of the Post-Anaesthetic Care Tool (PACT) would (1) enhance the recognition and response to patients at risk of clinical deterioration, (2) result in improved patient outcomes and (3) reduce healthcare costs.
Methods
Design
This study used a non-randomised prospective before and after intervention design. The study protocol has been published15; therefore, a brief overview is provided here. The setting for the study was the Post Anaesthesia Care Units (PACUs) at three hospitals within one Australian metropolitan healthcare organisation using primarily non-participant observation.
Development of the tool
The intervention was the PACT, developed locally to address concerns raised by clinicians and managers about the lack of standardised documentation within the perioperative services of the healthcare organisation, which was impacting on patient outcomes immediately following surgery. For example, one hospital was using a modified Aldrete scoring system16 to assess patient readiness for discharge from PACU while another used a simple checkbox. A working party was established to determine the best way to address these issues and improve outcomes for patients. An interdisciplinary subcommittee including nursing and medical health professionals, quality assurance and planning representatives and the researchers who were experienced in exploring PACU evaluation tools undertook extensive review of the current processes at each hospital. The researchers conducted two projects, a systematic review17 and an expert consensus study,18 to synthesise and evaluate the current evidence and generate key elements to form a new PACT for safe patient discharge from PACU. The findings from these two studies were considered and incorporated into the PACT when the new assessment documentation for perioperative care at this health organisation was developed between March 2011 and November 2012.
Changes to the PACT were also required to conform to organisational policy and procedures, especially with regard to guidelines relating to the recognition and response to patient clinical deterioration. These guidelines included the use of colour-coded charts that incorporated a track and trigger system, where different colours in the charts reflect levels of physiological abnormality or specific triggers in single or multiple parameter systems.19 Medical emergency team (MET) activation occurs when patients fulfil predefined criteria (specific abnormalities in vital signs or staff concern).20 The revised documentation (PACT) conformed to the National Consensus Statement on the essential elements for recognising and responding to clinical deterioration21 and used a track and trigger system for assessment of a patient’s conscious state, vital signs (oxygen levels, respiration rate, blood pressure and temperature), symptoms (pain, nausea and vomiting), level of activity and care plan. Patient readiness for discharge from PACU was recorded by a checklist of criteria: that the last two sets of observations were not within the MET or modified MET criteria; there was no active vomiting; pain management had been ordered; and all surgical concerns had been met.15 The PACT contained information regarding oxygen therapy, analgesia administered in PACU and related charts specific to the patient and surgical procedure (see online supp lementary figure S1).
Supplementary figure S1
Implementation of PACT
Implementation of the PACT was supported by perioperative nursing educators, posters summarising how to complete the PACT and feedback sessions between the nurses using the tool and the perioperative team (educators, nurse unit managers and the quality unit of the organisation). The PACT was included in the revised ‘Post-Anaesthetic Care Record’ and was implemented at all three hospitals on the same day in March 2014. Postimplementation data collection commenced after a 3-month period from the time of implementation, as this was considered sufficient time for the tool to be embedded in nursing practice in PACU.
Participants
The study population comprised surgical patients admitted to the PACU during the study period. All adult patients (18 years or over) undergoing elective surgery on days of data collection before (phase 1; July to October 2012) and after (phase 2; July to September 2014) the implementation of PACT were eligible to be included. Patients were excluded from the study if they had undergone emergency surgery, had a minor procedure requiring only sedation rather than anaesthesia or had a postoperative planned admission to intensive care. The sample size was based on an adverse event incidence of 12% and able to detect a 7% difference before and after the PACT, or an OR of at least 2.6, using a two-sided Cochran-Mantel-Haenszel (CMH) test conducted at the 5% significance level with 80% power.
Data, collected by research nurses, were patient demographics, physiological parameters, clinical nursing care, handover to ward nurse including duration, length of stay in PACU, length of hospital admission and patient outcomes, including any adverse events or complications. Complications and serious adverse events included clinical deterioration, prolonged stay in PACU, unplanned return to theatre, unplanned admission to intensive care unit (ICU) or readmission to hospital and were defined as any deviation from the normal postoperative course.22 Clinical deterioration was determined through assessment of respiration (difficulty in breathing, respiration rate less than 8 or greater than 30 per min; oxygen saturation less than 90% despite oxygen therapy), circulation (heart rate less than 50 or more than 130 beats/min, systolic blood pressure less than 90 mm Hg) or change in conscious state.15 Severity of each adverse event was graded using the Common Terminology Criteria for Adverse Events V.4.03,23 and grouped into mild (an event which caused no or minimal effect to the patient and resolved spontaneously), moderate (an event which resolved after intervention, with no lasting effect for the patient) and severe (an event which required intervention and caused harm to the patient, including death).
The primary outcomes were the rate of complications, adverse events and mortality, the length of stay in PACU and length of hospital admission. Patient outcomes were determined from the medical record following hospital discharge. An economic evaluation was also undertaken, from organisational data that were routinely submitted to the regional health department for benchmarking.
Statistical analyses were undertaken to describe the two groups and identify differences between phases 1 and 2, before and after implementation of the PACT. In order to account for hospitals’ heterogeneity the CMH test was used to compare the proportion of adverse events and mortality between the two groups, adjusting for hospital strata as an effect modifier factor. ORs for risk of an adverse event were adjusted for age, gender, American Society of Anesthesiologist (ASA) score, type of surgery and admission type (inpatient or day/short stay) using logistic regression. Length of time in PACU, and length of hospital admission were considered as time-to-event data. Survival rates were calculated and illustrated by the Kaplan-Meier method and further analysed by the log-rank test (stratified by hospitals).
Economic evaluation
In Australia, healthcare costs for each patient admitted to hospital are calculated on a cost–weight analysis using the Australian Refined—Diagnostic-Related Groups (AR-DRGs). The AR-DRG is ‘an Australian admitted patient classification system which provides a clinically meaningful way of relating the number and type of patients treated in a hospital to the resources required by the hospital’.24 In this study, the AR-DRG was used to calculate the costs for all initial admissions and unplanned readmissions, using the national efficient price determination.25 A weighted average cost of an unplanned admission to an ICU of $A190/hour was taken from the National Pricing Model Technical specifications 2014–2015.26 The cost of emergency department visits was assumed to be that of a non-admitted return visit, Triage 4, 5 ($A201 per encounter) as reported by the Independent Hospital Pricing Authority.26 To be included in the cost analysis, each patient needed to have all episodes of care recorded, including the code for diagnosis-related group (DRG) and length of stay for the initial admission. A review of the data provided by the health network administration found that details of the procedure, diagnosis and consequent DRG coding were not available for all enrolled patients. Those patients with missing data were excluded from the cost analysis.
Results
In total, 1417 patients were included in this study, 723 in phase 1 and 694 in phase 2. Almost half the patients were day surgery cases (48%, n=679) with the remainder being overnight (26%, n=369), or multiday admissions (26%, n=369). Surgical specialties in this study were: general (open and laparoscopic abdominal surgery), obstetric and gynaecological, orthopaedic, urology, plastics, ear, nose and throat, vascular and thoracic. There were no differences in the average age, gender distribution or patients’ physical status prior to surgery for both groups (table 1). However, there were more obstetric and gynaecological and fewer general surgery procedures in phase 2 (table 1).
Patient characteristics before (phase 1) and after (phase 2) implementation of the Post Anaesthetic Care Tool
Nursing management of patient symptoms
Following the implementation of the PACT, it was found that nursing responses to patients with clinical deterioration were higher. There were more requests for medical review by PACU nurses (19% vs 30%, P<0.001) and more patients with MET activation criteria modified by an anaesthetist while in PACU (6.5% vs 13.8%, P<0.001) using the PACT. There were higher rates of analgesia administration (37.3% vs 54.2%, P=0.001) for patients in pain, and there was also a significant increase in nursing assessment and documentation that ongoing pain relief had been ordered prior to discharge from PACU (55.3% vs 84.8%, P<0.001).
For the 16.1% (n=228) of patients experiencing nausea and vomiting in PACU, there were more assessments and documentation relating to this after introduction of the PACT (60.0% vs 92.4%, P<0.001). In addition, this led to an increase in antiemetics being administered to a significantly higher proportion of patients with nausea and vomiting in phase 2, compared with phase 1 (49.2% vs 84.8%, P=0.002).
Patient outcomes
Patient outcomes included rates of adverse events and mortality, the length of stay in PACU, length of hospital admission and discharge destination.
Adverse events
In total, 25.2% (357/1417) of patients experienced 379 adverse events following surgery; one-third occurred in PACU (33.9%, 121/357). The most common adverse events in PACU in both phases were clinical deterioration, other cardiovascular and respiratory events which required intervention and unresolved severe pain (pain score of at least 8 out of 10 after analgesia; figure 1).
Frequency of patients experiencing adverse events in Post Anaesthesia Care Unit (PACU) (blue), after discharge from PACU (green) and starting in PACU and continuing after discharge from PACU (red) for both phases combined. ICU, intensive care unit; MET, medical emergency team.
The number of adverse events recognised and recorded significantly increased from 21.2% (153/723) in phase 1 to 29.4% (204/694) in phase 2 (P<0.001). As shown in table 2, there was greater recognition of adverse events in PACU following the implementation of the PACT, as more adverse events were recorded in PACU during phase 2 (OR 2.08, 95% CI 1.49 to 2.91, P<0.001). In particular, there was a significant increase in the detection of cardiovascular events (OR 2.51, 95% CI 1.55 to 4.06, P<0.001) and respiratory events (OR 4.29, 95% CI 1.19 to 15.40, P=0.032) and an increase in episodes of unresolved pain recorded in PACU (OR 2.57, 95% CI 1.42 to 4.66, P=0.002). There was no significant difference in the rate of clinical deterioration (OR 0.86, 95% CI 0.50 to 1.47, P=0.579).
Mantel-Haenszel common Odds Ratio estimates comparing frequency of adverse events before (phase 1) and after (phase 2) implementation of the PACT
While the rates of all events occurring in PACU increased in phase 2, the rates of these same events following PACU discharge decreased or remained the same after the implementation of the PACT (figure 2). There was a significant decrease in the rates of clinical deterioration (OR 0.47, 95% CI 0.30 to 0.74, P=0.001) and cardiovascular events (OR 0.49, 95% CI 0.28 to 0.88, P=0.021) on the ward in phase 2 (table 2).
Frequency of patients experiencing adverse events before (P1) and after (P2) the implementation of Post-Anaesthetic Care Tool (PACT); events in Post Anaesthesia Care Unit (PACU) (blue), events after PACU discharge (green) and events starting in PACU and continuing after discharge (red).
The severity of the 379 adverse events in both phases was graded as mild for 31.3% (119/379), moderate for 64.4% (244/379) and severe for 4.2% (16/379). There was a significant increase in the proportion of patients with moderately severe adverse events in phase 2 (ORCMH=1.67, 95% CI 1.26 to 2.21, P<0.001), but there was no difference in the rate of mild or severe adverse events (table 2). This increase in moderate adverse events was greater in PACU (ORCMH=1.75, 95% CI 1.19 to 2.58, P=0.001) than for events which occurred after discharge from PACU (ORCMH=1.30, 95% CI 0.93 to 1.82, P=0.125).
As reported in table 1, there were fewer general and orthopaedic surgical procedures in phase 2 compared with phase 1 (reduced by 3.5% and 5.2%, respectively) while there was more obstetric and gynaecological surgery (increased by 6.3%). These differences were significant. Therefore, in comparing the adverse event rates in each phase, logistic regression was conducted to adjust for type of surgery, ASA status, admission type, gender and age (online supplementary table S1). Adjustment was made only for all adverse events in PACU, as this was the adverse event rate that was significant overall. No adjustment for subanalysis was conducted due to small sample size. As illustrated in online supplementary table S1, adjusted OR showed negligible change from the unadjusted OR.
Supplementary file 2
The median length of stay for all patients in PACU was 49.0 min (95% CI 47.7 to 50.3), with a range from 6 min to 9.2 hours. Approximately 1 in 20 (4.4%, n=63/1417) patients remained in PACU longer than 2 hours. The most common reasons for discharge delay were patient transfer delay due to unavailability of ward nurses for PACU patient handover (6.6%) and complex recovery (5.9%). Compared with phase 1, more patients experienced a delay in discharge from PACU in phase 2 (15.5% vs 25.4%, P<0.001). This was primarily due to complex patient recovery (3.5% vs 8.5%, P<0.001), with more patients fulfilling MET activation criteria while in PACU during phase 2 (6.5% vs 13.8%, P<0.001).
Using Kaplan-Meier survival analysis, where discharge from PACU was the event, there was a small but significant increase in median length of stay in PACU from 45 min (95% CI 43.3 to 46.7) in phase 1 to 53 min (95% CI 51.3 to 54.7, P<0.001) in phase 2 (figure 3A). In contrast, for patients who experienced an adverse event in PACU, the median length of stay in PACU decreased significantly from 100 min (95% CI 83.8 to 116.2) in phase 1 to 83 min (95% CI 68.9 to 97.1, P=0.017) in phase 2 (figure 3B).
(A) Kaplan-Meier survival curves for length of stay in Post Anaesthesia Care Unit (PACU) for all patients before (phase 1, blue line) and after (phase 2, green line) implementation of the Post-Anaesthetic Care Tool (PACT). (B) Kaplan-Meier survival analysis of length of stay in PACU for patients who experienced an adverse event in PACU, before (phase 1, blue line) and after (phase 2, green line) implementation of the PACT.
These differences in PACU length of stay are shown in table 3, where the results of a Cox regression are presented. Patients in phase 1 had significantly shorter median length of stay compared with those in phase 2, with a HR of 1.25 translating to the rate of discharge before PACT being 25% higher than after implementation of the PACT. Having an adverse event in PACU was associated with longer median PACU length of stay of 91.0 min (95% CI 84.2 to 97.8), regardless of phase. Following the implementation of the PACT, the median length of stay decreased significantly for patients who experienced an adverse event in PACU. The HR of 0.68 translates to the rate of discharge after the implementation of the PACT being 47% improved compared with before PACT (table 3).
Median length of stay in PACU before (phase 1) and after (phase 2) implementation of the PACT, for all patients and for those who experienced an adverse event in PACU
There was no difference in discharge destination from PACU for patients in phase 1 or 2. Patients were discharged from PACU to the day procedure unit (46%, n=650/1415), the short stay unit (11%, n=158/1415) or a ward (42%, n=600/1415). A small number of patients (0.5%, n=7) had an unplanned transfer from PACU to the intensive care unit. Four patients died during the hospital admission in phase 1 while no patient died during the hospital admission in phase 2 (P=0.022).
Health service usage and healthcare costs
There was a small but significant increase in the median length of hospital admission from 0.5 days (IQR=1.7) in phase 1 to 1.0 days (IQR=1.7) in phase 2 (P=0.029). This was reflected in an increase in the proportion of patients remaining in hospital overnight from phase 1 to phase 2 (22.1% vs 30.1%, P=0.002). After the implementation of the PACT, small, non-significant changes in health service use were noted with fewer unplanned hospital readmissions in the month following discharge (3.7% vs 3.0%, P=0.732), and more emergency department visits (1.8% vs 2.5%, P=0.320).
Aggregated costs were averaged across patients with complete data for phase 1 (n=707) and phase 2 (n=669) patients, respectively (table 4). The results can therefore be interpreted as the expected average impact on costs per patient of receiving care with the PACT compared with those receiving care before implementation of PACT. The average patient acuity, determined using independent hospital pricing authority (IPHA) cost weights for 2014–201525 was found to be 1.51 in phase 1 and 1.66 in phase 2. The difference was not statistically significant, suggesting that any differences in costs and length of stay between phases 1 and 2 were not attributable to differences in the average severity of the condition of patients at the time of discharge.
Economic evaluation comparing before (phase 1) with after (phase 2) implementation of the PACT.
The average cost difference for the initial surgical admission increased from $A5645 (n=707) in phase 1 to $A6433 (n=669) in phase 2, an increase of $A788 per patient (P=0.123). Cost–weight analysis using AR-DRGs for initial admissions, unplanned readmissions, intensive care admissions and visits to the emergency department were included (table 4). While the average cost for the original admissions increased, there was a decrease in the number of unplanned readmissions with a consequent decrease in the average cost per patient. The number of unplanned emergency department visits after discharge increased, but the average cost increase per patient was negligible. The researchers noted one outlier with regard to healthcare costs, in that one patient in phase 1 was readmitted for 76 days, including 295 hours in intensive care, with a total cost of $A239 766. This was more than twice the cost of the next most costly readmission for either phase 1 or 2 of the study. The cumulative total costs per patient were therefore examined using median values. Overall, there was a cumulative total cost increase of $A453 per patient following the intervention, which was not statistically significant (P=0.425).
Discussion
This study aimed to evaluate whether use of the PACT would (1) enhance the recognition and response to patients at risk of deterioration, (2) result in improved patient outcomes and (3) reduce healthcare costs. It is clear that the number of patients recognised to have an adverse event significantly increased after the introduction of the PACT (P<0.001), including cardiovascular and respiratory events and unresolved pain. Implementation of the PACT provided nurses with clear and comprehensive criteria to assess patient readiness for discharge from PACU. Assessment tools which use a scoring system, such as the Aldrete, modified Aldrete and post-anaesthetic discharge scoring system (PADSS),27 28 are commonly used internationally. In contrast, the PACT is consistent with the ‘track and trigger systems’ specified in the national standards of the Australian Commission on Safety and Quality in Health Care (ACSQHC).29 Track and trigger systems enable nurses to recognise and respond to patient deterioration by specifying thresholds in the observation chart using graphical colour shading when the patient’s vital signs fall outside the ‘normal’ parameters.19 30 31 According to ACSQHC, different track and trigger systems are used internationally, with varying parameters to identify level of abnormality. Importantly, track and trigger charts specify required responses when patient deterioration is recognised or when an observation threshold is crossed.21
The PACT included these thresholds in the observation section and specified that for safe patient discharge, the last two recordings of observations must not be outside the threshold. However, the tool allowed for modification of these escalation factors (MET activation criteria) if required for an individual patient by the anaesthetist.
Following the implementation of the PACT, there was an increase in nurses identifying patients with adverse events and seeking medical review. The comprehensiveness of the tool enabled nurses to identify patients whose observations fell outside the normal parameters and appropriately respond by consulting the anaesthetist prior to patient discharge from the PACU, if required. Postoperative deterioration has been shown to be a common event in PACU.12 It is therefore not surprising that using the PACT led to the identification of and response to more adverse events in the PACU and lower rates of clinical deterioration, cardiovascular and/or respiratory events and unresolved pain in the ward setting. These findings are also consistent with a longitudinal study of 855 870 admissions by O’Connell and colleagues who found that immediately following the implementation of an observation and response chart with altered calling criteria, there was a sudden increase in the MET call rate of 82% which then gradually fell over the following 6 months, but still remained higher than prior to the introduction of the new chart.32
There are a number of studies investigating adverse events in the acute care setting following surgery. However, to our knowledge, this is the first prospective study to explore the influence on nursing assessment and management of patients in the PACU following the introduction of a standardised, evidence-based PACU discharge tool designed to promote identification of, and response to postoperative complications. The rates of adverse events reported in the current Australian study are similar to those reported internationally. In a survey of over 2000 patients admitted to one Canadian PACU, rates of 3.5% for excessive pain, 6.0% for nausea and vomiting, 1% for a critical respiratory event and 3.5% for cardiac related events were reported.33 Large record reviews of Medicare hospital admissions in the United States have identified postoperative complication rates of 13%–20%34 35 and unscheduled readmission rates of 12.8%. An Australian study of 1291 patients found 20% of patients required medical review for unexpected complications.13 Although lower postoperative complication rates have been cited,10 other studies often limit their analysis to serious adverse events or to specific surgical procedures. In the current study, rates of many adverse events increased significantly after the introduction of the PACT. This is a positive outcome, indicating that the standardised discharge tool enabled nursing staff to better recognise and respond to deterioration before the patient condition became critical.
The second aim of the study was to evaluate whether use of the PACT would result in improved patient outcomes. Following the implementation of the PACT, length of stay in PACU and length of hospital admission decreased significantly for those patients who had an adverse event in PACU. This suggests that early detection and response to patients in PACU resulted in improved patient outcomes, specifically reduced time in PACU and hospital. Further, there were fewer unplanned ICU admissions and unplanned hospital readmissions in phase 2. There was a non-significant increase in emergency department visits within 48 hours of discharge from 13 (1.8%) in phase 1 to 17 (2.5%) in phase 2. These severe adverse events were quite rare, so no statistically significant difference could be detected. Mild adverse events were common, but by definition these events do not require any intervention and the patient recovers from these spontaneously.
The third aim of the study was to determine through an economic analysis whether there was a reduction in healthcare costs following the intervention. The findings of the economic analysis confirm that the implementation of the PACT was cost-effective; the improved patient outcomes were not associated with any significant change in costs to the health service and only minor non-significant differences between the costs for the initial admissions, ICU stays, emergency visits and unplanned readmissions were identified. There was a non-significant increase of the average costs per patient of $A453.
Study limitations
Emergency patients, with unscheduled surgery were not included in this prospective study due to ethical and logistical considerations, primarily relating to consent and incomplete documentation for emergency admissions.
We acknowledge that missing data are a limitation of the study. We decided not to perform statistical data manipulation using multiple imputation to fill in missing values. This has been supported by comprehensive simulation study that suggests available statistical techniques for data manipulation are naive and do not take into account the complexity of missing data mechanism.36 As a result, per protocol analyses have been presented.
There was a difference between phases 1 and 2 in the characteristics of the day of surgery and surgical category. These two variables are correlated in that surgical specialty teams are scheduled to operate on certain days of the week. This was an unfortunate but not highly significant confounder in the analysis. To examine the potential for various patient, surgery and admission characteristics to confound the comparison of adverse events rates, logistic regression was conducted and the ORs adjusted for significant confounders.
This was a quasi-experimental study which had the natural limitation of all before–after studies with no parallel control group. There may be factors external to the implementation of the PACT that increased or decreased surgical risk over the duration of the study. Determining the impact of sensitisation of the nursing staff to the PACT tool would require a full-scale cluster randomised controlled trial (RCT). Similar study designs are common in this area,8 32 37 38 as running a cluster RCT is not always a pragmatic option. Sensitisation is highly correlated with improvement in the early intervention implementation period and as time passes its effect will be diluted.
Conclusions
Using a structured observation, response and discharge chart in PACU enhanced nurses’ recognition and response to patients who experienced clinical deterioration. Furthermore, it resulted in reduced length of stay for patients who experienced an adverse event in PACU and was cost-effective. This study provides evidence of a relatively high overall risk to patient safety following surgery, with one in four elective surgical patients experiencing an adverse event. If a patient had an adverse event in PACU, this triggered greater response by nurses in the post-implementation phase, through the use of the PACT. There was a consequent decrease in the rates of clinical deterioration and cardiac events following discharge from PACU. These findings highlight the importance of close patient monitoring in the immediate postoperative period, in PACU and continuing on the ward.
Acknowledgments
The authors acknowledge the support of Eastern Health executives, in particular Adjunct Professor David Plunkett, and nursing management as well as staff at each of the study sites for their contribution to this project. We specifically acknowledge the contribution of health professionals working in the perioperative area on the development of the Post-Anaesthetic Care Tool, in particular Ms Trish Grasso who was a driving force in the early stages. We gratefully acknowledge the following nurses who conducted data collection: Mrs Leanne Barbazza, Mrs Monica Beninca, Ms Jessica Guinane, Ms Renata Mistarz, Mrs Nicole Robertson, Mrs Louise Thomas and Ms Melissa Ayres. Alfred Deakin Professor Rob Carter, from Deakin Health Economics, guided the cost-effectiveness evaluation and A/Professor Andrew Dalton contributed to this.
References
Footnotes
Contributors MS designed the study, acquired the data, monitored its collection, analysed the data, and drafted and revised the paper. NMP contributed to study design and interpretation of the data. She also assisted with drafting the manuscript. MM contributed to study design, advised with regard to data analysis and reviewed the draft manuscript. BK advised on each aspect of the study, participated in interpretation of the data and critically appraised the draft manuscript.
Funding This study was externally funded by the Health Contributions Fund (HCF) Research Foundation, an Australian not-for-profit charitable trust, established to encourage health service research for the benefit of HCF contributors and the public generally.
Competing interests None declared.
Ethics approval The research project was approved by the Human Research Ethics Committees of the Health Service and Deakin University as a low-risk study and waiver of consent for patients was granted.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.