Article Text

Download PDFPDF

Original research
Novel risk score for acute upper gastrointestinal bleeding in elderly patients: a single-centre retrospective study
  1. Yajie Li1,
  2. Qin Lu2,
  3. Mingyang Song3,
  4. Kexuan Wu3,
  5. Xilong Ou2
  1. 1Department of Gerontology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
  2. 2Department of Gastroenterology, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
  3. 3School of Medicine, Southeast University, Nanjing, China
  1. Correspondence to Dr Xilong Ou; ouxilong2021{at}163.com

Abstract

Objectives Acute upper gastrointestinal bleeding (UGIB) is a common reason for emergency hospital admission. Identifying low-risk patients suitable for outpatient management is a clinical and research priority. This study aimed to develop a simple risk score to identify elderly patients with UGIB for whom hospital admission is not required.

Design This was a single-centre retrospective study.

Setting This study was conducted at Zhongda Hospital affiliated with Southeast University in China.

Participants Patients from January 2015 to December 2020 for the derivation cohort and from January 2021 to June 2022 for the validation cohort were enrolled in this study. A total of 822 patients (derivation cohort=606 and validation cohorts=216) were included in this study. Patients aged ≥65 years with coffee-grounds vomiting, melena or/and haematemesis were included in the analysis. Patients admitted but had UGIB or transferred between hospitals were excluded.

Methods Baseline demographic characteristics and clinical parameters were recorded at the first visit. Data were collected from electronic records and databases. Multivariable logistic regression modelling was performed to identify predictors of safe discharge.

Results 304/606 (50.2%) and 132/216 (61.1%) patients were not safely discharged in the derivation and validation cohorts, respectively. A clinical risk score of five variables was entered into UGIB risk stratification: Charlson Comorbidity Index >2, systolic blood pressure <100 mm Hg, haemoglobin <100 g/L, blood urea nitrogen ≥6.5 mmol/L, albumin <30 g/L. The optimal cut-off value was ≥1, the sensitivity was 97.37% and the specificity was 19.21% for predicting the inability to discharge safely. The area under the receiver operating characteristic curve was 0.806.

Conclusions A novel clinical risk score with good discriminative performance was developed to identify elderly patients with UGIB who were suitable for safe outpatient management. This score can reduce unnecessary hospitalisations.

  • gastroduodenal disease
  • geriatric medicine
  • gastroenterology

Data availability statement

Data are available upon reasonable request. The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • This was the first study on the construction of a risk score for upper gastrointestinal bleeding in elderly patients.

  • This risk score used simple and easily available parameters that can be implemented in almost every hospital.

  • This was a single-centre retrospective study.

  • The patients discharged from the emergency department were not included in the analysis, which might introduce some bias.

Background

Upper gastrointestinal bleeding (UGIB) is defined as bleeding within the gastrointestinal tract proximal to the ligament of Treitz and is a common medical emergency. In recent years, the incidence of UGIB was 67/100 000 adults per year in the USA and 134/100 000 in the UK, with mortality rates ranging from 2% to 8.6%.1 2 UGIB is a significant cause of morbidity and mortality in elderly patients, with more than US$1 billion in indirect medical costs annually in the USA.1 3 The incidence increased with age, meaning elderly patients had a higher incidence of UGIB (197/100 000 in those aged 65–75 and 425/100 000 in those over 75 years).4 By 2030, approximately 0.3 billion people in China will be over 65 years old. Several risk-scoring systems have been developed to predict outcomes, including mortality, the need for hospital-based intervention and the need for blood transfusion; these include the Rockall Score (RS), Glasgow Blatchford Score (GBS), the AIMS65 and MAP(ASH).5–9 The Asia-Pacific working group consensus suggested that UGIB can be managed using ‘early risk stratification’ with influential prognostic factors.10 However, the latest UGIB guidelines for elderly patients were released in 2013 by the American Society for Gastrointestinal Endoscopy.11

A systematic review of 16 studies showed that the GBS was more sensitive and specific than the RS and AIMS65 in predicting hospital intervention and 30-day mortality requirements.12 Implementing GBS prognostic assessment was associated with a 15–20% reduction in hospitalisations due to UGIB.13 Therefore, it was recommended to identify patients at very low risk and manage them as outpatients. However, to date, there have been few studies on these scoring systems for UGIB in elderly patients: Wang et al reported that the RS accurately predicted rebleeding and mortality outcomes in order adults with acute UGIB; however, the area under the receiver operating characteristic curves (AUROC) was lower than 0.8.14 Kalkan et al also reported that the RS predicted mortality and rebleeding more accurately than the GBS or the AIMS65.15 The sample sizes of both studies were small (341 and 335).

An international consensus group guideline recommended using risk scores to assess UGIB patients; nevertheless, its role in managing geriatric patients remains unclear.5 16

When managing UGIB patients, the challenge faced by emergency department (ED) physicians is determining the cause and whether the patient should be hospitalised for further management. However, there is no internationally recognised effective scoring system for elderly patients to stratify the disease.

We aimed to develop and validate a simple risk score system to identify elderly patients who can be safely managed as outpatients and those who will benefit from inpatient care. We also compared the discriminative ability of the new score system with the previously published risk-scoring systems.

Methods

Design

We conducted two retrospective studies: one from January 2015 to December 2020 for the derivation cohort and the other from January 2021 to June 2022 for the validation cohort.

Setting

This study was conducted at Zhongda Hospital affiliated with Southeast University in China.

Operational definitions

UGIB

Bleeding in the gastrointestinal tract proximal to the ligament of Treitz, presenting with coffee-ground vomiting, melena or/and haematemesis.5 16

Safe discharge

None of the following symptoms after presentation17: rebleeding or blood transfusion; therapeutic intervention to control bleeding; all causes of death.

Rebleeding

The presentation of melena or/and fresh haematemesis associated with the development of shock (systolic blood pressure (SBP) <100 mm Hg or/and pulse >100 beats/min or/and haemoglobin (Hb) decreased by more than 20 g/L after successful initial treatment).5

Blood transfusion

The indication for blood transfusion was an Hb level decreasing an average of <70 g/L or 80 g/L in patients at high risk of heart disease.18

Therapeutic intervention

Endoscopic, radiological or surgical haemostasis.

Endoscopic management

The indication for endoscopic treatment was Forrest Ia-IIb ulcer bleeding.19

Elderly patients

Age ≥65 years.20

Patient and public involvement

No patients or members of the public were involved in the design, conduct or reporting of study results. The study results were not disseminated to study participants.

Data collection

Patients with coffee-grounds vomiting, melena or/and haematemesis were included. The inclusion criteria were presentation in the ED with black stool and/or haematemesis, age ≥65 years old and faecal occult blood positivity. The exclusion criteria were UGIB during hospitalisation, incomplete data, transfer from other hospitals and lower gastrointestinal bleeding manifested as bloody stool.

We recorded the following from the electronic medical record system: demographic data (sex and age), clinical presentation, comorbidities, medications history (including antiplatelet drugs, oral anticoagulant agents and/or non-steroidal anti-inflammatory drugs), haemodynamic parameters, Hb, biochemical parameters (coagulation panel, albumin, creatinine and urea nitrogen) were recorded. The need for endoscopic treatment, blood transfusion, radiological intervention or surgery was also analysed.

Data analysis

Eleven predictors were selected from both biological and clinical perspectives: age, sex, Charlson Comorbidity Index (CCI), SBP, heart rate, use of oral anticoagulants or oral antiplatelet agents, Hb (g/L), international normalised ratio (INR), albumin (g/L), serum urea nitrogen (mmol/L) and creatinine (μmol/L). The CCI was used to define comorbidities.21

We use SPSS V.22.0 and MedCalc V.19 for statistical calculations. Count data were expressed as the number of cases (n, %), and the χ2 test was used for comparisons. Measurement data with normal distribution were expressed as mean±SD (x±s), and independent sample t-test or univariate analysis was used to compare groups. The measurement data with non-normal distribution were expressed as median (quartile) (M (Q1, Q3)), and the Mann-Whitney U test was used for comparisons. Regression models were constructed. Statistically significant variables in univariate analyses were included in the multivariate regression analyses. Regression models were constructed using backward elimination. The variables in the final regression model were classified according to the thresholds most closely related to safe discharge, resulting in easily calculated scores. Results were expressed as ORs with 95% CIs. The Hosmer-Lemeshow test was used to evaluate the goodness of fit.

A new risk score was generated based on the established logistic regression model. Receiver operating characteristic (ROC) curves with 95% CIs were used for predicting the identified ability of outcomes. Sensitivity, specificity, positive predictive value and negative predictive value were also calculated.22 The DeLong test was used to compare areas under the curve (AUCs).

Results

We included 822 patients (derivation cohort=606 and validation cohort=216). The incidence of not safely discharged (NSD) was 50.2% (304/606) and 61.1% (132/216) in the derivation and validation cohorts, respectively.

Most patients (404/606, 66.7%, and 158/216, 73.1%) were men (table 1); the median ages were 74 (68–79) and 77.5 (71–84), respectively. The incidence of diabetes, any malignancy and renal failure differed significantly between the groups, and almost one-fifth of patients had a CCI score of >2, which suggests higher morbidity in the NSD cohort (27.6% vs 9.3%, p<0.01) (table 2).

Table 1

Comparison of demographic and mean clinical parameters of the two cohort study populations

Table 2

Demographics and mean clinical parameters of the study population in the derivation cohort

Patients in the NSD cohort were more likely to have tachycardia (heart rate ≥100, 17.2% vs 7.9%, p=0.019), hypotension (SBP <100 mm Hg, 16.4% vs 3.3%, p<0.01) and lower Hb and albumin (Hb <100 g/L, 85.5% vs 43.0%, p<0.01 and albumin <30 g/L, 42.1% vs 10.6%, p<0.01). Blood urea nitrogen (BUN) was higher (≥6.5 mmol/L, 80.3% vs 63.6%, p<0.01). Coagulopathy was more frequent (INR ≥1.5 5.6% vs 0.7%, p<0.01).

Table 3 displays the clinical outcomes and therapeutic interventions. More than one-third of patients required blood transfusion (n=268/606, 44.2%), and 124 (20.5%) suffered rebleeding. Overall, 108 patients (17.8%) underwent a therapeutic intervention during admission. Fifty (8.4%) required admission to the intensive care unit. The mortality rate was 8.6% (52 patients).

Table 3

Severity outcome and therapeutic interventions of the study population in the derivation cohort

Logistic regression

Based on calculations from the derivative cohort, significant predictors (p<0.05) included: CCI >2, HR ≥100, SBP <100 mm Hg, BUN ≥6.5 mmol/L, Hb <100 g/L, albumin <30 g/L, coagulopathy (INR ≥1.5) and creatinine >100 µmol/L (table 4).

Table 4

Univariable analysis for predictive factors of not safely discharged in the derivation cohort

These variables were included in a multivariate logistic regression model—CCI >2, SBP <100 mm Hg, BUN ≥6.5 mmol/L, Hb <100 g/L and albumin <30 g/L were statistically significant in predicting NSD (table 5). The final logistic regression function was log (odds of NSD) = 0.636 (BUN)+1.616 (Hb)+1.065 (albumin)+0.455 (CCI)+1.479 (SBP)−2.193. These variables were used to develop a prognostic scoring model (table 6).

Table 5

Multivariable logistic regression analysis for predictive factors of not safely discharged in the derivation cohort

Table 6

Prognostic factors for not safely discharged for inclusion in our clinical risk score

The optimum cut-off was ≥1 point(s), the sensitivity was 97.37%, the specificity was 19.21%, the positive predictive value was 54.8% and the negative predictive value was 87.9% for predicting NSD (table 7). Only GBS ≤1 and our risk score=0 achieved a sensitivity at 97.37%; AIMS65=0 and MAP(ASH)=0 had maximal sensitivities of 96.71% and 79.61%, respectively. Our risk score performed better than GBS ≤1 for correctly classifying patients who could safely be discharged (p<0.05). Our risk score had a specificity of 19.21% at a sensitivity of 97.37% compared with a specificity of 11.92% and sensitivity of 97.37% with GBS ≤1.

Table 7

Clinical risk score for not safely discharged with sensitivity, specificity, PPV and NPV

The AUCs of our risk score, GBS, MAP(ASH) and AIMS65 are displayed in table 8 and figure 1. For both cohorts, our risk score had the largest AUCs of 0.806 and 0.807, respectively, which were significantly higher than those of GBS, MAP(ASH) or AIMS65 (p<0.05).

Table 8

Values of the three scoring systems in the prediction of not safely discharged

Figure 1

Curves for three scoring systems in evaluation of not safely discharged. GBS, Glasgow Blatchford Score.

Discussion

The mortality rate for non-variceal UGIB decreased from 4.5% in 1989 to 2.1% in 2009, and the incidence decreased from 108 to 78 cases per 100 000 population in 1994 and 2009. However, the economic burden of immediate hospitalisation for UGIB increased from US$3.3 billion to US$7.6 billion, and a similar trend was observed for variceal UGIB.23

Barkun et al proposed that using a prognostic score system and early discharge with low risk would reduce the associated costs without increasing harm.16 The initial assessment aimed to determine whether admission was required or an endoscopic intervention was required urgently or could be managed in the outpatient setting.24

Several risk-scoring systems have been used for UGIB patients; however, most are used to predict mortality, rebleeding and intervention as endpoints.5–9 The full RS was derived in 1996 from 4185 cases of UGIB in the UK and designed to predict mortality.5 Because the full RS relied on endoscopic findings, its use in initial ED assessment was limited.

Blatchford et al cited Hb, blood urea, pulse, SBP, presentation with syncope or melena and evidence of hepatic disease or cardiac failure as factors predicting the need for intervention.7 The 2019 International Consensus Group guidelines recommended a GBS ≤1 to identify patients at very low risk for rebleeding or mortality and thus may not require hospitalisation or inpatient endoscopy.16 GBS is clinically useful; however, it is evaluated using eight factors, making calculations cumbersome and decreasing its use in clinical practice in China.

Saltzman et al constructed a prediction model named AIMS65 comprising albumin, INR, altered mental status, blood pressure and age to predict death; they reported an area under the ROC of 0.77 for predicting death.6 AIMS65 provided a more age-appropriate score and might be a beneficial supplement to a risk stratification model for distinguishing high-risk patients. The International Consensus Group recommended against using the AIMS65 prognostic score to predict the need for hospitalisation.16 MAP(ASH) score was established in 2020. MAP(ASH) has good predictive accuracy for intervention and mortality.9 However, it was a new risk score, and further research is needed to confirm its predictive effect. Furthermore, there were few studies on those score systems on geriatric patients to validate whether they suit elderly patients. Our previous research25 found that MAP(ASH), GBS, AIMS65 and pRS (the preendoscopic Rockall score) only performed reasonably in predicting mortality and intervention with the AUROCs all below 0.8, indicating they might not be very suitable for elderly patients.

It is challenging to determine the most critical outcomes in patients with UGIB. Initially, death was the priority; however, studies showed that the mortality rate of UGIB had decreased in the last two decades.23 Increasing attention was paid to risk scores to predict profitable outcomes such as safe discharge,16 in which low-risk patients could avoid hospitalisation and be managed as outpatients.

We derived a simple risk score system with five variables that can be used to distinguish between patients who can be safely managed as outpatients and those who will benefit from inpatient care. The system was designed to prevent rebleeding, blood transfusion and hospital-based intervention to control bleeding and death to capture adverse events. Previous studies had reported that unstable vital signs, anaemia, hypoproteinaemia, azotemia and existing comorbidities were predictive of adverse outcomes.7 26 In our study, we identified CCI >2, SBP <100 mm Hg, Hb <100 g/L, BUN ≥6.5 mmol/L and albumin <30 g/L as risk factors. We included the use of antiplatelet/anticoagulant medications, INR ≥1.5, age, sex, heart rate and creatinine in the model; however, these were not statistical predictors and therefore were not included in the score. Other studies suggested that the use of antiplatelet or anticoagulant medications and coagulopathy might be related to the increased severity of bleeding.7 27 Still other studies found that advancing age and creatinine were risk factors for predicting adverse outcomes.7 26 These findings are inconsistent with our results, probably because the target populations differ.

In practice, risk stratification scores are used to guide clinical care to select thresholds that maximise sensitivity and minimise false negatives. The guidelines suggest that patients with GBS ≤1 might be discharged to outpatient management because very few of these patients require hospital-based intervention or blood transfusion or die. In our study, the GBS ≤1 recommended by the guidelines as a cut-off value had a sensitivity of 97.37% and a specificity of 11.92% for the composite outcome. At the matched sensitivity of 97.37% (compared with GBS), the specificity significantly increased from 11.92% to 19.21%, suggesting that our score could increase the number of patients who could be safely discharged by more than 1.5-fold.

Our risk score predicted the composite outcome in the present cohort better than the current commonly used clinical risk scores (GBS, AIMS65 and MAP(ASH)). Our score improves the ability to identify very low-risk elderly patients who can be safely discharged.

A patient scoring 0 points at presentation has an 87.9% chance of safe discharge from the ED. We recommend using this threshold for patients with no other hospitalisation indications. In our cohort, 30–50% of patients presenting with UGIB could be safely discharged. A large micro-cost study in UGIB found that the average cost per patient was £2458 in the UK, and 60% of the cost was attributed to the cost of an inpatient bed. A 30–50% reduction in hospital admissions would reduce the financial burden.28

This study has several limitations. This was a single-centre retrospective study; patients discharged directly from ED were omitted, which might have led to selection bias. However, the patients suitable for discharge directly from ED were likely to be safely discharged with UGIB and might not significantly impact our risk score. An integral part of the safe discharge outcome is the absence of blood transfusion, which might be inaccurate because many transfusions might be considered unneeded when layered according to vital signs and anaemia.29 30 These factors might lead to underestimating the ratio of patients who can be discharged safely.

Our study was based on clinically accessible risk stratification for elderly patients with UGIB. To our knowledge, ours is the first analysis of this type. The ROC curve showed higher predictive accuracy and sensitivity for patients with a threshold ≥1 point, which would facilitate the discharge of low-risk patients. The model is easy to implement and can assist clinical decision-making and early identification of patients with severe UGIB requiring aggressive blood cell transfusion, entering monitoring units and requiring intervention.

In conclusion, our risk score uses five easily quantifiable fundamental predictors and is easy to calculate. Compared with the previously available four risk scores, our prediction of safe discharge was the best. The score could be included in the acute medical triage route to identify UGIB patients who can be safely discharged. Further research is required to validate these findings.

Data availability statement

Data are available upon reasonable request. The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.

Ethics statements

Patient consent for publication

Ethics approval

This study was approved by the Ethics Committee for Clinical Research of Zhongda Hospital, affiliated to Southeast University. This study used the medical records obtained from the past clinical diagnosis and treatment. Upon application, the Ethics committee agreed that informed consent was not required. All methods were carried out in accordance with relevant guidelines and regulations. The ethics reference number: 2021ZDSYLL333-P01.

References

Footnotes

  • Contributors YL, QL and XO conceived of the study. YL, MS and KW contributed to data collection. XO was responsible for data analyses. All authors contributed to interpretation of the results. YL drafted the manuscript. All authors contributed to the refinements of the manuscript and approved the final manuscript for publication. XO is the guarantor of the manuscript.

  • Funding This work was financially supported by the Nanjing Health, Science and Technology Development special fund project (YKK20235).

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.