Acute kidney injury in intensive care unit patients: a comparison between the RIFLE and the Acute Kidney Injury Network classifications

Abstract

Introduction

Whether discernible advantages in terms of sensitivity and specificity exist with Acute Kidney Injury Network (AKIN) criteria versus Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease (RIFLE) criteria is currently unknown. We evaluated the incidence of acute kidney injury and compared the ability of the maximum RIFLE and of the maximum AKIN within intensive care unit hospitalization in predicting inhospital mortality of critically ill patients.

Methods

Patients admitted to the Department of Intensive Medicine of our hospital between January 2003 and December 2006 were retrospectively evaluated. Chronic kidney disease patients undergoing dialysis or renal transplant patients were excluded from the analysis.

Results

In total, 662 patients (mean age, 58.6 ± 19.2 years; 392 males) were evaluated. AKIN criteria allowed the identification of more patients as having acute kidney injury (50.4% versus 43.8%, P = 0.018) and classified more patients with Stage 1 (risk in RIFLE) (21.1% versus 14.7%, P = 0.003), but no differences were observed for Stage 2 (injury in RIFLE) (10.1% versus 11%, P = 0.655) and for Stage 3 (failure in RIFLE) (19.2% versus 18.1%, P = 0.672). Mortality was significantly higher for acute kidney injury defined by any of the RIFLE criteria (41.3% versus 11%, P < 0.0001; odds ratio = 2.78, 95% confidence interval = 1.74 to 4.45, P < 0.0001) or of the AKIN criteria (39.8% versus 8.5%, P < 0.0001; odds ratio = 3.59, 95% confidence interval = 2.14 to 6.01, P < 0.0001). The area under the receiver operator characteristic curve for inhospital mortality was 0.733 for RIFLE criteria (P < 0.0001) and was 0.750 for AKIN criteria (P < 0.0001). There were no statistical differences in mortality by the acute kidney injury definition/classification criteria (P = 0.72).

Conclusions

Although AKIN criteria could improve the sensitivity of the acute kidney injury diagnosis, it does not seem to improve on the ability of the RIFLE criteria in predicting inhospital mortality of critically ill patients.

Introduction

Multiple definitions have until recently been used for acute kidney injury (AKI), and therefore the wide variation in definitions has made it difficult to compare results across studies and populations [1]. Recently, however, the Acute Dialysis Outcome Initiative group proposed a classification for AKI – the Risk, Injury, Failure, Loss of Kidney Function, and End-stage Kidney Disease (RIFLE) classification – in order to have a uniform standard for diagnosing and classifying AKI [2]. The standard defines three grades of severity – risk (Class R), injury (Class I) and failure (Class F) – and two outcome classes – loss of kidney function and end-stage kidney disease [2].

This classification system includes separate criteria for creatinine and urine output. A patient can fulfill the criteria through changes in serum creatinine or changes in urine output, or both. The criteria that lead to the worst possible classification should be used. Class R is considered if there is an increase of serum creatinine X1.5 or an urinary output < 0.5 ml/kg/hour for 6 hours; Class I is considered if there is an increase of serum creatinine X2 or an urinary output < 0.5 ml/kg/hour for 12 hours; and Class F is considered if there is an increase of serum creatinine X3, or in patients with serum creatinine >4 mg/dl if there is an acute rise in serum creatinine of at least 0.5 mg/dl, or a urinary output < 0.3 ml/kg/hour for 24 hours, or anuria for 12 hours (Table 1).

Table 1 Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease classification [2]

Several studies have demonstrated that the RIFLE criteria have clinical relevance for the diagnosis of AKI, classifying the severity of AKI and for monitoring the progression of AKI, as well as having predictive ability for mortality in hospitalized patients in general, and patients in the intensive care unit (ICU) setting in particular [3–12]. Nevertheless, a more recent classification for AKI based on the RIFLE system has been proposed by the Acute Kidney Injury Network (AKIN) [13]. This new staging system (Table 2) differs from the RIFLE classification as follows: it reduces the need for baseline creatinine but does require at least two creatinine values within 48 hours; AKI is defined as an abrupt (within 48 hours) reduction in kidney function, currently defined as an absolute increase in serum creatinine ≥0.3 mg/dl (≥26.4 μmol/l), a percentage increase in serum creatinine ≥50% (1.5-fold from baseline), or a reduction in urine output (documented oliguria < 0.5 ml/kg/hour for > 6 hours); risk maps to Stage 1, but it also considers an increase in serum creatinine ≥0.3 mg/dl (≥26.4 μmol/l); injury and failure map to Stages 2 and 3, respectively; Stage 3 also includes patients who need renal replacement therapy irrespective of the stage they are in at the time of renal replacement therapy; and the two outcome classes loss and end-stage kidney disease have been removed.

Table 2 Classification/staging system for acute kidney injury [13] modified from the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease criteria [2]

These modifications were based on the accumulating evidence that small increases in serum creatinine are associated with adverse outcomes, and on the variability inherent in commencing renal replacement therapy and inherent to resources in different populations and countries. Despite the AKIN criteria possibly having greater sensitivity and specificity, it is currently unknown whether discernible advantages exist with one approach towards definition and classification versus the other.

In the present study, we evaluated the incidence of AKI and compared the ability of the maximum RIFLE and of the maximum AKIN within ICU hospitalization in predicting inhospital mortality of critically ill patients.

Materials and methods

The present study is retrospective, including all patients admitted to the ICU of the Hospital de Santa Maria (Lisbon, Portugal) between January 2003 and December 2006. Variables such as age, gender, race, body weight, history of cardiovascular disease (angina pectoris, myocardial infarction, cerebrovascular disease, and diabetes mellitus), primary diagnosis, Simplified Acute Physiology Score version II, vasopressor use, need for mechanical ventilation or renal replacement therapy, serum creatinine, urine output and outcome were collected from the ICU database and patient medical charts.

Baseline serum creatinine values were unavailable and were estimated by the Modification of Diet in Renal Disease equation [14], as recommended (assuming a lower limit of the normal baseline glomerular filtration rate of 75 ml/min/1.73 m²) and previously applied [2, 4, 9]. In this ICU, serum creatinine is determined at least once a day and urine output is recorded hourly, for all patients. AKI was defined and classified by means of the RIFLE criteria [2] (Table 1) and the AKIN criteria [13] (Table 2). Patients were categorized on serum creatinine or on urine output, or both, the criteria that led to the worst classification were used, and the maximum AKIN and the maximum RIFLE within ICU hospitalization were reported. At least two serum creatinine values within 48 hours were considered to define AKIN stages. The maximum RIFLE was calculated considering the maximum creatinine with reference to the Modification of Diet in Renal Disease equation-estimated creatinine, and the reference creatinine used for AKIN staging was the lowest creatinine within a 48-hour timeframe.

Sepsis was classified in accordance with the American College of Chest Physicians and the Society of Critical Care Medicine consensus [15]. The Simplified Acute Physiology Score version II was used to evaluate illness severity, and was calculated based on the worst variables recorded during the first 24 hours of ICU admission [16]. Inhospital mortality was considered the outcome measure. Chronic kidney disease patients on dialysis and renal transplant patients were excluded from the analysis. Since this was a retrospective and observational study that did not evaluate a specific therapeutic or prophylactic intervention, institutional ethical approval was not required according to our institution's guidelines.

Statistical analysis

Continuous variables are expressed as the mean ± standard deviation, and categorical variables are presented as the percentage of the number of cases. Comparisons between RIFLE classes or AKIN stages were performed using analysis of variance and the chi-square test for continuous variables and categorical variables, respectively. Multivariate logistic regression analysis was employed to evaluate the association between RIFLE criteria and AKIN criteria with inhospital mortality. Model fit was assessed by the goodness of-fit test, and discrimination was assessed by the area under the receiver operator characteristic (AuROC) curve.

Data are presented as odds ratios (ORs) with 95% confidence intervals (CIs). A two-tailed P value < 0.05 was considered significant. Analysis was performed with the statistical software package SPSS 15.0 for Windows (Produtos e Serviços de Estatísticas, Lisboa, Portugal).

Results

During the study period 703 patients were admitted to the ICU, but 41 of them were chronic kidney disease patients undergoing dialysis and were excluded from the analysis. None of the patients had received a renal transplant. A total of 662 patients (mean age, 58.6 ± 19.2 years; 392 males; 613 Caucasian; mean Simplified Acute Physiology Score version II, 46.3 ± 18.6) were therefore evaluated. Patient baseline characteristics are summarized in Tables 3 and 4.

Table 3 Patient baseline characteristics

Table 4 Patient baseline characteristics and the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease (RIFLE) criteria

Acute kidney injury stratified by the RIFLE and AKIN criteria

AKI occurred in 43.8% of patients with a maximum RIFLE category: risk in 14.7%, injury in 11% and failure in 18.1% (Table 5). According to AKIN criteria, AKI occurred in 50.4% of patients – 21.1% with Stage 1, 10.1% with Stage 2 and 19.2% with Stage 3 (Table 5). AKIN criteria allowed the identification of more patients as having AKI (P = 0.018) and classified more patients with Stage 1 (risk in RIFLE) (P = 0.003); however, no statistically significant differences were observed for Stage 2 (injury in RIFLE) (P = 0.655) and for Stage 3 (failure in RIFLE) (P = 0.672).

Table 5 Incidence of acute kidney injury stratified by the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease (RIFLE) and the Acute Kidney Injury Network (AKIN) definition/classification schemes

Creatinine criteria led to a maximum RIFLE and a maximum AKIN in 64.1% and 67.4% of patients, respectively, whereas in almost 5% of patients it was the urine output criteria that led to a maximum RIFLE and a maximum AKIN. Creatinine and urine output criteria both led to a maximum RIFLE and a maximum AKIN in 30.3% and 27.8% of patients, respectively (Table 6).

Table 6 Patients with acute kidney injury classified by creatinine criteria or urine output criteria, or both criteria

Seventy-nine AKI patients (27.2%), defined by the RIFLE classification based on creatinine and urine output criteria, received renal replacement therapy. The requirement of renal replacement therapy was higher in accordance with severity of AKI, defined by the RIFLE classification based on creatinine and urine output criteria (risk, 2%; injury; 12.3%; failure, 56.7%; P < 0.0001; AuROC curve = 0.829), and either on creatinine criteria (risk, 2%; injury, 13%; failure, 56.1%; P < 0.0001; AuROC curve = 0.818) or on urine output criteria (risk, 0%; injury, 27.5%; failure, 77.6%; P < 0.0001; AuROC curve = 0.787).

Mortality

The overall mortality was 24.3%, and mortality was significantly higher for AKI patients as compared with non-AKI patients, as follows: AKI defined by any of the RIFLE criteria (41.3% versus 11%, P < 0.0001; OR = 2.78, 95% CI = 1.74 to 4.45, P < 0.0001) or AKIN criteria (39.8% versus 8.5%, P < 0.0001; OR = 3.59, 95% CI = 2.14 to 6.01, P < 0.0001) (Tables 7 and 8).

Table 7 Mortality according to acute kidney injury stratified by the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease (RIFLE) and the Acute Kidney Injury Network (AKIN) definition/classification schemes

Table 8 Separate multivariate regression analysis for the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease (RIFLE) and the Acute Kidney Injury Network (AKIN) classifications

The analysis was repeated using the RIFLE or AKIN classification either based only on creatinine criteria or only on urine output criteria. AKI defined by any of the criteria was associated with mortality (RIFLE creatinine, OR = 2.68, 95% CI = 1.69 to 4.25, P < 0.0001; AKIN creatinine, OR = 3.38, 95% CI = 2.05 to 5.57, P < 0.0001; RIFLE urine output, OR = 2.06, 95% CI = 1.24 to 3.42, P = 0.005; AKIN urine output, OR = 1.9, 95% CI = 1.16 to 3.14, P = 0.01). RIFLE classes and AKIN stages based on creatinine criteria predicted mortality – whereas when the maximum RIFLE and the maximum AKIN were based on urine output criteria, only Class F and Stage 3 were independently associated with mortality (Table 8).

When considering both creatinine and urine output criteria, the AuROC curve for inhospital mortality was 0.733 for RIFLE criteria (P < 0.0001) and 0.750 for AKIN criteria (P < 0.0001) (Figures 1 and 2). There were no statistically significant differences in mortality by the AKI definition/classification criteria (P = 0.72).

Figure 1

Area under the receiver operator characteristic (AuROC) curve for inhospital mortality for the Risk, Injury, Failure, Loss of Kidney Function, End-stage Kidney Disease criteria (P < 0.0001).

Figure 2

Area under the receiver operator characteristic (AuROC) curve for inhospital mortality for the Acute Kidney Injury Network criteria (P < 0.0001).

The AuROC curve for inhospital mortality was 0.729 for RIFLE creatinine (P < 0.0001) and was 0.745 for AKIN creatinine (P < 0.0001), whereas the AuROC curve was 0.619 (P < 0.0001) for RIFLE urine output and was 0.612 for AKIN urine output (P < 0.0001).

Discussion

We conducted a single-center study with 662 ICU patients to compare the new recently released definitions/classifications for AKI – the RIFLE system and the AKIN system.

We confirmed that the RIFLE system allows the identification and classification of a significant proportion of ICU patients as having some degree of AKI, and predicts inhospital mortality. These findings have also been reported in a variety of ICU patients [3, 5–12].

Nevertheless, a more recent classification for AKI based on the RIFLE system has been proposed by the AKIN workgroup [13]. This new staging system differs from RIFLE as follows: it reduces the need for a baseline creatinine value but does require at least two creatinine values within 48 hours; AKI is defined as an abrupt (within 48 hours) reduction in kidney function, currently defined as an absolute increase in serum creatinine ≥0.3 mg/dl (≥26.4 μmol/l), a percentage increase in serum creatinine ≥50% (1.5-fold from baseline), or a reduction in urine output (documented oliguria < 0.5 ml/kg/hour for > 6 hours); risk maps to Stage 1, but it also considers an increase in serum creatinine ≥0.3 mg/dl (≥26.4 μmol/l); injury and failure map to Stages 2 and 3, respectively; Stage 3 also includes patients who need renal replacement therapy irrespective of the stage they are in at the time of renal replacement therapy; and the two outcome classes loss and end-stage kidney disease have been removed. These modifications were based on the accumulating evidence that small increases in serum creatinine are associated with adverse outcomes, and on the variability inherent in commencing renal replacement therapy and inherent to resources in different populations and countries. Despite the AKIN system possibly having greater sensitivity and specificity, it is currently unknown whether discernible advantages exist with one approach towards definition and classification versus the other.

In the present study, despite AKIN criteria allowing the identification of 6.6% more patients (50.4% versus 43.8%, P = 0.018) as having some degree of AKI and increasing the number of patients classified as Stage 1 (risk in RIFLE) (from 14.7% to 21.1%, P = 0.003), no statistically significant differences in terms of inhospital mortality were found according to AKI definition/classification criteria. In a recent report Bagshaw and colleagues utilized a large multicenter (120,123 patients, 57 ICUs) clinical database and found no statistically significant differences in terms of incidence of AKI and inhospital mortality by the RIFLE criteria or the AKIN criteria in the first 24 hours after admission [17]. These observations suggest that the proposed modifications for the RIFLE classification, the most widely used definition of acute renal failure in both the critical care and nephrology literature [18], do not improve the ability of this classification in predicting inhospital mortality of ICU patients.

As suggested by a North East Italian multicenter study on AKI, classified by the RIFLE criteria, in 2,164 ICU patients [19], in our analysis the serum creatinine criteria seemed to be a better predictor of mortality than urine output. In fact, a rise in creatinine is an earlier sign of worsening renal function than oliguria. In > 60% of our patients with AKI, the creatinine criteria led to a worse RIFLE class or AKIN stage than urine output.

The current study has some limitations. First, it is a single-center and retrospective study with a relatively small cohort of patients. Second, we did not know the baseline serum creatinine level or the prevalence of chronic kidney disease (except for those undergoing dialysis). Instead, we calculated an estimate of baseline function using the Modification of Diet in Renal Disease equation, as recommended (assuming a lower limit of the normal baseline glomerular filtration rate of 75 ml/min) and previously applied [2, 4, 9]. Third, despite having hourly records of urine output, we did not have data regarding additional factors that could influence urine output such as diuretic therapy. Overall, we recognize that any biases would influence both the RIFLE criteria and the AKIN criteria, and thus would not significantly influence our conclusions.

Despite these limitations our study has several strengths. First, it is the second study comparing the incidence of AKI, defined by the RIFLE criteria and the AKIN criteria, and the prognostic ability of these classifications in ICU patients. Second, the creatinine criteria and urine output criteria were both used to define and categorize AKI. Finally, we did not limit our analysis to the first 24 hours of ICU admission, contrary to Bagshaw and colleagues [17].

Conclusion

In summary, our results suggest that although the AKIN criteria could improve the sensitivity of the AKI diagnosis, they do not improve on the ability of the RIFLE criteria in predicting inhospital mortality of critically ill patients. Taking into consideration the extensive validation of the RIFLE criteria in a higher number of patients and heterogeneous groups of patients and cohorts than any other widely accepted and applied definitions and classifications for AKI [20–22], it is time for the utilization of the RIFLE criteria in randomized controlled clinical trials as a surrogate marker of clinically important outcome to establish specific interventions for prevention or attenuation of AKI.

Key messages

• The RIFLE criteria allowed the identification of 43.8% of ICU patients as having some degree of AKI.

• The AKIN criteria could improve the sensitivity of the AKI diagnosis but do not improve on the ability of the RIFLE criteria in predicting inhospital mortality of ICU patients.