Article Text

Original research
All-cause excess mortality among end-stage renal disease (ESRD) patients during the COVID-19 pandemic in Thailand: a cross-sectional study from a national-level claims database
  1. Sutham Jirapanakorn1,
  2. Woranan Witthayapipopsakul2,3,
  3. Khanitta Kusreesakul2,
  4. Divya Lakhotia2,
  5. Viroj Tangcharoensathien2,
  6. Rapeepong Suphanchaimat1,2
  1. 1Department of Disease Control, Ministry of Public Health, Nonthaburi, Thailand
  2. 2International Health Policy Program, Nonthaburi, Thailand
  3. 3London School of Hygiene & Tropical Medicine, London, UK
  1. Correspondence to Dr Sutham Jirapanakorn; suthamkku{at}gmail.com

Abstract

Objectives COVID-19 infection increased nephrology-related risks and mortality rate among end-stage renal disease (ESRD) patients. The pandemic also disrupted essential healthcare services. We aim to explore all-cause excess mortality among ESRD patients who were members of the Universal Coverage Scheme (UCS), the largest public health insurance scheme in Thailand covering citizens who are not employed in the formal sector, including children and older persons.

Design A cross-sectional study.

Setting We retrieved the dataset from the UCS claims database—electronic health records used for processing healthcare expense claims from medical facilities of all UCS members. This database links mortality outcome to civil registration. We employed the WHO’s excess mortality methodology using pre-pandemic data to estimate expected deaths during the pandemic period (March 2020 to August 2022).

Participants This study included ESRD patients from across Thailand, covered by the UCS.

Primary outcome measure Excess deaths are the difference between predicted and reported deaths.

Results Over a 30-month period of the pandemic, the total number of all-cause excess deaths among ESRD patients was 4966 (male 1284; female 3682). The excess death per 100 000 ESRD patients was 3601 (male 2012; female 4969). The relative excess death was 5.7% of expected deaths (95% CI 1.7%, 10.0%). The excess deaths were highly concentrated among patients aged 65 and older.

Conclusion ESRD patients are significantly more vulnerable to pandemic-related mortality than the general population. Health systems’ capacity to contain the pandemic at varying virulence and maintain essential health services for ESRD patients might be related to the size of excess deaths at different periods. The observed excess deaths highlight the importance of established strategies to reduce all-cause mortality such as rapid vaccine rollout for ESRD patients and sustaining dialysis and other essential services for older patients and other high-risk groups.

  • COVID-19
  • End stage renal failure
  • Mortality

Data availability statement

Data may be obtained from a third party and are not publicly available. We only received permission to use this dataset for specific research objectives. We are not allowed to distribute patient dataset outside of the research team or use it for other purposes beyond the original agreed objectives. Researchers who are interested in using NHSO dataset can request access directly from the NHSO.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • This study used a national-level claims database of the Universal Coverage Scheme, which covers 71% of Thai citizens; thus, ensuring representativeness of end-stage renal disease (ESRD) patients and minimising potential sampling bias.

  • The study used death statistics from Thailand’s high-quality death registration, which has a coverage rate of 99.3% of total deaths. This high coverage enhances the accuracy of reported mortality outcomes.

  • The study followed the WHO’s standard methodology for estimating excess mortality, providing a robust framework for analysing the impact of the COVID-19 pandemic on ESRD patients and facilitating comparison between studies.

  • Monthly incidence of newly diagnosed ESRD patients was estimated based on historical service utilisation profiles dating back to January 2016 only, which may introduce inaccuracies in the data.

  • Some ESRD patients may have been underdiagnosed during the pandemic, potentially affecting the accuracy of patient counts; particularly during waves 2 and 3 of the pandemic when healthcare systems were overwhelmed.

Introduction

The COVID-19 pandemic has profoundly impacted human lives, especially those in vulnerable situations. Travel restrictions have resulted in unemployment and economic disruption with an uneven recovery; a double shock as described by the World Bank.1

In Thailand, the first confirmed case of COVID-19 was reported on 13 January 2020, marking the onset of a series of waves that swept the nation as well as policy responses.2 There were four waves of the epidemic. The first wave began in March 2020, with a rapid increase in COVID-19 cases. This surge was primarily caused by mass gatherings at Lumpini boxing stadium and entertainment venues in Bangkok. The second wave, from December 2020 to March 2021, was characterised by an outbreak among undocumented migrant workers.3 During this wave, the predominant viral variant was clade GH.4 The third wave, April to December 2021, was associated with an outbreak linked to an entertainment venue in Bangkok. Compounded by the relaxation of restrictions during the Thai New Year holidays in April 2021, the disease rapidly spread nationwide, overwhelming healthcare services. Notably, this wave was caused by Alpha, Beta and Delta variants, all of which were classified by the WHO as Variants of Concern, with a high mortality rate.3 August 2021 marked Thailand’s highest number of daily confirmed COVID-19 cases (23 418) and confirmed deaths (312).5 The fourth wave, spanning from late 2021 to the end of 2022, caused by the Omicron variant with lower severity,6 marked a significant improvement in mortality as Thailand achieved high COVID-19 vaccine coverage. The Ministry of Public Health prioritised several population groups including end-stage renal disease (ESRD) patients, with a higher risk of COVID-19 mortality for receiving the COVID-19 vaccination; as evidence suggested that vaccination reduced mortality.7

ESRD is the final stage of chronic kidney disease (CKD), defined by a glomerular filtration rate of less than 15 mL/min. Patients with ESRD require regular renal replacement therapy (RRT) to continue survival. RRT includes haemodialysis (HD), peritoneal dialysis (PD) and kidney transplantation.8 In Thailand, the prevalence of people receiving RRT in 2020 was 170 774.9 A study conducted on Thai ESRD patients found that the 1-year, 2-year and 3-year patient survival rates were 84.4%, 77.3% and 72.7%, respectively.10

A study in 2021 showed that the COVID-19 pandemic had a negative impact on catheter insertion rates, outpatient follow-up visits and home visits for ESRD patients.11 Another study confirmed that patients on HD and PD with SARS-CoV-2 infection had significantly increased mortality and complications such as coronary artery disease and congestive heart failure.12 ESRD patients had an increased risk of mortality from COVID-19 as they have lower immune functions and multiple comorbidities. COVID-19 patients with ESRD had significantly higher odds of all-cause 1-year mortality compared with COVID-19 patients without ESRD.13 Although ESRD as a comorbidity that increased disease severity and mortality from COVID-19 has been well documented,14 the overall impacts on mortality due to the pandemic that is, disruptions of other essential services remains unknown.

Several studies have explored excess mortality resulting from COVID-19, including a study in Italy,15 and a systematic analysis covering multiple countries.16 Another study estimated that 14.83 million excess deaths occurred in the general population worldwide from 2020 through 2021, compared with 5.42 million COVID-19 reported deaths. The excess death per 100 000 population was 57.63 in 2020, which increased to 132.22 in 2021.17 An analysis in the USA estimated a total of 6953–10 316 excess deaths in 798 611 ESRD patients which is equivalent to 870.6–1291.7 excess deaths per 100 000 ESRD patients.18 These studies shed light on the overall impact of COVID-19 on ESRD mortality. There remains a gap in the understanding of excess mortality rate and profiles among ESRD patients in Thailand, a middle-income country, in order to inform appropriate national policies.

In this study, we aim to estimate all-cause excess mortality among Thai ESRD patients during the COVID-19 pandemic. We focused on ESRD patients covered by the Universal Coverage Scheme (UCS) which was the largest public health insurance scheme in Thailand covering citizens who do not have other public health insurance schemes, that is, the informal sector, children and older persons. UCS covered 71% of all citizens.19 This subset represents approximately 40% of the total ESRD patients who were on RRT in 2020.9

Methods

Data sources

We retrieved the dataset from the National Health Security Office (NHSO) which administers the UCS. The dataset included electronic health records of all outpatient and inpatient services of UCS members submitted for claims by health facilities. The mortality of any Thai citizen was captured by the Bureau of Registration Administration through death registration, as mandated by law, and linked daily with the UCS database by citizen ID. The dataset contained citizen ID, sex, age, hospital code, service date, principal diagnosis, secondary diagnoses, date and causes of death. NHSO encrypted citizen ID to protect personal data.

Study participants

Our study population was ESRD patients who were members of the UCS and used outpatient or inpatient services between January 2016 and August 2022. ESRD patients were identified based on the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision code: I185 as either their principal diagnosis or secondary diagnoses. We excluded a total of 2239 ESRD patients whose sex, age and death date were missing from our analysis (online supplemental figure 1).

Patient and public involvement

No patients involved.

Data management

We estimated monthly number of ESRD patients for the period between January 2016 and August 2022 using the following steps. First, we used the number of ESRD patients who were still alive at the end of 2015 as a baseline number. Second, for each month, we estimated incidence of ESRD cases by counting the patients who appeared in the service records for the first time since January 2016. Third, we counted the number of deaths in each month. Finally, the number of ESRD population in month n is equal to the number of populations in the previous month (n−1) plus the difference between incident cases (new cases) and deaths in month n. Deaths related to COVID-19 were retrieved from cause of death information in the death registration system and were also counted monthly. All statistics were disaggregated by sex and the following age groups: 0–19 years, 20–44 years, 45–64 years, 65–74 years and ≥75 years.

We categorised the outbreak patterns into four distinct waves namely wave 1 (March–November 2020); wave 2 (December 2020–March 2021); wave 3 (April–December 2021); and wave 4 (January 2022–August 2022).

Statistical analysis

We followed the WHO’s manual for estimating excess mortality associated with COVID-19.20 The WHO defines excess mortality as “the mortality above what would be expected based on the non-crisis mortality rate in the population of interest”.21 We modelled monthly all-cause mortality based on a negative binomial distribution to account for overdispersion of data using general additive models with covariates, namely the logarithm of monthly ESRD population, sex, age groups and a smooth function of time accounting for seasonal fluctuation with a penalised cyclic cubic regression spline (more details in online supplemental file box 1).

Excess mortality was estimated using three steps. First, we built the model to estimate the number of all-cause mortality using data from the pre-pandemic period. Second, we used the model to predict the number of expected deaths with a 95% CI for the no-outbreak scenario from March 2020 to August 2022. Third, we subtracted expected deaths during the outbreak period from the observed deaths to obtain excess deaths. We produced three figures (1) number of all-cause excess mortality, (2) excess deaths per 100 000 ESRD patients and (3) relative excess death as a per cent of expected deaths, as described below where t refers to monthly observation.

Excess deathst=observed deathst–expected deathst

Excess deaths per 100 000t=(excess deathst/ESRD populationt)×100 000

% relative excess deathst=[(observed deathst–expected deathst)/expected deathst]×100

The model was fitted using mgcv package V.1.8-40 in R V.4.2.1.22

Results

Between January 2016 and August 2022, the UCS database recorded a total of 3 886 582 service records by 352 373 ESRD patients. After excluding 2239 patients with missing important data (accounting for 0.63%), there were 350 134 ESRD patients in our analysis cohort (see figure 1). The number of ESRD patients under the UCS ranged between 109 826 and 130 426 during 2016 and 2021. There were 134 520 ESRD patients at the end of August 2022. The median ages ranged between 65 and 66 years old and there were more females than males (females 52.8%–56.0%, males 44.0%–47.2%) throughout the observed years. Before the pandemic, over half the patients were aged 65 and above. However, once the pandemic began in 2020, the percentage of patients in this age group dropped below 50%. All-cause mortality counts substantially increased from 27 648 in 2016 to 40 510 in 2021. There were a total of 21 726 deaths among ESRD patients in 2022 (recorded until August). Mortality rate, as measured by the proportion of ESRD patients who died, increased from 25.2% in 2016 to 31.1% in 2021, and 16.2% in the 8 months of 2022. Females accounted for 54.1%–55.2% of total deaths in all observed years (see table 1).

Figure 1

Monthly observed and expected all-cause mortality among end-stage renal disease patients between January 2016 and August 2022

Figure 1 compares monthly observed deaths (blue line) and expected deaths (solid red line with 95% CI in dashed red lines) over the coloured background indicating the pre-pandemic period and the four waves during the pandemic. The red lines in the pandemic period go downward reflecting a reduced number of ESRD population. The graph presents the volume of positive and negative excess deaths during different waves, highlighting large numbers of excess deaths during the third wave caused by the Delta strain in the fourth quarter of 2021. The blue bar chart represents much lower numbers of monthly reported COVID-19-related deaths, though we observed a synchronous trend with all-cause death tolls of ESRD patients.

Table 1

Characteristics and all-cause mortality of end-stage renal disease (ESRD) patients (January 2016 to August 2022)

Table 2 shows monthly reported COVID-19 deaths among ESRD patients, observed all-cause deaths and estimated all-cause excess mortality in this group. Over the 30-month observation period, the total observed all-cause deaths were 91 879 while total expected deaths were 86 913. This resulted in total excess deaths of 4966. The excess deaths were 3600.9 per 100 000 ESRD patients, and the relative excess deaths were 5.7% of the expected number (95% CI 1.7%, 10.0%). The number of monthly excess deaths was above zero in 17 out of 30 months. At the beginning of the pandemic, between March and October 2020, monthly excess deaths were negative, meaning there were fewer deaths than expected. The number of excess deaths turned positive between November 2020 and August 2022, except for the months of February 2021, February 2022 and June to August 2022. Consistently, relative excess death was negative in 2020 (–8.3%, 95% CI −11.8, –4.5), it rose to 20.3% of expected deaths (95% CI 15.7, 25.2) in 2021, and then reduced to 4.0% (95% CI 0.1, 8.2) in 2022. Though the excess deaths per 100 000 ESRD patients were mostly negative in 2020, it increased to between 127.3 and 750.6 deaths per 100 000 patients in 2021 (except for a negative value in February 2021). It is worth noting a significant reduction in the numbers of monthly ESRD population in 2021; from 140 785 in January to 130 426 in December. The excess deaths fluctuated in 2022.

Table 2

Monthly number of deaths caused by COVID-19, observed all-cause deaths and all-cause excess mortality among end-stage renal disease (ESRD) patients between March 2020 and August 2022

Excess deaths were disaggregated by sex and age group. Out of the total positive excess deaths, 40% were males and 60% were females. The oldest age group (75 years and over) accounted for the largest proportion (59%), followed by the 65 to 74-year group (30%), and the 45 to 64-year group (11%). Those below 45 years had only 31 excess deaths (0%). Numbers are reported in online supplemental table 1.

We estimated the relative excess deaths as per cent of expected deaths, by sex and age group in figures 2 and 3, respectively. In 2020, there were erratic patterns of negative relative excess death in males and females. However, after January 2021, a clear pattern emerged showing the relative excess deaths in female patients were higher than that of male patients in all months, except August 2021. The gap between sex varied considerably by month in 2021 and 2022, ranging from a difference of almost zero in January 2021 to a 20-fold difference in July 2022. The relative excess deaths for males and females generally followed the same direction (either positive or negative values) in most months, except for November 2020 (male 0.5%, female −0.2%) and February 2021 (male −8.4%, female 4.2%).

Figure 2

The relative excess mortality of end-stage renal disease patients by sex between March 2020 and August 2022

Figure 3

The relative excess death of end-stage renal disease patients by age group between March 2020 and August 2022

More details on monthly excess deaths, excess deaths per 100 000 patients and relative excess death as per cent of expected deaths disaggregated by sex and age group are available in online supplemental tables 2 and 3a–3c.

Discussion

This study finds a total of 4966 excess deaths during the 30-month observation period. We observed negative excess death among ESRD patients at the beginning of the pandemic in 2020, followed by a significant surge in excess deaths during waves 2–4. We hypothesise that the negative excess deaths in wave 1 were a result of the country’s stringent lockdown measures, detection and isolation of confirmed cases and closure of international borders.4 This might result in very few overall COVID-19 cases, with only two COVID-19 deaths reported among the approximately 141 000 ESRD patients in 2020. Excess mortality increased in wave 2, reaching peak levels in wave 3 when the Delta strain was more transmissible and the surge cases overwhelmed healthcare facilities, disrupting the provision of essential health services for patients with chronic diseases, including ESRD patients who required three HD sessions per week. Additionally, Thailand’s COVID-19 vaccine rollout in May 2021 faced significant supply limitations until the end of the year.23 This might have hampered access to vaccines for ESRD patients and contributed to the highest number of excess mortalities between July and December 2021 (679–979 deaths per month). In wave 4, the number of observed deaths began to taper off resulting in low to negative excess deaths. This was likely due to the less severe Omicron variant, increased vaccine coverage, health services resuming normal function and more relaxed travel restrictions. It should be noted that a downward trend line of expected deaths during the pandemic period was not because of a lower mortality rate but rather a reduction in newly diagnosed ESRD patients, likely stemming from service disruptions and travel restrictions.

In this study, the total number of all-cause excess deaths was much higher than the deaths from laboratory-confirmed COVID-19 cases in ESRD patients as reported by the civil registry. We speculate that several factors beyond COVID-19 infection might contribute to the observed all-cause excess mortalities, including overwhelmed healthcare services which disrupted HD and PD, patients’ self-imposed restrictions on travelling to dialysis centres due to the fear of contracting COVID-19 infection, individual’s intention to not put additional burden on health workers at the peak of managing COVID-19 patients, reduced public transport facilities, and stay-at-home policies. These circumstances might collectively lead to reduced access to essential services required by ESRD patients. Additionally, the under-reporting of COVID-19 confirmed deaths in the death registry could be another reason. It is unknown whether social stigmatisation hampered the reporting of COVID-19 deaths that occurred outside of hospitals, as observed in other studies.24 25

Compared with the general population in Thailand, excess deaths per 100 000 population for ESRD patients are much higher. The estimated all-cause excess deaths for the general population in Thailand between 1 January 2020 and 31 December 2021 was 35 200 (95% CI 26 600, 42 200), equal to 24.9 deaths (95% CI 18.7, 29.8) per 100 000 Thai population between 2020 and 2021.16 This is equivalent to one excess death per 100 000 Thai population per month. Our study found an average of 120 excess deaths per 100 000 ESRD patients per month (3600 per 100 000 patients in 30 months), indicating ESRD excess deaths as 120-fold (120/1) higher than the general population, notwithstanding the different study timeframe. Previous evidence also supported that COVID-19 affected ESRD patients more than the general population.14 The result of another study on excess death in the general Thai population between April and October 2021 was 25 486 (95% CI 13 913, 36 862), the relative excess death was 14.3% of expected deaths (95% CI 8.6%, 18.8%).26 Compared with our estimates for ESRD patients during the same period (data not presented here), the relative excess death of ESRD patients in our study was approximately 1.6 (22.9/14.3) times that of the general Thai population.

There is no existing study estimating excess deaths among ESRD patients in Thailand. A study in the USA estimated 6953–10 316 excess deaths among 798 611 ESRD patients during February–August 2020, equivalent to 870.6–1291.7 per 100 000 ESRD patients.18 Our results on excess deaths in the same period were lower.

Our findings, which indicate that excess deaths were concentrated among older age groups and female ESRD patients, align with other studies presenting a correlation between older age and increased mortality in ESRD patients,27 28 and female CKD patients experiencing more excess deaths than males.29 Higher excess deaths among older ESRD patients is also consistent with the pattern found in the general population which reported that people older than 60 years accounted for 78.4% of total excess deaths. However, the same study reported that males accounted for 56% of total excess deaths (14 223/25 486),26 which is in contrast to our study in ESRD patients where males comprised only 26% of the total excess deaths (1284/4966). Pre-COVID-19 statistics of ESRD patients in Thailand also supported that more females than males experienced mortality in this population. Age structure by sex may help explain this finding as females in our cohort were older than males.

Several policies were introduced during the pandemic, such as mobilising surge capacity from within and outside health systems to contain the spread of infection, prevent health systems from getting overwhelmed, and sustain the provision of essential services, especially dialysis—a life-saving service for ESRD patients. ESRD was one out of seven chronic conditions prioritised for COVID-19 vaccination.

Our findings on excess deaths may be similar to what would be observed among other chronic disease patients who need essential healthcare services and close monitoring by healthcare practitioners during public health emergencies. Further research may explore excess mortality between PD and HD patients, and the status of COVID-19 vaccination. A regression analysis exploring factors affecting mortality among ESRD patients can shed light on mortality risk factors and further inform policies to reduce deaths.

Strengths and weaknesses of this study

The key strength of our study is the use of a national-level claims database which ensures completeness of the UCS population and their mortality outcome, thus minimising the risks of sampling bias. Additionally, the high coverage of death registration in Thailand (99.3% of total deaths), ensures confidence in the accuracy of the mortality outcome.

We identified certain limitations. First, we estimated monthly newly diagnosed ESRD patients by relying on historical service utilisation profile from 2015 until the previous month, which might not be completely accurate. Second, we expect that some ERSD patients may be underdiagnosed, especially during the second and third waves of the pandemic, which almost overwhelmed health delivery systems. This was reflected by the reduced number of patients diagnosed with ESRD in 2021–2022 compared with 2020, which can be explained by RRT service disruption. Third, confirmed COVID-19 deaths are likely under-reported, especially in 2020 due to overwhelmed COVID-19 testing capacities using RT-PCR, cases where COVID-19 patients passed away without a formal diagnosis, or discrepancies in clinicians certifying the cause of death when COVID-19 patients had multiple underlying diseases. Fourth, the data quality of all variables used in the regression model can affect the precision of estimating excess mortality and the robustness of the predictive model. Though we applied WHO’s standard method of cyclic cubic regression spline models as the basis for modelling the expected deaths, the cubic splines interpolation algorithm does not work well for interpolation of highly fluctuated data and when there is a large time difference between the period fed into the predictive model and the estimated period.

Conclusion

We demonstrate the impact of the COVID-19 pandemic on all-cause excess mortality in ESRD patients. Older patients had higher all-cause excess mortality than the younger age groups. The SARS-CoV-2 virus strains with different infectivity and severity in different waves, and the health systems capacity to contain the pandemic and sustain the provision of essential health services to general patients including ESRD patients may have influenced variations in excess all-cause mortality. The all-cause mortality among ESRD patients in this study is far greater than that in the general population. Policies to minimise excess deaths should focus on sustaining provisions of essential services and rapid rollout of vaccination, especially in the older age group. We suggest further studies to investigate excess mortality between PD and HD patients, and the status of COVID-19 vaccination.

Data availability statement

Data may be obtained from a third party and are not publicly available. We only received permission to use this dataset for specific research objectives. We are not allowed to distribute patient dataset outside of the research team or use it for other purposes beyond the original agreed objectives. Researchers who are interested in using NHSO dataset can request access directly from the NHSO.

Ethics statements

Patient consent for publication

Acknowledgments

We sincerely thank Waritta Wangbanjongkun for administrative assistance and Poonchana Wareechai from NHSO who provided excellent support during data acquisition.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Contributors SJ: methodology, data analysis, writing first draft; WW: data acquisition, writing first draft; KK: methodology, reviewing draft; DL: writing first draft; RS: methodology, reviewing draft; VT: conceptualisation, reviewing draft, supervision, guarantor.

  • Funding This study received no research grant. Health Policy and System Research Fellowship, International Health Policy Program Foundation, sponsored the fees for Ethical Review and open-access publication (award/grant number: N/A).

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.