Article Text
Abstract
Objectives The Utstein ten-step implementation strategy (UTIS) proposed by the Global Resuscitation Alliance, a bundle of community cardiopulmonary resuscitation (CPR) programs to improve outcomes after out-of-hospital cardiac arrests (OHCAs), has been developed. However, it is not documented whether UTIS programs are associated with better outcomes or not. The study aimed to test the association between the UTIS programme and better outcomes after OHCA.
Methods The study was a before- and after-intervention study. Adults OHCAs treated by emergency medical service (EMS) from 2006 to 2015 in Korea were collected, excluding patients witnessed by ambulance personnel and without outcomes. Phase 1 (2009–2011) after implementing three programs (national OHCA registry, obligatory CPR education, and public report of OHCA outcomes), and phase 2 (2012–2015) after implementing two programs (telephone-assisted CPR and EMS quality assurance programme) were compared with the control period (2006–2008) when no UTIS programme were implemented. The primary outcome was good neurological recovery (cerebral performance scale 1 or 2). We tested the association between the phases and outcomes, adjusting for confounders using a multivariate logistic regression model to calculate adjusted odds ratios (AORs) with 95% confidence intervals (CIs).
Results A total of 1 28 888 eligible patients were analysed. The control, phase 1, and phase two study groups were 19.4%, 30.5%, and 50.0% of the whole, respectively. There were significant changes in pre-hospital ROSC (0.8% in 2006 and 7.1% in 2015), survival to discharge (3.0% in 2006 and 6.1% in 2015), and good neurological recovery (1.2% in 2006 and 4.1% in 2015). The AORs (95% CIs) for good neurological recovery were 1.82 (1.53–2.15) or phase 1 and 2.21 (1.78–2.75) for phase two compared with control phase.
Conclusion The national implementation of the five UTIS programs was significantly associated with better OHCA outcomes in Korea.
- out-of-hospital cardiac arrest
- cardiopulmonary resuscitation
- national health policy
- outcomes
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The study tested the association between implementation of five national CPR programs of ten UTIS programs proposed by the Global Resuscitation Alliance and better outcomes using nationwide OHCA data. All national OHCAs who were transported by fire-based ambulance services were collected with very high representativeness.
The degree of implementation or real change by implementation were not fully measured. This might be related with measurement bias. This study relates outcome to the implementation of some of the ten steps. Some of these steps can be fully or partially implemented and until now there are defined no common tool for assessing the individual steps.
A natural change by years could not be completely adjusted for, even though we adjusted for individual risk factors when calculating the effect size. The before- and after-intervention study has those limitations.
Emergency medical services with intermediate service level in Korea were different North America or European countries where advanced life support are given to OHCA at the field. Therefore the generalisation should be cautious.
Background
Out-of-hospital cardiac arrest (OHCA) is a serious public health problem due to high incidence and low survival rates worldwide.1–3 To improve the survival rates, community, emergency medical services (EMSs), and hospital efforts should be closely linked on the basis of evidence and scientific guidelines.4–8 However, the implementation of evidence-based cardiopulmonary resuscitation (CPR) programs has been difficult due to socioeconomic, cultural, administrative, and behavioural barriers.
The Utstein Implementation Meeting was held in 2015 in Stavanger, Norway to discuss ways to implement scientific recommendations at the community level. From this meeting, the ten programs and ten actions for improving outcomes after OHCA were agreed as core public health CPR programs, The Utstein Ten-step Implementation Strategy (UTIS). The UTIS recommended the followings steps derived from expert consensus: (1) Cardiac arrest registry, (2) Telephone-assisted CPR, (3) High-performance CPR, (4) Rapid dispatch, (5) Measurement of professional resuscitation, (6) Automatic external defibrillator (AED) programme for first responders, (7) Smart technologies for CPR and AED use, (8) Mandatory training for CPR and AED, (9) Accountability, and (10) Culture of excellence. The UTIS was agreed and accepted by the Global Resuscitation Alliance, a new international collaborating organisations for facilitating and implementing the UTIS to the communities, in the following meeting during the EMS 2016 in Copenhagen.
Although the UTIS was derived from scientific findings in many studies and experiences in different communities, the extent of the impact of implementing the UTIS CPR programs at the national level on outcomes is unclear. The goal of this study was to test the association between national implementation of the UTIS programs and outcomes of OHCA, as well as to test the interaction effect of the implementation of UTIS on outcomes across bystander CPR groups.
Methods
This is a before- and after-intervention study to test the association between the national implementation of novel CPR programs and outcomes after OHCA. The Korea Centres for Disease Control and Prevention (CDC) approved the use of all data, and the study was approved by the Institutional Review Board of the study site.
Study setting
Approximately 50 million people live in a 99 000 km2 area of land, where there were multiple regional and local government / hospital organisations: in 2015, there were 17 provinces and 253 local health departments (including 253 local health centres), 17 provincial fire departments, 200 local EMS agencies (966 ambulance stations and 1282 ambulances), and 546 emergency departments (EDs) (20 level one regional EDs, two specialty EDs, 124 level two local EDs, 274 level three emergency rooms, and 126 level four non-designated urgent facilities).
The Ministry of Health and Welfare EMS programme is responsible for emergency care services, acts and regulations, budgeting and policy planning. The Korea Centres for Disease Control and Prevention (CDC) is responsible for the community CPR programme by developing national standards and education programs. The National Medical Centre is responsible for hospital-based emergency care through the ED evaluation programme and reimbursement programs for hospital emergency care. The Central Fire Services (CFS) is responsible for pre-hospital ambulance services related to EMS.9 10
The 2005 and 2010 CPR guidelines recommended by the International Liaison Committee on Resuscitation (ILCOR) were accepted by the academic societies and implemented in the CPR training for lay persons, first responders, and EMS providers in 2006 and 2011, respectively.11 12 The EMS CPR protocol was developed by EMS medical directors in 2011 on the basis of 2010 guidelines. The protocol allowed the EMS providers to perform chest compression and automatic defibrillation, and endotracheal intubation or supraglottic airway under direct medical control during prehospital CPR. The epinephrine or other resuscitation drugs were not permitted to infuse. The termination of resuscitation declared by emergency medical technicians was not allowed and all OHCAs should be transported to the emergency department with providing CPR on ambulance transport if the patients did not achieve the prehospital return of spontaneous circulation.
Data sources
The Korea OHCA Registry (KOHCAR) of cardiac arrest patients transported by ambulance services since 2006 has been constructed by the Korea CDC in collaboration with the central fire services (CFS). The EMS run sheet, EMS CPR registry, and dispatch CPR registry were merged into one EMS-assessed cardiac arrest database by the EMS quality committee of the CFS, which was sent to the Korea CDC. The Korea CDC cleaned the database of hospital information and reviewed the hospital records regarding inpatient care and outcomes.9 10 13 14 The KOHCAR was developed on the basis of recommendations from the international OHCA database and has been modified several times to fit the needs of health policy and planning, cost-effective data collection, and academic requirements.
Data quality management (DQM) was performed in two steps. First, the CFS educated and trained EMTs (mostly level 1) to record EMS data through the data dictionary of EMS record variables and education programme. Medical oversight for each case was performed by EMS medical directors. Second, the Korea CDC educated and trained the hospital medical record reviewers (approximately 15 persons), who were employed by the Korea CDC and worked only for the medical record review programme. They were trained on data dictionary and case review protocols and dispatched to all hospitals to gather information on hospital care and outcomes. The first and second steps were supported by the same DQM committee members, consisting of EMS physicians, epidemiology and statistical experts, cardiologists, and medical record review experts. Every month, the DQM reviewed the collected data from the CFS and Korea CDC and sent feedback to both government partners.
Study population
All adult patients (older than 15 years) with OHCAs and with cardiac aetiology transported by ambulance services between 2006 and 2015 were selected. We excluded patients who did not receive resuscitation in the field or during ambulance transport, patients who suffered an arrest at a hospital ED, arrests that were witnessed by EMS providers, and patients for whom outcome information was not available.
National interventions and study groups
To decide whether the UTIS programme was or was not implemented in a community, each programme was defined using a standard operational definition agreed to by the consensus of the study authors and the attendees of the GRA meeting at the EMS ASIA 2016 Congress (See Appendix 1 for the UTIS implementation status checklist that was discussed in the meeting).
Supplementary file 1
The national intervention was defined as programs introduced under a new Act Article related to community, EMS, and hospital CPR programs among the UTIS programs. We finally selected and defined five of ten programs to make up a national intervention as follows: (1) Korea OHCA Registry (2008) (2) Telephone-assisted CPR (2011) (3) High performance CPR programme (not implemented), (4) Rapid dispatch (2015), (5) Measurement of professional resuscitation (not implemented), (6) AED programme for first responders (not implemented), (7) Smart technology for CPR and AED (not implemented), (8) Mandatory training programme for CPR and AED (2008). (9) Accountability (2008), and (10) Cultural excellence (2011). We defined the intervention year as 1 year after the Act was enacted in the national assembly or the government regulation process began.
The KOHCAR started the CAVAS project in 2008 and applied and was approved for status as national statistics in 2009. The telephone-assisted CPR programme was implemented in Seoul in 2011 and implemented throughout the country in 2012, with mandatory inclusion in the dispatch CPR registry under the Rescue and EMS Act. Mandatory training programs for legally defined first responders, such as drivers, schoolteachers, police officers, rescuers and guards, were started by the EMS Act in 2008. Another obligatory training programme for students and teachers was implemented in 2012 by the School Health Act. All students in each primary, middle, and high school are required to attend at least one session of CPR training during each school year. Every schoolteacher is expected to learn CPR every 3 years, and health and sports teachers should retrain annually. Accountability for CPR was implemented in 2009. All statistics on CPR were reported to the public and the media via an annual symposium and press reports since 2009 and sent to all organisations. The cultural excellence in CPR programme was selected because under the Rescue and EMS Act, EMS medical directors have been working at local fire departments as employed medical directors since 2012. Every individual OHCA case was reviewed by the directors and scored for feedback to EMS providers.
We defined the five interventions and control according to the year of implementation as follows: 1) KOHCAR (2009), 2) Telephone-assisted CPR (2012), 3) Mandatory CPR program (2009), 4) Accountability (2009), and 5) Cultural excellence (2012). From those set time points, we defined the three phases of the observational period: 1) Control phase (2006–2008), 2) Primary intervention (phase 1) (2009–2011) after implementing KOHCAR, Mandatory CPR training, and Accountability, and 3) Secondary intervention (phase 2) (2012–2015) after implementing the T-CPR programme and Cultural excellence, including EMS quality assurance programs (figure 1).
Data variables
We selected several potential confounders for outcomes. These confounders included age, gender, urbanisation level (metropolitan city >1 million population, urban/suburban city >50 000 population, and rural <50 000 per county), place of the event (public, private, unknown), event witness (witnessed, unwitnessed), bystander CPR (yes or no), bystander defibrillation (yes or no), dispatch assistance (yes or no), cause (cardiac, trauma, poisoning, drowning, asphyxia/hanging, and other), primary ECG rhythm (VF/ pulseless VT, PEA, asystole), date and time of onset (season, weekday, and day/ night), number of members of ambulance crew, top level of EMS providers (level 1, level 2, lower), airway management (endotracheal intubation, supraglottic airway, bag-valve mask ventilation, passive oxygen ventilation), EMS defibrillation (yes or no), elapsed time intervals (response time interval (RTI), scene time interval (STI), transport time interval (TTI), trauma level of ED (level 1 to 4), achievement of pre-hospital ROSC, survival to discharge, and a measure of neurological recovery, such as cerebral performance category 1 or 2.
Outcome measure
The primary outcome was survival with good neurological recovery (CPC 1 or 2) at discharge. The secondary outcome was survival to discharge. The tertiary outcome was pre-hospital ROSC. All outcomes were measured by the Korea CDC medical record reviewers, who had visited the hospital to evaluate the medical records. They extracted information from the hospital discharge summaries, which are usually used for the national health insurance reimbursement programme.
Statistical analysis
Demographic findings were described as percentages (%) for categorical variables or medians (q1 and q3) and were compared using the Chi-square test or Wilcoxon rank sum test with the significance level (p value<0.05). We estimated the crude incidence rates (IRs) for 1 00 000 population of each year. The IRs were calculated from the total number of OHCA with all causes in all gender/ age group divided by the total number of population multiplying 1 00 000. Potential risk factors were tested for trends by year. We tested the trend for age- and gender-standardised outcomes using the whole study population as a standard population. All trends were tested by the Cochran-Armitage test.
Each UTIS intervention was tested for the association with outcome variables, and then we tested the UTIS intervention phases 1 and 2 (phase 1 in 2009–2011 and phase 2 in 2012–2015) compared with the control phase group (2006–2008), adjusting for the potential confounders identified above. Potential confounders were selected to avoid the mediator effect. We performed a multivariate logistic regression analysis for the UTIS on the outcomes, adjusted for potential confounders such as age, gender, urbanisation level of the event location, place (private, public, unknown), event witness (witnessed, unwitnessed, unknown), primary ECG rhythm (VF/pulseless VT, PEA, and asystole), response time intervals from call to ED arrival, scene time interval (STI) from arrival to the scene and departure to ED, advanced airway management (ETI, SGA, BVM, PV), level of ED (level 1 to 4), and implemented international CPR guidelines (2005 vs. 2010) for all patients. The 2005 and 2010 guideline were implemented during 2006–2010 and 2011–2015, respectively.
Additionally, interaction analysis was performed using an interaction model with the interaction term (study phase*bystander CPR), which was added to the final multivariate logistic regression model.
We performed the sensitivity analysis for appropriate comparison on the Utstein OHCA population who had cardiac aetiology, witnessed status, and initial shockable rhythm using the same multivariable logistic regression according to study period on outcomes.
All statistical analyses were performed using SAS software, version 9.4 (SAS institute Inc., Cary, NC, USA).
Results
Demographics
Of 229,361 OHCAs during the study period, a total of 1 28 888 eligible patients were analysed, excluding patients who were less than age 15 (n=4478), had non-cardiac etiologies for arrest (n=68 152), for whom resuscitation was not attempted (n=23 807), whose arrest was witnessed in an ambulance (n=39 090), or who did not have available hospital outcome information (n=127). (figure 2)
The demographics among study groups are compared in table 1. Compared with the control group, the phase 1 and 2 groups had the following characteristics: older, predominantly female, occurred more often in private places, more shockable rhythms, less witnessed, more bystander CPR, staffing with more level 1 EMTs, more members in the ambulance crew, longer response times, increased scene time intervals, more advanced airway management, and higher trauma levels of ED (all p values<0.001). Patients included in Phases 1 and 2 had much better outcomes than those in the control phase (all p values<0.001).
Trend analysis
shows trends in crude incidence rate, bystander CPR, pre-hospital ROSC, survival to discharge, and good neurological recovery by year. There were significant changes from 2006 to 2015 in bystander CPR (1.2% in 2006 vs 16.4% in 2016), pre-hospital ROSC (0.8% in 2006 vs 7.1% in 2015), survival to discharge (3.0% in 2006 vs 6.1% in 2015), and good neurological recovery (1.2% in 2006 vs 4.1% in 2015). (p for trend <0.001) The prehospital ROSC was higher than survival to discharge rate in 2015.
The age-and gender-standardised survival rates (SSRs) were calculated using a direct standardisation that used the whole OHCA population during study period as a reference population (table 2). SSRs were 2.6 in 2006 vs 6.9 in 2015 per 100 OHCA person-years. SSRs with good neurological recovery were 0.8 in 2006 vs 4.7 in 2015 per 100 OHCA person-years.
Table 3 shows the trend of crude incidence rates and risk factors stratified by year. The crude incidence rates per 1 00 000 were 18.2 in 2006 and 41.1 in 2015, respectively. Metropolitan locations, season and weekend were not significantly changed by year (p for trend <0.001). The proportions of women and elderly patients older than 80 years, private places, and unwitnessed OHCAs, as well as shorter response time intervals (<4 min.), were increased (p for trend <0.001) and were correlated with poor outcomes. By contrast, proportions of bystander CPR and shockable rhythm, longer scene time intervals (>8 min.), increase in the number and level of EMT crew members, advanced airway management, and higher trauma level of ED of the destination hospital were increased (p for trend <0.001).
Main analysis
Table 4 shows the association between implementation phase and outcome from multivariate logistic regression analysis. AORs (95% CIs) on good neurological recovery in model 2 were 1.82 (1.53–2.15) for phase 1 and 2.21 (1.78–2.75) for phase 2. AORs (95% CI) in model 2 were 1.79 (1.62–1.98) (phase 1) and 1.78 (1.56–2.04) (phase 2) on survival to discharge and 2.20 (1.86–2.59) (phase 1) and 3.47 (2.84–4.24) (phase 2) on pre-hospital ROSC, respectively.
Interaction analysis
Interaction analysis for comparison of the effect size by study phase according to bystander cardiopulmonary resuscitation was performed (table 5). The implementation of phases 1 and 2 had different magnitudes of effects on good neurological recovery based on patient groups that received or did not receive bystander CPR. In terms of good neurological recovery, there was a significant interaction between phases 1 and 2 and bystander CPR (both p values<0.05). There was no significant interaction between pre-hospital ROSC in phases 1 or two with bystander CPR (both p values>0.05).
Sensitivity analysis
Sensitivity analysis was performed for the Utstein OHCA population. The AORs (95% CIs) on good neurological recovery in the model with adjusted for the full confounders (Model 2) were 1.32 (1.00–1.75) for phase 1 and 5.76 (4.56–7.28) for phase 2. AORs (95% CI) in model 2 were 1.22 (0.98–1.51) (phase 1) and 3.79 (3.14–4.58) (phase 2) on survival to discharge and 1.09 (0.74–1.60) (phase 1) and 14.36 (10.66–19.36) (phase 2) on pre-hospital ROSC, respectively (table 6).
Discussion
The implementation of the Utstein ten-steps programs was associated with increase in prehospital ROSC, survival to discharge and good neurological recovery during 10 years observational period in Korea. During the study period, five programs were implemented, including CPR registry, obligatory CPR training, and public reports in 2008 and telephone-assisted CPR, and in-depth medical oversight for EMS CPR in 2011. The interventions were found to have significant effects on outcomes in both phases. The AORs for good CPC were 2.22 in phase 2 and 3.22 in phase 3.
There were several reports on the association between community implementation of CPR programs and improved outcomes. One report from Denmark showed the significant improvement in outcomes by implementation of community programs.15 Analysis using resuscitation attempted OHCA between 2001 and 2010 in the nationwide Danish Cardiac Arrest Registry (n=19 468 showed the significant increase in bystander CPR rate (21.1% in 2001 to 44.9% 2010) and increase in survival on hospital arrival (7.9% in 2001 to 21.8% in 2010), and finally improvement in 30 days survival (3.5% in 2001 to 10.8% in 2010) and 1 year survival (2.9% in 2001 to 10.2% in 2010) (All p-values<0.001). Although the study did not analyse the association between the phase of the national initiatives or implementation of CPR programs and outcome, the findings were very similar to those of our study.
During the ten-year study period, the risk factors were influenced by natural changes in characteristics or by the interventions. To compare the risk factors and outcomes among countries, regions, and local communities and to monitor the trends by year, we need a novel OHCA registry based on a standard report form that includes demographic, system-related, EMS-related, and hospital-related information.16 17 There may be huge variations in outcomes in different communities due to resources, policies, and system efforts during a long study period.18–20 One of the issues related to variations in outcomes is the selection bias of denominators and numerators, which can be calculated with different study population criteria.21 To select a study population as a denominator, an EMS-assessed or EMS-treated population would be standardised to determine incidence and trends in general outcomes. To measure the effect size of the intervention, the Utstein criteria, including witnessed events and shockable rhythm, are recommended.16 22 Risk factors would be different in different populations, such as in older patients.23 To compare the outcomes among communities in the observed time intervals, we used age- and gender-adjusted survival rates as well as Utstein survival rates instead of crude survival rates.9 18 19
Korea has collected OHCA data for the last ten years and reported the risk factors and outcomes to the public.9 10 There were multiple national-level interventions derived and implemented by the national government and individual-level interventions accepted and practiced by academic societies and hospitals according to international guidelines.8 17 The country experienced a rapid increase in population age and change in EMS protocols for selecting patients or time intervals for providing CPR in the field, which may influence the calculated outcome rates.3 9 24 For the study period, we observed changes in both favourable and unfavourable risk factors. Characteristics of the natural population of OHCA patients that were associated with poor outcomes included increases in the elderly and in female patients,25–27 increase in response time,3 28 private location of OHCA,3 10 and unwitnessed OHCA.9 10 These risks are related to ageing of the population. However, several favourable factors also increased, such as bystander CPR,3 19 29 shockable rhythm,3 10 19 scene time interval,24 number of EMTs in the ambulance and level of the top EMT. Advanced life support techniques, such as advanced airway management, increased, though the effect of advanced life support techniques on outcomes is controversial.30 31
Primary intervention programs, such as system monitoring using a nationwide OHCA registry, followed by EMS CPR registry and dispatch registry, might encourage health policy makers to develop programs to improve outcomes after OHCA. The media reported the nationwide outcomes in 2009 and deeply analysed the causes of poor outcomes and regional variation and provided solutions to improve outcomes. Due to active media coverage, the budget was increased to fund CPR training for lay persons. The OHCA registry enabled monitoring of the various components and revealed weaknesses that led to poorer outcomes.3 18 19 28 32
The one of the secondary interventions was the telephone-assisted CPR programme, and it was reported to have strong effects.10 This programme involved strong education and quality assurance programs. Dispatch-assisted CPR rates quickly increased in up to 50% of all detected OHCAs. The comprehensive medical oversight programme was implemented by the Rescue and EMS Act. In this programme, every EMS agency under a fire department was directed to employ a medical director at least part-time and to provide a full range of information on CPR performance of the EMS crew, including an EMS CPR registry and ECG rhythm analysis.
The prehospital ROSC was higher than survival to discharge rate in 2015. The survival to discharge rate was not increased than 2014, while the good neurological recovery rates and prehospital ROSC rates continuously increased. Increase in bystander CPR might contribute the continuous improvement in prehospital ROSC and good brain recovery. Bystander CPR had interaction with study phases for the outcomes. During the study period, the percentage of patients who received bystander CPR increased continuously. Thus, study phases were interactively related with bystander CPR. In terms of good CPC, the sizes of the effects of phases 1 and 2 were significantly greater in patients who received bystander CPR.
From the sensitivity analysis on Utstein OHCA population whose proportion was 4.6% of original study population, we found the similar effect of Utstein ten-steps CPR programs on outcomes according to phases. The good neurological recovery was significantly improved in both phase 1 and phase 2, and survival to discharge and prehospital ROSC was significantly improved in phase 2. The results were similar to those of original OHCA population.
Limitations
The first limitation is the definition of intervention used in this study. The study intervention was operationally defined based on expert consensus. This method could cause measurement bias, resulting in differences when the programme is fully implemented on a larger scale. Potential interventions were selected from the Utstein Ten-step Implementation Strategy programme, and final interventions were enforced by government acts.
The second limitation is the exclusion criteria, including unknown outcomes, paediatric patients and non-cardiac aetiology. Therefore, the results of this study should only be interpreted in the context of the groups of patients enrolled.
The third limitation is related to the study setting. In Korea, the emergency services are intermediate, which is very different from the advanced services provided in some communities in North America or Europe. Thus, one should be cautious with respect to generalizability.
Conclusion
Implementation of national OHCA registry, regular public reports, mandatory CPR training programme, telephone-assisted CPR programme, and medical oversight for EMS CPR performance, which are recommended by the Global Resuscitation Alliance, were significantly associated with better outcomes in the 10 years of before-and after-study in Korea.
Acknowledgments
This study was supported by the National Emergency Management Agency of Korea and the Korea Centers for Disease Control and Prevention (CDC). The study was funded by the Korea CDC (2011-2015) (Grant No.: 2011- Grant for Private Support Program; 2012-E33010-00; 2013-E33015-00; 2014-E33011-00; 2015-Grant for Private Support Program).
Acknowledgments
This study was supported by the National Emergency Management Agency of Korea and the Korea Centres for Disease Control and Prevention (CDC). The study was funded by the Korea CDC (2011–2015) (Grant No.: 2011- Grant for Private Support Program; 2012-E33010-00; 2013-E33015-00; 2014-E33011-00; 2015-Grant for Private Support Programme).
References
Footnotes
Contributors Kim YT has developed the data collection system and leaded the public health program. Dr. Kim developed the idea of this paper and wrote the draft. Drs. Song KJ, Ro YS, Ahn KO, and Hong KJ collected the data and contributed the quality management. Dr. Hong SO collected raw data and maintain the quality via education and training the study coordinators. Dr. Shin SD has the full responsibility of the paper. All authors are accessible to the data and agreed with submission of this manuscript to the journal.
Funding This study was supported by the National Emergency Management Agency of Korea and the Korea Centers for Disease Control and Prevention (CDC). The study was funded by the Korea CDC (2011-2015) (Grant No.: 2011- Grant for Private Support Program; 2012-E33010-00; 2013-E33015-00; 2014-E33011-00; 2015-Grant for Private Support Program). And the Central Fire Services provided support for data collection.
Competing interests No conflicts of interest are associated with this study.
Ethics approval Seoul National University Hospital.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement The Korea Centers for Disease Control and Prevention owns the whole data which are accessible to. If a researcher wants to use the data, the researcher should get a permission for the use of the data.