Systematic literature review of templates for reporting prehospital major incident medical management
- 1Department of Research and Development, Norwegian Air Ambulance Foundation, Drøbak, Norway
- 2Anaesthesia and Critical Care Research Group, Faculty of Health Sciences, University of Tromsø, Tromsø, Norway
- 3Network of Medical Sciences, Field of Pre-hospital Critical Care, University of Stavanger, Stavanger, Norway
- 4Department of Anaesthesia and Intensive Care, Akershus University Hospital, Lørenskog, Norway
- 5Science and Health Library, University Library of Tromsø, University of Tromsø, Tromsø, Norway
- 6Department of Anaesthesiology and Intensive Care, Hammerfest Hospital, Finnmark Health Trust, Hammerfest, Norway
- Correspondence to Sabina Fattah;
- Received 30 January 2013
- Revised 25 June 2013
- Accepted 27 June 2013
- Published 1 August 2013
Objective To identify and describe the content of templates for reporting prehospital major incident medical management.
Design Systematic literature review according to PRISMA guidelines.
Data sources PubMed/MEDLINE, EMBASE, CINAHL, Scopus and Web of Knowledge. Grey literature was also searched.
Eligibility criteria for selected studies Templates published after 1 January 1990 and up to 19 March 2012. Non-English language literature, except Scandinavian; literature without an available abstract; and literature reporting only psychological aspects were excluded.
Results The main database search identified 8497 articles, among which 8389 were excluded based on title and abstract. An additional 96 were excluded based on the full-text. The remaining 12 articles were included in the analysis. A total of 107 articles were identified in the grey literature and excluded. The reference lists for the included articles identified five additional articles. A relevant article published after completing the search was also included. In the 18 articles included in the study, 10 different templates or sets of data are described: 2 methodologies for assessing major incident responses, 3 templates intended for reporting from exercises, 2 guidelines for reporting in medical journals, 2 analyses of previous disasters and 1 Utstein-style template.
Conclusions More than one template exists for generating reports. The limitations of the existing templates involve internal and external validity, and none of them have been tested for feasibility in real-life incidents.
Trial registration The review is registered in PROSPERO (registration number: CRD42012002051).
- Disaster Medicine
- Major Incidents
- Mass Casualty Incidents
- Data Collection
- Health Care Management
Identify templates that enable systematic and uniform reporting of prehospital major incident medical management.
Appraise the data fields in the included templates regarding internal and external validity.
Templates for reporting major incident medical management exist in different formats, but none have been tested for feasibility.
A template for generating reports from the prehospital phase with clearly defined data variables enabling comparative analysis is needed.
Strengths and limitations of the study
A systematic review following the preferred reporting items for systematic reviews and meta-analyses guidelines.
The protocol was published and deviations from protocol are revealed in the study report.
Only English and Scandinavian language literature was included.
Major incidents, such as natural disasters, accidents and terrorist attacks, affect millions of lives each year. In 2011, natural disasters alone killed more than 30 000 people and injured 244 million people worldwide. The 332 natural disasters in 2011 caused the highest economic damage ever recorded; Asia was the continent most often hit, followed by the Americas, Africa, Europe and Oceania. This regional distribution of disaster resembles the profile observed from 2001 to 2010. Over the last decade, China, the USA, the Philippines, India and Indonesia were the five countries most frequently hit by natural disasters.1
Although disaster medicine can be traced back to the Middle Ages, it has become a distinct scientific discipline in only the last 60 years.2 An evolving trend in disaster medicine calls for improved reporting of major incidents in order to increase the level of science within this field.3–8 Previous expert group processes defined uniform data sets for reporting in both emergency medicine in general9 ,10 and in disaster medicine specifically.11 ,12 These templates were designated as Utstein-style templates after the Norwegian monastery where they were developed. Qualitative research methods have also been used to identify areas within prehospital critical care and major incident management that require further research.13 ,14 A recent review identified data from mass gatherings as non-uniform and called for consistent data to enable future research.15 The importance of evaluating disaster exercises using predefined, high-quality data has also been discussed as a potential for improving disaster health management16 and for comparing outcomes from different exercises.17 The analysis of standardised data from previous incidents can allow decision-makers to make well-informed decisions.18
This systematic review was designed to identify and describe the content of templates for reporting prehospital major incident medical management. The questions being asked in this systematic review were: which data are reported in the existing templates (data extraction), and are the templates internally and externally valid with regard to the methodology with which they were developed and the data they are reporting (quality appraisal)? The need for a template for uniform reporting was assessed based on the findings. To the best of our knowledge, no similar studies have been performed or registered in the Cochrane or Prospero databases.
A systematic literature search was performed to identify templates published after 1 January 1990 and up to 19 March 2012.19 The controlled vocabulary of Medical Subject Headings (MeSH) from PubMed, including subheadings, publication types and supplementary concepts, was used. The search was performed between 24 February 2012 and 19 March 2012. A systematic search of the grey literature was performed 25–29 June 2012.
In the main database search, three sets of entry terms were applied and combined (figure 1). The first set of entry terms describes major incidents. The second set of entry terms describes templates. In addition to the MeSH terms in the first two sets, a third set of entry terms with free search phrases was included. For the grey literature search, only two sets of entry terms were combined.19
Templates reporting prehospital major incident medical management.
Templates published after 1 January 1990 (inclusive) and until the date of the literature search.
All non-English language literature, except Scandinavian.
Literature without an available abstract.
Literature reporting only psychological aspects.
Deviations from protocol in search strategy
Combining the three sets of entry terms resulted in 225 individual searches in each database. If any of these individual searches returned more than 700 results, the search was performed again with a fourth entry term (disaster prevention) using the Boolean operator AND (figure 1).
In Scopus, two entry terms, “questionnaires” and “learning”, were excluded due to a large number of irrelevant results, and all searches were limited to the subject areas of life sciences, health sciences and physical sciences. Searches in Scopus were further limited to article title, abstract and keywords. In Web of Knowledge (ISI), all searches were limited to articles and reviews. The term “disaster prevention” was used to refine and decrease the number of search results in four of the individual searches performed in this database. ProQuest Research Library was excluded as it returned too many irrelevant results and the most relevant subjects were covered by the searches performed in PubMed/MEDLINE, Web of Knowledge and Scopus.
The grey literature databases revealed a broad range of quality and searchability. The System for Information on Grey Literature in Europe (OpenSIGLE) was excluded due to the need to order the documents from the original source or a library. Only the document title was available on the web page, making it difficult to determine which documents to order.
Deviations in the search strategy were necessary in order to make the systematic literature review feasible, as a larger number of findings might have made completion of the study impossible.
The search was performed according to the deviations described above. A total of 10 136 results from each individual database search were sent to Endnote X5 (Thomson Reuters, New York, USA). After removing duplicates, the number of results was 8497. The grey literature search returned 107 results (figure 2). A total of 18 articles were included for data extraction and quality appraisal.
Analysis of identified literature
One author scanned the titles and abstracts of the identified literature. Literature not complying with the inclusion criteria was excluded. The full text was obtained for uncertain articles, and inclusion was subject to consensus among three of the authors. Data analysis was performed according to the participants, interventions, comparisons, outcomes, study design (PICOS) methodology as described in PRISMA guidelines.20 ,21 In this case, the participants were all the identified templates for reporting major incident medical management. Our intervention, comparisons and outcomes were carried out using the data extraction and quality appraisal variables described in methods and depicted in figures 3 and 4. From each template, 34 data items were extracted according to a predefined set of questions described in the study protocol19 (figure 3). These data were classified into four categories: demographics, incident characteristics, system characteristics and descriptors of patient characteristics. After data extraction, quality appraisal was conducted using a checklist22 designed by the authors prior to data collection19 (figure 4). This checklist was based on authors’ assumptions of the data relevant to report in a template. One author performed data extraction and quality appraisal; the results were checked by a second author. The contact authors of articles that provided an email address were asked whether the template had been used in real-life incidents. The reference lists of the included literature were scanned and relevant literature included. A quantitative synthesis (meta-analysis) was not performed. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines were followed.20 ,21
Deviations from protocol regarding quality appraisal
The study protocol proposed to appraise whether the medical outcomes predicted by the templates were valid and to evaluate the outcome of using the templates. Both of these questions proved difficult to answer and were removed from the appraisal.
A total of 12 articles were included from the main database search,23–34 five articles were identified from the literature lists of included articles,35–39 and one relevant article was published after the literature search was completed12 (figure 2). The total of 18 articles included 10 different templates or guidelines for reporting (figure 5).
The results of data extraction are shown in figure 3. In addition, under each of the four categories (pre-event information, incident information, system characteristics, patient characteristics), other information that was not extracted by the predefined questions was registered. Six of the 10 templates contained other pre-event information, such as climate, child mortality rate and descriptions of hazards. Seven of the 10 templates contained other incident information, such as a description of the incident. All templates included more system characteristics than what we extracted, including on-site medical care, distribution of casualties, independent action by medical disaster response personnel, continuation of day-to-day care, decision flow and information management. Seven templates contained other descriptors of patient characteristics, such as different triage systems used, description of psychological reactions and morbidity using hospital data.
The appraisal using a predefined checklist is shown in figure 4. The first five questions regarding internal validity indicated that two of the templates contained none of the data we were looking for, four templates contained one of the data items we found relevant and the remaining four templates included three or more data items included in our list of desirable information. The 11 items regarding external validity were also heterogeneous in regard to which and how many of the items each template contained.
Use of templates
We succeeded in contacting the authors of seven templates. According to the authors, five of these templates24–30 ,31 ,33–35 ,37 ,39 were used in other publications and one12 is currently being used to retrospectively evaluate disaster management. One has not been used in other publications.32 DISAST-CIR24–30 ,35 is routinely used to report each mass casualty incident in the registry of the Israeli Defence Force Home Front and Ministry of Health. Guidelines for reporting health crises and critical health events37 have been used to report international disasters, but these publications were not available as official publications at the time of correspondence with the authors. The protocol for reports of major accidents and disasters33 was published previously in the International Journal of Disaster Medicine40 ,41 and used for a report in this journal.42 It has also been used in the European Journal of Trauma and Emergency Surgery43 ,44 and mentioned in an editorial in the same journal.45 Two of the templates31 ,34 ,39 are routinely used for reporting from exercises. Data on medical management during a mass casualty incident exercise31 are normally used to assess the healthcare system in a mass casualty incident simulation and exercise. An online registry for the healthcare system is designed using this instrument. Performance indicators for major incident medical management34 ,39 have also been used in additional publications.17 ,46–50 For the three publications lacking author email,23 ,36 ,38 we were unable to attain information on whether they have been used.
We identified 10 templates for reporting prehospital major incident medical management that were heterogeneous with regard to the data they reported. The quality appraisal revealed that, for most of the templates, the methodology for developing them was not clearly explained. In addition, the data variables were not clearly defined for all templates, and the rationale for choosing the data variables was only explained for half of the templates. Only three of the articles describe the handling of missing data and two depict whether an ethics committee approved the templates. All of these factors are important for internal validity, but the results were also heterogeneous for external validity. We chose to interpret that the templates were developed in the regions affiliated with the authors, though this was not specified. Only two templates stated in which region they were intended to be used. None of the articles discussed the clinical credibility of the template, and no feasibility studies have been performed. In all cases, the use of the template as a tool for evaluation was mentioned.
The data extraction and quality appraisal variables were based on the authors’ assumptions on what is important in a template for reporting major incident medical management. Data variables for reporting should be uniformly defined in order to improve research and allow analysis of data; this is the ideological basis for several previous projects to standardise data for scientific use.9–12 We also believe it is important that templates are preapproved by ethics committees to allow immediate reporting and rapid dissemination of data on the potential for improvement. For a template to be used, it needs to be both clinically credible and feasible. Ideally, if a template is to be used in a specific region, it ought to be developed together with experts from that region; if this is not possible, feasibility studies regarding regional differences could be performed. Reporting should be done by representatives with in-depth local knowledge and directly involved in responding to or managing the major incident. The ultimate goal of reporting is that an evaluation of the response be undertaken to identify areas for improvement, enabling those responsible in similar settings to improve their preparedness. For this kind of evaluation to occur, comparable, standardised reports that allow for research need to be published. Thus far, reporting on the scale needed for comparisons has not been achieved.
Not all of the included literature was intended for prospectively reporting real-life incidents. However, in order to not overlook potentially relevant aspects of major incident reporting, the literature aimed to report from exercises31 ,34 ,36 ,39 and literature using a systematic method for reporting in general was included.23 ,32 A clear weakness was that templates may exist in languages other than those included. We invite others to identify these templates. Only literature in which an abstract was available was included. With more that 8000 articles identified in the search, reviewing full articles at the initial stage was not feasible. Another limitation was that only one author performed the initial review of the literature for inclusion. One author performed data extraction and the appraisal and a second author checked the results, but this can still allow room for subjective interpretations of the content of the templates. The aim of the appraisal was to systematically extract information that the authors thought would be important for reporting major incident medical management. However, neither the data extraction nor the quality appraisal represents a validated set of data or gold standard.
Our findings show that more than one template exists for generating reports from the medical management of major incidents. Limitations are present in the existing templates regarding internal and external validity, and none of them have been tested for feasibility in real-life incidents. Uniform reporting can allow the analysis and comparison of medical management for different major incidents and identify areas that need improvement. Indirectly, this information can lead to better resource use and improved outcomes for patients and society. The identified templates may be used as a basis for designing a template that is specifically aimed at prehospital medical care and at generating reports in such a quantity that comparative analysis can be performed. The work to create such a template seems warranted and is now underway.
Contributors SF, MR and TW conceived the idea and designed the study. ER designed and conducted the search strategy for the literature search. SF screened the identified literature. TW, MR and SF considered the eligibility of uncertain literature. SF performed data extraction and quality appraisal of the included literature. TW and MR checked these results and were mentors in the process. SF, MR, ER and TW approved the final version of the manuscript.
Funding The Norwegian Air Ambulance employs SF and MR as research fellows. ER and TW received departmental funding only. No additional funding was obtained.
Competing interests None.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/