Article Text

School closures and influenza: systematic review of epidemiological studies
  1. Charlotte Jackson1,2,
  2. Emilia Vynnycky2,
  3. Jeremy Hawker3,
  4. Babatunde Olowokure3,
  5. Punam Mangtani1
  1. 1Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, UK
  2. 2Health Protection Agency, London, UK
  3. 3Health Protection Agency, Birmingham, UK
  1. Correspondence to Dr Charlotte Jackson; charlotte.jackson{at}lshtm.ac.uk

Abstract

Objective To review the effects of school closures on pandemic and seasonal influenza outbreaks.

Design Systematic review.

Data sources MEDLINE and EMBASE, reference lists of identified articles, hand searches of key journals and additional papers from the authors' collections.

Study selection Studies were included if they reported on a seasonal or pandemic influenza outbreak coinciding with a planned or unplanned school closure.

Results Of 2579 papers identified through MEDLINE and EMBASE, 65 were eligible for inclusion in the review along with 14 identified from other sources. Influenza incidence frequently declined after school closure. The effect was sometimes reversed when schools reopened, supporting a causal role for school closure in reducing incidence. Any benefits associated with school closure appeared to be greatest among school-aged children. However, as schools often closed late in the outbreak or other interventions were used concurrently, it was sometimes unclear how much school closure contributed to the reductions in incidence.

Conclusions School closures appear to have the potential to reduce influenza transmission, but the heterogeneity in the data available means that the optimum strategy (eg, the ideal length and timing of closure) remains unclear.

  • Epidemiology
  • Public Health
  • Systematic Reviews

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Article summary

Article focus

  • This systematic review assesses the effects of school closures on the transmission of influenza, including data from the recent 2009 pandemic as well as from previous pandemics and seasonal outbreaks.

Key message

  • The available data suggest that school closure can be a useful intervention during influenza outbreaks, with the greatest benefits occurring among school-aged children.

Strengths and limitations of this study

  • We have reviewed an extensive body of the literature on the effects of school closure on the incidence and transmission of influenza.

  • The optimum timing and duration of closure are unclear because studies often differed in several respects, or used other interventions in addition to school closure.

Introduction

During the 2009 influenza pandemic, schools were closed in many settings in efforts to reduce transmission. The WHO does not specifically recommend or discourage school closures during an influenza pandemic, as their potential benefits and harms may be context-specific,1 but has suggested that they be considered as part of a mitigation strategy.2 Their effects on transmission, however, remain poorly understood.3 ,4 Closures may be proactive (occurring before transmission is established in the school) or reactive (a response to a school-based outbreak), and may involve closure of whole school(s) or dismissal of individual classes.4

A review of the evidence available before the 2009 pandemic concluded that school closures may be beneficial, depending on characteristics including age-specific attack rates.4 Here, we review epidemiological studies to assess the effects of school closures on transmission and incidence of seasonal and pandemic influenza, updating and extending previous reviews2 ,4 to include data from the 2009 pandemic.

Methods

Search strategy and selection criteria

MEDLINE and EMBASE were searched in January 2012, without language restrictions, for relevant papers published by the end of 2011 (see online supplementary appendix for search strategy). Eurosurveillance (23 April 2009 to 15 December 2011), Morbidity and Mortality Weekly Report (24 April 2009 to 23 December 2011) and Emerging Infectious Diseases (April 2009 to December 2011) were hand-searched. Results were supplemented using the reference lists of the articles identified and papers from the reviewers’ collections. An additional PubMed search (for the words ‘influenza’ and ‘school’) was used to identify relevant papers published during October—December 2011 but not yet listed in MEDLINE or EMBASE.

Studies were included if they described one or more influenza outbreaks during which schools were initially open and subsequently closed, with or without other interventions. If papers presented several measures of influenza activity, the most specific data were extracted (eg, data on laboratory-confirmed influenza were extracted in preference to all-cause school absenteeism). Studies using modelling techniques to assess how school closure affected transmission based on real epidemic curves were eligible; however, predictive modelling studies exploring how school closure might affect a hypothetical outbreak were excluded. English translations (where available) of the titles and abstracts of papers written in other languages were screened, but these papers were ineligible for inclusion. Studies of outbreaks which started during school closure were excluded.

Abstracts and full text were screened initially by one reviewer (CJ) and by a second reviewer (PM) if the first reviewer was in doubt as to the paper's eligibility. Box 1 summarises the information extracted (by CJ) from the studies. Wherever possible, epidemic curves were plotted by transcribing daily or weekly data from figures or tables.

Box 1

Information extracted from eligible studies (where presented)

  • Study design

  • Study population/setting (including size of population)

  • Nature of school closure (eg, school holiday, response to outbreak)

  • Duration of closure and number of schools affected

  • Timing of closure in relation to influenza circulation

  • Outcome measure(s) examined (eg, clinical ILI, virologically confirmed influenza)

  • Association between school closure and outcome

  • Epidemic curve (transcribed from graphs or figures); used to derive peak, cumulative and median attack rates

  • Normalised peak attack rate (=peak attack rate/median attack rate)

Data analysis

We summarised the data graphically and descriptively. We plotted the peak and cumulative attack rates (and 95% CIs, calculated using standard methods for calculating CIs for proportions) for each study that provided an appropriate denominator. We calculated the normalised peak (peak AR/median AR) for datasets with a median AR greater than zero, to adjust approximately for differences in case definitions (this approach has been used elsewhere to adjust for intercity differences in case fatality proportions5). These estimates were stratified by the timing of closure, that is, whether schools closed before, coincident with or after the peak.

Results

Of 2579 papers identified through MEDLINE and EMBASE, 430 were reviewed in full. Sixty-five of these studies were included in the review, along with 14 additional papers (figure 1; the supplementary PubMed search yielded no further eligible articles). Seventy-nine papers were thus included: 22 for seasonal and 57 for pandemic influenza (49, 1 and 7 from the 2009, 1968 and 1918 pandemics, respectively). Details of the studies are given in table 1 and see online supplementary tables S1 and S2.

Table 1

Features of the studies identified

Figure 1

Identification of epidemiological studies of the effects of school closure on influenza outbreaks.

Description of the epidemics

Nineteen and 41 epidemic curves were available on seasonal and pandemic influenza, respectively, (see online supplementary figures S1 and S2). School closure was often followed by a reduction in incidence, in children specifically or the general population. However, closure often occurred late in the outbreaks (table 1), and it is unclear whether it influenced the decline.

The cumulative and peak ARs varied widely for seasonal and pandemic influenza (figure 2). Normalised peaks partly account for differences in case definitions between studies, but also varied considerably (figure 3). There was no clear pattern in the cumulative, peak or normalised peak ARs plotted by timing of closure in relation to the peak. Relatively few schools closed before the peak (figures 2 and 3); of those that did, two also reopened before the peak.6 ,7 However, the early introduction of non-pharmaceutical interventions (NPIs), often including school closures, in US cities during the 1918 pandemic has been found to be associated with reductions in mortality.5 ,8 ,9 In Connecticut in 1918, three cities which closed schools experienced higher death rates than two which did not.10

Figure 2

Peak cumulative attack rates recorded in the identified studies. Case definitions varied between studies (see online supplementary appendix); only studies which included a denominator are shown. Studies which reported peak prevalence of absenteeism are denoted by an asterisk. See online supplementary appendix for full details of datasets. All pandemic data are from 2009 except for Kelleys Island. BC, British Columbia; CT, Connecticut; IL, Illinois; KI, Kelleys Island; NC, North Carolina.

Figure 3

Normalised peak attack rates (estimated as peak attack rate/median attack rate) recorded in the identified studies; one study with an estimate normalised peak of 128 is excluded for clarity.82 Case definitions varied between studies (see online supplementary appendix). Studies which reported peak prevalence of absenteeism are denoted by an asterisk. HK, Hong Kong; IL, Illinois; KI, Kelleys Island; NC, North Carolina; SARI, severe acute respiratory infection.

Age-specific effects of school closure

The available age-specific data suggested that any benefits associated with school closure were greatest among school-aged children.11–25 During the 2009 pandemic in New Zealand, the age-standardised proportion of confirmed cases in 5-year-olds to 19-year-olds fell during the winter holiday and increased when schools reopened19; a slight increase in influenza-like illness (ILI) consultation rates when schools reopened was confined to 5-year-olds to 14-year-olds.14 Similar relationships between school closure and the ratio of the number of H1N1 infections in 5-year-olds to 20-year-olds to that in other age groups were reported for Mexico23 and Peru.24 During the 1967–1968 influenza season in Great Britain, general practitioner (GP) consultation rates for ILI among 5-year-olds to 14-year-olds declined during the winter holiday and increased when schools reopened; this effect was less clear in other age groups.17

Winter holidays in Israel were associated with a reduction in the ratio between the number of clinic visits for influenza and those for non-respiratory complaints, in 6-year-olds to 12-year-olds, in three of five seasonal influenza periods studied.15 In one season, this ratio was also reduced in adults, and in another it was reduced for adults not living with 6-year-olds to 12-year-olds. When a 2-week teachers’ strike coincided with an influenza outbreak in January 2000, closing 80% of elementary schools nationwide, this ratio decreased by 15% for 6-year-olds to 12-year-olds (95% CI 6% to 23%), but not for older individuals. As the authors note, children comprise a high proportion (34%) of the Israeli population, which may contribute to any apparent benefit of closing schools in Israel.26

Similar data from four influenza seasons in Arizona are less consistent, partly because school closure rarely coincided with elevated influenza activity.18 During all four seasons, rates of laboratory-confirmed influenza in school-aged children were similar during the 2-week winter holiday and the preceding 2 weeks. In two seasons, this rate increased in the 2 weeks after schools reopened; in one other season, it was significantly lower on reopening than during closure.18 In comparison, rates in adults and preschool-aged children increased successively (though not always significantly) across the three 2-week periods in three of the seasons.18

Three studies which fitted transmission models to surveillance data also concluded that school closures mainly benefit children.12 ,13 Analyses of French seasonal ILI data13 and ILI data from London during the 2009 pandemic22 estimated that school holidays did not affect adults’ contact patterns; similarly, reductions in transmission following school closures in Hong Kong in 2009 occurred primarily among children.12

However, two studies of the 2009 pandemic suggested that school closure affected incidence in adults. One of these studies estimated the age-specific number of ILI cases due to pandemic H1N1 in England; estimated case numbers in most age groups decreased during the summer holiday and increased when schools reopened.25 In Vojvodina, Serbia, incidence decreased among 5-year-olds to 14-year-olds and 15-year-olds to 64-year-olds during a 1-week school closure.27

Reversibility of effects

Incidence sometimes rebounded when schools reopened, suggesting that school closure contributed to reducing incidence in some settings. For example, during the 2009 pandemic in England, the estimated weekly number of infections declined during the school summer holiday; a second wave occurred when schools reopened (see online supplementary figure S2).22 ,28 Similar reversibility appeared in ILI consultation rates in Vojvodina in 2009.27 Datasets from the 2009 pandemic in Mexico23 ,29 ,30 also suggested an increase in incidence after schools reopened (see online supplementary figure S2). Analyses of NPIs (usually including school closures) during the 1918 pandemic found that, in the cities studied, second waves occurred only after NPIs were lifted.5 ,8

In the Israeli data regarding seasonal influenza and the teachers’ strike, the number of physician visits for acute respiratory illness was 42% lower during closure compared with the previous 2 weeks; incidence increased after the strike.26 During the 1999–2000 influenza season in Japan, the increase in incidence appeared to slow during the 2-week winter holiday and accelerated when schools reopened.7 Similarly, in Beijing in 2009, the cumulative incidence of laboratory-confirmed H1N1 influenza increased more markedly before and after a national school holiday than during the break.31

Changes in transmission patterns from modelling analyses of epidemic data

Several studies have fitted transmission models to observed epidemic data to estimate the reduction in contact rates associated with school closure. School holidays were estimated to reduce transmission of seasonal influenza among children by a median of 24% (range 20–29%), based on rates of ILI in France from 1985 to 2006, corresponding to a 16–18% reduction in total case numbers.13 During the 2009 pandemic in London, contact among 5-year-olds to 14-year-olds was reduced by an estimated 72% during the 6-week summer holiday; the corresponding reduction during the 1-week half-term holidays was 48%.22 In US cities in 1918, changes in mortality were attributed to a combination of formal interventions (including school closure) and spontaneous social distancing.8 In Sydney in 1918, formal and spontaneous social distancing together were estimated to have reduced contact rates by up to 38%.32 Based on the influenza incidence data from the 2009 pandemic in Mexico City, school closure together with other interventions appeared to reduce the population contact rate by 23%.30 A subsequent analysis of national data from Mexico estimated that the contact rate was reduced by 30% during the intervention period.23

In Hong Kong (also during the 2009 pandemic), closing primary schools, kindergartens and childcare centres proactively, together with the affected secondary schools, were estimated to reduce transmission by 70% among children and 25% in the population overall.12 The same study estimated the effective reproduction number (Rn, the average number of secondary infectious persons generated by a single infectious person in a given population) as 1.7 before school closure, 1.5 during school closure and 1.1 during the subsequent school holidays.12 Daily estimates of Rn in Hong Kong in 2009 (based on a longer time series) also suggested a decline during school closure and a slight increase following reopening.33

Modelling techniques have also been used to estimate daily values of Rn during a seasonal influenza outbreak in Hong Kong34 and the 2009 pandemic in Mexico City23 ,30 and New Zealand.19 The Hong Kong analysis for seasonal influenza suggested that Rn was not substantially affected by school closure, perhaps because closure occurred late in the outbreak when Rn was already below one.34 In Mexico City 30 and New Zealand, Rn was declining before schools closed and continued to decrease during closure; in New Zealand, Rn increased briefly but not substantially when schools reopened.19 Analysis of a further outbreak in the USA detected no clear effect of school closure on transmission, which was attributed to the late timing of closure.20

Modelling analyses of the spatiotemporal spread of pandemic H1N1 in Europe in 2009 were able to reproduce observed incidence patterns only when contact rates were allowed to change specifically during each country's school holidays (holidays were assumed to eliminate transmission in schools and increase community transmission by a factor of 1.4).35 In all countries, holidays were estimated to delay the peak compared with a hypothetical situation without school closure. In contrast, regression analysis of estimates of Rn in 12 European countries found no evidence of an effect of school holidays on transmission in the nine countries in which school holidays coincided with the study period.36 The authors proposed that this apparent lack of effect might result from changes in reporting, stochastic effects early in the outbreaks, and the fact that in some countries (including England) school holidays occurred outside the study period.

Different school closure strategies

In some outbreaks, individual schools were closed; in others, school closure was more widespread (see online supplementary tables S1 and S2). The effects of these different strategies could not be compared, due to both late implementation and differences between the studies in other factors (such as the duration of closure).

Analyses of the 1918 pandemic in US cities found that the duration of NPIs was negatively associated with the total excess death rate.9 In the datasets reviewed here, closures longer than 2 weeks were associated with reduced incidence or transmission in several studies of seasonal37 and pandemic12 ,28 influenza, but not in others.11 ,38 Two studies which suggested reasonably strong evidence of an effect of school closure (from France and Israel) reported on closures lasting 2 weeks.13 ,26 Studies in Japan7 and England and Wales17 also suggested possible effects of 2-week closures on seasonal influenza. However, 2-week closures did not always appear to reduce transmission.34 Shorter closures, for example, of 1–2 weeks, may sometimes have contributed to reductions in transmission,22 ,28 ,30 ,31 ,39 but often had no obvious effect.40–43 In London, contacts between children were reduced more dramatically during a 6-week holiday than during 1-week breaks, but this may reflect different behaviour during the different holidays.22

Use of multiple interventions

In most of the pandemic influenza studies, other interventions were implemented alongside school closure and may have contributed to any reduction in incidence. In 2009, antiviral treatment and/or prophylaxis was commonly used in the studies identified.12 ,14 ,19 ,20 ,38 ,39 ,41 ,44–56 Public places were sometimes closed and/or large gatherings were discouraged or restricted.16 ,29 ,30 ,57 Some datasets from the 2009 pandemic included vaccination against the pandemic strain, although this was usually only available late in the study period, so it would not affect the included incidence data.28 ,31 ,56 ,58 In 1918, school closures were often combined with other social distancing measures;5 ,8 ,9 ,32 the only study included from the 1968 pandemic was a vaccine trial.59 Of the few pandemic studies which mentioned no additional interventions, one suggested an effect of school closures: in Israel in 2009, three waves of infection corresponded to the planned closure and reopening of schools.60 In the England and Wales data for the 2009 pandemic, other interventions (vaccination and antivirals) were used to only a limited extent; incidence still clearly declined during the school summer holiday and increased afterwards.28

Some studies of seasonal influenza mentioned additional interventions (eg, vaccination,61–63 prophylactic amantadine,64 hygiene promotion,37 ,40 ,65 closure of public places37 and advice to avoid large gatherings43). However, some studies without additional interventions showed reductions in incidence and/or transmission during school closure.13 ,26

Discussion

This systematic review of the effects of school closures on influenza outbreaks extends previous reviews2 ,4 to include published experiences from the 2009 pandemic. The results suggest that school closure can reduce transmission of pandemic12 and seasonal13 ,26 influenza among schoolchildren. Many datasets, however, show no clear effect of school closure. As noted by some authors,20 ,42 ,43 this may sometimes have been because schools shut late in the outbreak (often close to or after the peak).

In some studies, incidence increased when schools reopened.5 ,7 ,8 ,14 ,22 ,26 ,28 ,30 This apparent reversibility provides evidence that school closure can cause reductions in influenza incidence. In two of the studies of seasonal influenza which showed reversibility,7 ,26 no additional interventions (beyond usual seasonal interventions) were used. In many other datasets, multiple interventions were used, so the specific effects of school closures are difficult to isolate.

In 2009, several countries closed schools while in others, planned holidays coincided with outbreaks. Several datasets from this pandemic strengthen support for school closure as an intervention; however, others illustrate that benefits are not guaranteed and that timely closure may be challenging. The sensitivity of the 2009 pandemic to school closures probably reflects the high attack rates in children compared with adults; outbreaks in which children are less affected might be less sensitive to school closure.

Studies presenting age-stratified data suggested that the effects of school closure on transmission were greater among children than adults. Few studies stratified children further, for example, into primary and secondary school students. Older children might socialise more than younger children during school closures, so closing primary schools may have a greater effect on transmission than closing secondary schools (eg, in Hong Kong in 2009, primary schools were closed proactively while secondary schools closed if cases occurred among their students12).

The long-term effects of closing schools are unclear, as relatively few studies presented substantial data after schools reopened. For example, school closure could result in multiple peaks, potentially involving more cases than would otherwise have occurred.8 However, a study published since this review was conducted estimated that case numbers in Alberta, Canada, could have been up to twice as high as those seen if schools had not closed for planned holidays.66 It is difficult to compare reactive versus proactive closures, different durations of closure and local versus national closures as studies typically differed in several respects.

Some studies have concluded that reopening schools after holiday periods can accelerate epidemic growth (eg during the 1957 67 ,68 and 200969 pandemics). These studies were beyond the scope of this review of the effects of closing schools during outbreaks, but they suggest that extending school holidays might delay the spread of an epidemic beginning during a break.

Results from analyses of seasonal influenza may not be directly applicable to a pandemic. Schools were often closed for planned holidays rather than in response to the outbreaks; contact patterns may differ between reactive school closures70 and holidays.71 Extrapolating from previous pandemics may also be problematic. Modelling studies72–74 have predicted that school closures will have the greatest effects if transmission occurs mainly among children. The importance of children in transmission has varied between pandemics;75 in 2009, attack rates were higher in children than in adults, probably because of pre-existing immunity in older individuals.76 Viral virulence will also influence individuals’ responses to school closure and other interventions, for example, spontaneous social distancing during a mild pandemic may be less dramatic than occurred in 1918. Changes in household size, contact patterns, children's behaviour and school systems since 1918, 1957 and 1968 may also limit the generalisability of experiences from these pandemics. As noted in a study of the 1918 pandemic in Connecticut, reverse causality may occur when comparing rates in cities which closed schools to those in cities which did not, if closure was a response to a particularly severe local outbreak.10

One limitation of the datasets is that ascertainment may have changed during the outbreaks, due to changes in surveillance and care-seeking behaviour. Increases in ascertainment during an outbreak could obscure any reductions in incidence during school closures (eg in one study, enhanced surveillance began the day the school closed55). Conversely, the proportion of patients who undergo virological testing may be reduced late in an outbreak, and in some settings (eg New Zealand14) patients with ILI were discouraged from consulting GPs during the 2009 pandemic. The estimated proportion of influenza cases that were reported in Hong Kong declined to ∼5% of its original value during the move from containment to mitigation during the 2009 pandemic.12 In England, the introduction of the National Pandemic Flu Service telephone helpline coincided with the school holiday, and was estimated to have reduced the probability of GP consultation for adults with ILI from 16% to 1.8%.22

Case definitions may not always have been well suited to detecting any effect of school closure. For example, school absenteeism is a relatively non-specific measure, while laboratory specimens frequently represent severe infections (eg in the elderly, who may have little contact with children and therefore be relatively unaffected by school closure).

Influenza transmission is influenced by factors besides contact in schools, including temperature and absolute humidity (AH).77–80 Two studies which assessed the role of AH during the 2009 pandemic did not find strong evidence that it affected transmission.24 ,36 The two waves seen in the UK in 2009 could be explained by changes in contact patterns during school holidays.28 ,81 In a modelling study of data from Alberta, Canada, the best-fitting model included effects of temperature and school holidays on transmission, and predicted that if schools had not closed, the outbreak would have been restricted by temperature effects but would still have been 2.1 times larger than was observed in the province as a whole (1.38 and 1.54 times in the cities of Calgary and Edmonton, respectively).66 A study of the interplay between school calendars, AH and population susceptibility in enhancing influenza transmission concluded that high AH may prevent influenza outbreaks.78 However, if a sufficiently high proportion of the population is susceptible, outbreaks can occur even when AH is high; the opening of schools may enhance transmission.78 Taken together, these studies suggest that contact in schools is not the only determinant of influenza transmission, but it is one influential (and modifiable) factor.

Previous studies have estimated the effects of public-health interventions using transmission models.8 ,12 ,20 ,30 The development of such models is complicated for the datasets reviewed here, and would not necessarily have provided conclusive insight into the impact of school closures. For example, many factors are unknown and would need to be estimated or assumed for each dataset, such as the basic reproduction number, proportion of infections that were reported, effect of other interventions and the proportion of individuals who were immune at the start of the outbreak.

The review was limited to published studies, which could potentially introduce publication bias. However, many of the studies identified did not aim to evaluate the effects of school closure on transmission, so publication bias appears unlikely. This is supported by the apparent lack of an effect of school closure in many of the studies (including some of those which did specifically assess school closure as an intervention). A further limitation is that most papers were screened (and all data were extracted) by a single reviewer. Foreign language papers were excluded, but in most cases it was clear from the title and/or abstract (available in English) that the papers were not relevant to this review.

Conclusions

The available data suggest that school closures can potentially reduce transmission during an influenza outbreak, even in the absence of other interventions, although the optimal school closure strategy is unclear. The effect of school closures is larger for school-aged children than for other age groups, although there is some evidence that incidence in adults might also be reduced. During a future pandemic (or seasonal outbreaks during which schools are closed), it will be important to collect incidence data using systematic ascertainment and a consistent case definition, before, during and after school closure, to assess the effects of school closures on transmission. Analysis of comparable data from multiple outbreaks may help to overcome some of the problems with comparability and ascertainment discussed above, and clarifies which features determine the effectiveness of school closures. Although timely school closures may reduce transmission, other implications of school closure (eg, ethical and economic considerations)4 and viral properties such as virulence must also be considered in policy decisions, and may depend on the local context.1

Acknowledgments

This paper was developed from a review commissioned by the UK Health Protection Agency as part of its pandemic influenza programme. We thank Nadia Inglis, Angus Nicoll and two anonymous members of the HPA's Influenza and Respiratory Virus Programme Board for helpful comments on the review. We also thank the staff at the LSHTM library for assistance in locating papers.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Contributors BO and JH initiated the study and defined the initial research question. JH wrote the generic investigation plan and PM, CJ and EV developed the detailed methodology. CJ carried out the literature review and PM assessed any doubtful papers. CJ, PM and EV analysed the data. JH and BO contributed to interpretation of data. CJ, PM and EV drafted the manuscript, which was critically revised by JH and BO. All authors approved the final version for publication.

  • Funding This work was partially funded by the Health Protection Agency; CJ was supported by a Research Training Fellowship from the National Institute for Health Research.

  • Competing interests None.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.