Table 2

Findings from the risk of bias assessment using the ROBINS-I tool, stratified by study design

StudyConfounding or
co-intervention bias
Selection
bias
Misclassification
bias
Deviation biasMissing data biasOutcome measurement biasOutcome reporting biasOverall judgementLikely direction
School closures—pooled multiple-area before-after comparison studies
Auger et al14ModerateLowLowLowLowLowLowModerateFavours experimental
Banholzer et al15ModerateLowLowLowLowModerateLowModerateUnpredictable
Brauner et al18ModerateLowLowLowLowLowLowModerateUnpredictable
Chernozhukov et al19ModerateLowModerateLowLowLowLowModerateUnpredictable
Courtemanche et al20ModerateLowLowLowLowLowLowModerateUnpredictable
Garchitorena et al24ModerateLowLowLowLowLowLowModerateUnpredictable
Hsiang et al26ModerateLowLowLowLowLowLowModerateUnpredictable
Jamison et al30ModerateLowLowLowLowLowLowModerateUnpredictable
Li et al35ModerateLowLowLowLowLowLowModerateUnpredictable
Liu et al36ModerateLowLowLowLowLowModerateModerateUnpredictable
Stokes et al46ModerateLowLowLowLowLowModerateModerateUnpredictable
Wu et al47ModerateLowLowLowLowLowLowModerateUnpredictable
Yang et al48ModerateLowLowLowLowLowLowModerateUnpredictable
Krishnamachari et al33ModerateLowSeriousLowLowLowLowSeriousUnpredictable
Dreher et al21SeriousLowModerateLowLowModerateLowSeriousFavours experimental
Li et al34ModerateLowSeriousLowLowLowLowSeriousUnpredictable
Papadopoulos et al39ModerateLowModerateLowLowSeriousLowSeriousUnpredictable
Rauscher42SeriousLowLowLowLowLowLowSeriousFavours experimental
Yehya et al49SeriousLowLowLowLowModerateLowSeriousFavours experimental
Zeilinger et al50ModerateLowLowLowLowSeriousLowSeriousFavours experimental
Kilmek-Tulwin and Tulwin32CriticalModerateLowLowLowModerateLowCriticalFavours experimental
Piovani et al40CriticalLowLowLowLowSeriousLowCriticalFavours experimental
School closures—within-area before-after comparison studies
Matzinger and Skinner37ModerateLowLowLowLowModerateLowModerateUnpredictable
Gandini et al23SeriousModerateLowModerateLowModerateLowSeriousUnpredictable
Iwata et al29SeriousLowLowLowLowModerateLowSeriousUnpredictable
Neidhofer and Neidhofer38SeriousSeriousLowLowLowLowModerateSeriousFavours experimental
Shah et al53SeriousLowModerateLowLowModerateLowSeriousUnpredictable
Sruthi et al43SeriousLowLowLowLowModerateLowSeriousUnpredictable
Stage—closuresCriticalLowLowLowLowModerateLowCriticalFavours experimental
School closures—pooled multiple-area comparisons of interventions in place at a fixed time point
Juni et al31SeriousLowLowLowLowLowLowSeriousFavours experimental
Wong et al51SeriousLowLowLowLowLowLowSeriousUnpredictable
Walach and Hockertz52CriticalLowSeriousLowLowSeriousLowCriticalUnpredictable
School reopening studies
Garchitorena et al24ModerateLowLowLowLowLowLowModerateUnpredictable
Harris et al25ModerateModerateLowModerateLowLowModerateModerateUnpredictable
Isphording et al28ModerateLowLowLowLowModerateLowModerateUnpredictable
Li et al35ModerateLowLowLowLowLowLowModerateUnpredictable
Gandini et al23SeriousModerateLowModerateLowModerateLowSeriousUnpredictable
Ingelbeen et al27SeriousLowLowLowLowModerateLowSeriousUnpredictable
Sruthi et al43SeriousLowLowLowLowModerateLowSeriousUnpredictable
Stage—openingSeriousLowLowLowLowModerateLowSeriousUnpredictable
Beesley16CriticalLowModerateModerateLowSeriousLowCriticalFavours experimental
Ehrhardt et al22CriticalLowLowModerateLowLowLowCriticalFavours experimental
Stein-Zamir et al45CriticalLowLowLowLowSeriousLowCriticalUnpredictable
School holiday studies
Pluemper and Neumayer41ModerateLowLowLowLowLowLowModerateUnpredictable
Bjork et al17LowLowLowSeriousLowLowLowSeriousFavours comparator
Beesley16CriticalLowModerateModerateLowSeriousLowCriticalFavours experimental
  • Scale applied: low, moderate, serious or critical.

  • ‘Favours experimental’ indicates that the bias likely resulted in an exaggeration of the reduction in community transmission associated with school closures.

  • ROBINS-I, Cochrane Risk of Bias In Non-randomised Studies of Interventions.