Article Text
PDF
Abstract
Objectives To assess the association between soft-shell headgear (HG) use and sports-related concussion (SRC). Secondary objectives were to assess the association between HG and superficial head injury and investigate potential increase in injury risk among HG users.
Design A systematic search in Ovid MEDLINE, Cochrane Library, Scopus, PsycINFO and SPORTDiscus was conducted in April 2020. Inclusion criteria were youth <18, English language, in vivo studies published after 1980 that evaluated SRC and other injury incidence in HG users compared with non-users.
Outcome measures Incidence rates of SRC, superficial head injury or other injuries.
Results Eight studies were eligible. The majority (n=5) reported no difference in the rate of SRC among HG users versus non-users. One rugby study identified significantly lower risk of SRC for non-HG users (risk ratio (RR) 0.63; 95% CI 0.41 to 0.98) compared with HG users, whereas a cross-sectional survey of soccer players indicated higher risk of SRC for non-HG users (RR 2.65; 95% CI 1.23 to 3.12) compared with HG users. Three of the four studies investigating superficial head injury found no significant differences with HG use, though the soccer survey reported reduced risk among HG users (RR 1.86; 95% CI 0.09 to 0.11). Increased incidence of injuries to all body regions for rugby HG users was reported in two studies with adjusted RRs of 1.16 (95% CI 1.04 to 1.29) and 1.23 (95% CI 1.00 to 1.50).
Conclusions HG use was not associated with reduced rates of SRC or superficial head injury in youth soccer and rugby. The possibility of increased injury risk to all body regions for rugby HG users was raised. The need for research specific to youth and female athletes was highlighted.
PROSPERO registration number CRD42018115310.
- neurological injury
- sports medicine
- trauma management
- preventive medicine
Data availability statement
All data relevant to the study are included in the article or uploaded as online supplemental information.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
This systematic review provides the first comprehensive examination of the limited available evidence for the use of soft-shell padded headgear for sports related concussion prevention in youth athletes.
The review included only five studies that specifically pertained to youth cohorts. Many studies combined adult and youth participants, potentially confounding findings regarding risk taking behaviour with headgear which may differ across age.
The literature search revealed few articles. Included studies generally lacked robust evidence and did not assess the intervention of headgear as the primary outcome. As such, the conclusions should be interpreted with caution.
This review provides an up to date evidence base for community decision making on club headgear mandates and an indication of where data is currently lacking on the topic, specifically in youth and female athletes.
Introduction
Traumatic brain injury (TBI) is a leading cause of disability and death, contributing to a growing worldwide disease burden.1 Global estimates indicate that TBI affects 60 million individuals per year.2 Collision sports are recognised as a significant contributor, with exponential increases in hospital admissions for children and adolescents sustaining TBI since the early 2000s.3 The majority of these are classified as mild TBI, or sports-related concussion (SRC), with one study indicating that SRC emergency department visits have increased by more than 85% in 8–13 years and by more than 200% in 14–19 years.4 Increased public awareness around SRC and higher numbers of youth participation in collision sport are likely contributing to these increases.5
In most cases of youth SRC, symptoms resolve within 4 weeks,6 though some players have protracted recovery with cognitive, behavioural and emotional difficulties that interfere with school attendance, academic endeavours, sporting performance, social life and family relationships for months and sometimes years.7 Playing technique (eg, teaching skills that reduce exposure to head impacts), rule changes (eg, limiting tackling and contact) and the use of protective equipment (eg, hard shell helmets, padded headgear (HG) and mouthguards) are variably implemented as brain injury prevention initiatives in collision sports such as football, rugby and soccer.8 Helmet subtypes include those with a hard-outer shell used in the National Football League in the USA, and soft-shell padded HG, that either fully covers the head (eg, rugby scrum cap) or resembles a headband (eg, soccer HG) with an opening at the top. HG is most commonly used in rugby, with inconsistent uptake in Australian football and soccer,9 although with varying policy guidelines across community clubs. Within the sporting community it is a widely held belief that such HG protects against injury9 and SRC,10 leading some youth Australian football, soccer and rugby clubs to mandate its use.10 11
Previous reviews have evaluated HG effectiveness across a diverse range of HG models and sports (eg, skiing, American football, hockey, etc). Findings indicate evidence for hard-shell helmets in the prevention of severe TBI,12 though findings for SRC prevention with HG are equivocal at best.8 A systematic review by Emery et al found inconsistent evidence for the use of HG in rugby, and more consistent evidence that HG may play a role in soccer SRC prevention.13 The evidence, however, was scarce and largely drawn from cross-sectional, rather than randomised controlled trial (RCT) methods. The most commonly accepted opinion is that HG provides limited or no protection against SRC,14 although, this may be due to a lack of evidence, rather than a lack of effect.15 As such, debate continues with regard to HG for SRC prevention,8 12 and whether there is any evidence to support the notion of potential risk (ie, risk compensation behaviour). The risk compensation hypothesis posits that players may be at greater risk of sustaining injuries due to increased tackling using the head and increases in aggressive play because they assume greater safety when wearing HG.16 17 Importantly, to date, no reviews have focused exclusively on youth populations. Youth may be more vulnerable to risk compensation than adults,18 as the cognitive processes associated with risk taking in the developing brain are immature.19
The primary objective of this study was to assess the in vivo evidence for the intervention of HG for SRC in youth collision sports. Secondary objectives were to assess HG for prevention for superficial head injury (injuries superficial to the skull) and investigate potential indicators of risk compensation behaviour by assessing the association between HG and rates of injury to all body regions.
Methods
The review was conducted in accordance the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.20 See online supplemental file for search strategy.
Supplemental material
Patient and public involvement
Over many years, the study investigators have worked clinically in treating patients with SRC, ranging from initial presentation to the Emergency Department, through to specialist treatment clinics providing interventions for those with prolonged symptoms. Whether children should wear HG to play team sports was a frequent question posed by parents, players and sporting club staff.
Data sources
A systematic search was conducted in April 2020 using databases; Ovid MEDLINE, Cochrane Library, Scopus, PsycINFO and SPORTDiscus.
Study selection
Studies were included when the population of interest were athletes under aged 18 years who participated in a collision team sports study assessing the intervention of HG in comparison to no-HG on the primary (SRC) and secondary outcomes (head injury superficial to the skull and/or injuries to other body regions). Included studies were limited to those using quantitative methods to report SRC, head injury and other injury rates (eg, cross sectional survey, prospective cohort injury surveillance, RCTs). Studies were excluded when they did not report data on incidence of SRC, head injury superficial to the skull and/or injuries to other body regions in HG and no-HG groups, were not published in English language, or were published prior to 1980, laboratory based, conducted in adult only cohorts, conducted in individual and/or non-contact sports or only included participants wearing hard-shell helmets. Authors Archbold et al 21 were contacted and agreed to provide additional unpublished data on the rates of SRC sustained by HG users and non-users.
Two review authors (JMK and JN) independently screened manuscripts on title and abstract, selecting agreed citations in full text using the predetermined eligibility criteria. The reviewers then independently screened the selected manuscripts in full text. Disagreements were adjudicated by a senior member of the team.
Data extraction
Data on study design, sporting code, sample size, cohort characteristics, methods, outcomes and covariates predicted to alter injury risk, and main findings were extracted from each study. Description of study participants, injury definitions and the denominators used to compute injury incidence were extracted in as much detail as each study provided. Incidence rate ratios (IRR), relative risk and risk ratios with 95% CI were extracted (if reported) from each study. Where these were not available, relative risk and 95% CIs were calculated using the incidence data available. Due to the expected heterogeneity in reported statistical methods and study design, a meta-analysis was not planned.
Quality and level of evidence assessment
Two reviewers (JMK and JN) independently assessed the quality of non-randomised studies using the nine-item Newcastle-Ottawa Scale (NOS) for Cohort Studies.22 The NOS assesses three domains and assigns up to a maximum of nine points for: (1) selection of cohorts (four points); (2) comparability of cohorts (two points); and (3) outcomes (three points). On this scale, scores between 7 and 9 were considered good quality, and scores 1–6 were considered low quality. The quality of RCTs were assessed using the 11-item Physiotherapy Evidence Database (PEDro) scale.23 On this scale, scores between 9 and 11 were considered excellent quality; 6–8, good quality; 4–5, fair quality and <4, poor quality.24 Reviewers also assessed levels of evidence using the Oxford Centre for Evidence-Based Medicine (OCEBM) guidelines.25 The OCEBM levels range from level 1, representing systematic reviews, level 2 representing randomised trials, level 3 denoting non-randomised controlled cohort/follow-up, level 4 denoting case series, to level 5, denoting mechanistic reasoning. All included studies were assigned a number indicating the level of evidence and quality.
Results
Of the 4355 citations that remained after duplicates were removed, 73 were screened in full text for eligibility and of these, 65 were excluded (figure 1). The most common reasons for exclusion were if studies were laboratory-based or used hard-shell helmets. Studies were also excluded based on outcome measures and alternate populations. After screening, eight studies were included for qualitative analysis and none were excluded based on quality analysis.
The figure depicts a PRISMA flow chart showing systematic exclusion of articles at each stage of the review. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
Study characteristics
All studies were published between 2001 and 2019 and study designs included prospective cohort injury surveillance (n=4), RCT (n=2), pilot RCT (n=1) and cross sectional (n=1). There were six rugby and two soccer cohorts, with a total of 12 064 participants. Three studies included female athletes, who represented 2038 (17%) of the total included participants. Of the eight included studies, five were exclusive to youth, and others comprised mixed adult/youth cohorts who ranged in age from 13 to 45 years. Studies examined the effect of HG on rates of SRC (n=6), injuries to other body regions (n=5), head injury superficial to the skull (n=4) and frequency of impacts sustained to the head (n=1). Three studies examined a combination of these outcomes, as they associated the use of soft-shell HG with SRC, superficial head injury and injuries to other body regions. Injury data was typically collected for games and training sessions, with the exception of three studies that included injuries sustained in games only. Study characteristics are summarised in table 1.
Methodological details of studies
Quality and levels of evidence results
Interrater agreement for quality analysis between the two reviewers (JMK and JN) assessing the eight included manuscripts was 94.44%. The results for quality assessment and levels of evidence for cohort studies can be seen in table 2. Selection bias was considered low in all studies. Only one study was not awarded full points in this domain, as Delaney et al. 26 did not ascertain the exact number of exposures to SRC reliably due to using self-report, as opposed to direct observation or secure record. For comparability of cohorts, all studies controlled for age, sex and injury history, with only one study not controlling for additional factors. Delaney et al 26 did not account for factors such as player position and player experience that may, in addition to HG use, modify injury rates.27
Results for NOS scale risk of bias assessment and Level of Evidence (OCEBM)
For the final domain, three studies did not assess SRC and injury outcomes using an independent observer. The findings of Delaney et al 26 were deemed to have the highest risk of bias due to a cross-sectional survey design with the survey accessible online to players (aged 12–17 years) who could reaccess it multiple times to update SRC symptoms. In addition, the injury definition used did not relate to time lost from participation in sport and/or medical-attention received for injury, the most common definition28 used in all other studies. Two other studies were considered to be subject to the inherent biases associated with self-report data collection, due to a prospective design where researchers completed weekly, postgame follow-up interviews with players over the phone.29 30 These self-reported methods contrasted those used where direct SRC and injury observation was completed by trained data collectors, athletic trainers and medical professionals.
Both RCTs31 32 were assessed as good quality, the OCEBM levels of evidence were scored as two (table 3). On the PEDro scale, they both recieved scores of eight with only three criteria not met (5–7). These criteria related to the blinding of participants, therapists and assessors. It was deemed unfeasible to expect blinding in these studies due to the fact that the intervention (HG use) was directly observable.
Randomisedstudy quality (PEDro scale) and level of evidence (OCEBM)
Overall, methodology across studies tended to lack scientific rigour in one or more aspects, and incidence of injury was made difficult to interpret due to different methods of reporting injuries (eg, per player, per player weeks, per player hours). The most common convention was for authors to report injuries per player 1000 player games. The two studies who did not conform to this, were subject to retrospective self-report bias. For instance, Marshall et al.,30 obtained injury data from players at weekly intervals and therefore reported by ‘player week’, and Delaney et al.,26 reported injuries ‘per player’, likely because players reported SRC at a single survey time point. These studies likely reported injuries in this way because they did not capture players’ true exposure to injury, and therefore could not report per hour.
Few studies prospectively recorded HG wearing rates throughout the season. Indeed, many studies relied on a questionnaire administered at a single time point asking players whether they used HG. In the Hollis et al. 33 study the authors used a Likert scale (eg, never, rarely, sometimes) to ascertain HG useage rates, and reported that players who ‘always’ wore HG were significant less likely to sustain SRC than those who ‘rarely’ wore HG. First, this is not an accurate reflection of HG use, as players may have decided to use or not use HG depending on how they felt on match day, and second, the rates of SRC among those who ‘always’ wore HG, compared with those who ‘never’ wore HG, were in fact very similar (see table 4 for details).
Outcome data for concussion, head injury and injuries to other body regions stratified by HG versus no-HG
The RCTs (of which there were only 2) were the only studies that reliably recorded HG use. Without accurate data on whether players consistently wore HG, the results are prone to bias and confounding as player propensity to risk taking may have been inconsistent across games. In addition, HG uptake was generally low across observational studies, and compliance poor in RCTs, rendering many studies statistically underpowered to assess for difference in outcomes among HG users and non-users. As data reporting methodologies differed across studies, the data presented should be interpreted with caution, especially when comparing results that were obtained across varying contexts with inconsistent definitions of SRC and injury.
HG use and SRC
Outcomes for SRC, superficial head injury, head impacts, and injuries to other body regions stratified by HG use versus no-HG use (No-HG) are listed in table 4. There were seven studies included that analysed SRC. Of these, five (one in soccer and four in rugby) found no differences in rates of SRC with or without HG (see table 4).21 30–32 34 Contrasting findings were seen in two other studies; a prospective cohort study in rugby showed that non-HG users were at significantly lower risk of SRC (risk ratio (RR 0.63; 95% CI 0.41 to 0.98) than HG users, and a cross-sectional survey of soccer players outlined higher risk of SRC for non-HG users (RR 2.65; 95% CI 1.23 to 3.12) compared with HG users.
HG use and superficial head injury
There were four included studies that investigated the association of HG use and superficial head injury. Two assessed rugby cohorts and found no statistically significant difference in rates of sustaining superficial head injury between HG users and non-users.21 34 In the soccer survey study, non-HG users were reported to have higher adjusted risk of superficial head injury (RR=1.86; 96% CI: 0.09 to 0.11) compared with HG users.26 Among the four studies reporting superficial head injury, one reported frequency and type of head impacts using game video analysis. That study found no statistically significant association among HG users (RR: 1.54; 95% CI 0.63 to 3.75) compared with non-HG users.34
HG and injuries to all body regions
There were five included studies that reported on injuries to all body regions. Four of these conducted the analyses with SRC and all body injuries combined as a composite outcome variable.21 29 30 32 Reporting this composite outcome were two studies conducted in rugby with no differences observed in injury rates among HG users vs non-users.21 30 In contrast, Chalmers et al 29 and McIntosh et al 32 reported increases in injury rates to all body regions in rugby players wearing standard HG, adjusted RR: 1.23 (95% CI 1.00 to 1.50) and adjusted RR: 1.16 (95% CI 1.04 to 1.29), respectively. The McIntosh et al 32 study also investigated injury rates to all body regions for players who wore ‘modified HG’. The use of this HG was not associated with increased injury risk, adjusted IRR: 1.05 (95% CI 0.78 to 1.41), although the group accounted for only 11% of exposures to SRC due to poor compliance. The remaining RCT study by McGuine et al 31 reported the outcome of injury to other body regions (excluding SRC) and found no difference in rates for soccer HG users and non-users with adjusted RR=0.91 (95% CI 0.64 to 1.29).
Discussion
The association of HG with SRC, superficial head injury and other injuries
The findings from this review do not support the use of the current, commercially available HG to prevent SRC in youth soccer or rugby. The majority of in vivo evidence is consistent with laboratory research showing that HG does not mitigate the forces associated with head impacts.35–37 Though some protection may be offered against superficial head injury, as purported by Delaney et al 26 and prior studies where HG has been shown to protect against soft tissue injuries sustained to areas of the head covered by padding.38 Importantly, there may also be potential for increased risk of sustaining all types of injuries. Two studies reported 23%29 and 16%32 increases in all types of injury risk for rugby players who wore commercially available HG, and indeed, results from one prospective cohort injury surveillance study indicated higher risk of SRC among players who wore HG.21 Raised by these findings, is the possibility that risk compensation is a phenomena occurring in rugby, but not soccer, as increased injuries were not observed among soccer HG users in a RCT. Soccer is unique in that SRC and other types of injury are sustained when players purposefully use their head to progress the ball,9 when players knock heads39 or when falling over during a tackle.40 In contrast, the majority of SRC and other injuries in rugby are sustained in player to player collisions during full body tackling.40 41 These fundamental differences may render rugby HG users more vulnerable to risk compensation behaviours because injury mechanisms overtly differ and their style of play allows for the head to be used as a tackle weapon.
Given that perceptions about HG and associated behavioural changes may differ across the lifespan, it is unclear whether injury risk associated with HG use differs between adult and youth populations. A commonly held belief reported by youth rugby players is that HG makes them feel safer in contact situations and allows them to play ‘harder’.16 42 A study on HG perceptions among adult and youth rugby players indicated that these beliefs differed with age, as youth tended towards greater acceptance and beliefs in the utility of HG.43Adult HG users may be protected against risk compensation as they are less prone to misguided beliefs about HG.
The studies included in the review span almost two decades raising the possibility that changes in HG technology might influence outcomes. No chronological trends were apparent in the analysis and industry experts are of the opinion that the commercially available HG has not advanced considerably since the 1990s.37 Confounding a summative interpretation was the heterogeneity found in definitions of injury. One study referred to superficial head injury as the ear and scalp only,30 while others included the face21 26 or excluded the face from the definition.32 Some studies defined an injury as occurring only if a player was observed to miss time from play,21 32 33 or received attention from a medic or athletic trainer,31 33 34 while others used retrospective player self-report.26 29 30 Retrospective self-reported methods are not consistent with standards which suggest prospective recording by health professionals is superior to retrospective interview.28 The differences in methodology were prominent in the heterogeneity of outcomes with far higher proportion of SRC recorded when self-reported compared with studies that used direct observation.26 31
Directions for future research
A key finding of this review is that standardised definitions and reliable recording of HG use are vital to ensure the translation of findings to clinicians and the community. It is recommended that injury definitions are guided by the most recently published consensus statements, and that definitions rely on a number of factors to describe severity. It is recommended that an SRC be defined as a ‘TBI induced by biomechanical forces’ with physical, behavioural, cognitive and somatic clinical features documented with each SRC event.6 A superficial head injury should be defined as any injury to the head that is superficial to the skull (including contusions, abrasions and lacerations).26 To capture the full spectrum of SRC and other injuries and facilitate comparison with past results, it is recommended that researchers record all injuries using a combination of ‘broad’ definitions (eg, injury recorded if it causes a player pain or discomfort) and ‘narrow definitions’ (eg, injury recorded if player misses a game).44 As an example, an injury anywhere on the body should be initially documented by body region (eg, lower leg, arm, head) and pathology (bruise, open wound, fracture) if it causes a player pain. Additional information on whether that injury resulted in time lost from play, missed games, required medical attention or resulted in hospital transfer should be collected as surrogates for severity.45 Data collection conducted by a medical professional diagnosing SRC and reliably classifying players as HG users and non-HG users would be optimal, however, we acknowledge this is not possible in most youth community sports. As an alternative, live observation by trained data collectors that are athletic trainers or work in health-related fields has shown promise.28 Video analysis may also have a role in augmenting findings. This could allow researchers to examine the number of head impacts sustained by each player, observe whether the player was wearing HG at the time of impact, and code the behaviours of HG wearers.
Under-representation of female athletes in the included studies was frequently observed. Compared with male athletes, females have been reported to have higher rates of SRC46–50 report more SRC symptoms,51 52 demonstrate worse cognitive impairment following SRC,50 51 and may take longer to recover.52 53 In addition, it has been suggested that females are at higher risk of the effects of subconcussive impacts due to differences in neck strength and body composition.54 Given the exponential increase in female participation in these sports,55–57 further evaluation of injury risk and prevention in this cohort is crucial to future research.
Ultimately, injury surveillance systems specific to youth have not yet been developed, as they largely exist at the elite level and require significant financial and operational resources to conduct.28 Nonetheless, identifying constraints is an important step for researchers conducting future studies to address this important issue. Existing constraints are the potential ethical dilemmas regarding HG being implemented in an RCT because of the lack of evidence that supports its protective benefit versus potential harm. Other barriers include difficulty truly randomising HG (ie, allocation often occurs based on entire teams and is stratified by gender) and poor compliance. For instance, only 11% of exposure hours were attributable to those in the modified HG arm of the McIntosh et al.32 RCT due to very low compliance. A HG RCT conducted in Australian football that was screened for inclusion also revealed that SRC and injury outcomes could not be assessed due to very low compliance in HG use.58 Low compliance was less problematic in the included soccer RCT with 99.5% of those allocated to the HG arm consistently wearing it,31 raising the question of what encourages compliance in these types studies. As seen in McGuine’s (2019) study, players chose their preferred HG model from a range of provided options that met specific testing standards. This potentially contributed to higher compliance because the players had greater involvement and autonomy. It may also be that soccer HG is less intrusive because it covers less of the head and may not induce as much discomfort via increased heat and perspiration.
Strengths and limitations
The primary strength of this review is that it provides a picture of where data is currently lacking, highlights significant evidence gaps particularly in youth and female athletes, and outlines a framework for researchers to further explore this important topic. The review included only five studies that specifically pertained to youth cohorts. Many studies combined adult and youth participants, potentially confounding findings in outcomes due to the higher level of experience, training and increased maturity in risk-taking decision making among adults.19 Without robust data, it was difficult to draw definitive conclusions about the role of HG in sports injury prevention. An important methodological issue was that reporting of results across studies was inconsistent. Reporting of homogeneous outcomes and 95% CIs was not possible in all cases as data was not available, although attempts were made to reanalyse available data to provide consistency.
Conclusion
Extending on the most recent Concussion in Sports Group consensus,6 this review indicates a lack of scientifically rigorous research that clearly outlines the benefit or harm of wearing HG in youth collision sports. Future research should include a representative population and focus on including female participants across a range of sporting codes that use HG. Standardisation of the definitions and measurement of outcome variables are indicated for comparability across studies.
Data availability statement
All data relevant to the study are included in the article or uploaded as online supplemental information.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @Biswadev_M
Contributors CW was the chief investigator. CW, BM and JMK were involved in the planning, design and registration of the study protocol. JMK conducted the systematic search. JMK and JN screened studies for eligibility. JMK extracted data from studies and wrote the first draft of the manuscript. All authors made revisions and approved the final manuscript.
Funding This work was supported by the Equity Trustees Walter Cottman Charitable Trust (COTT2017M002) and the Australian Football League (no grant number provided from this organisation).
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.