Article Text

Original research
Consumption and effects of caffeinated energy drinks in young people: an overview of systematic reviews and secondary analysis of UK data to inform policy
  1. Claire Khouja1,
  2. Dylan Kneale2,
  3. Ginny Brunton3,
  4. Gary Raine1,
  5. Claire Stansfield2,
  6. Amanda Sowden1,
  7. Katy Sutcliffe2,
  8. James Thomas2
  1. 1 Centre for Reviews and Dissemination, University of York, York, UK
  2. 2 EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, London, UK
  3. 3 Faculty of Health Sciences, Ontario Tech University, Oshawa, Ontario, Canada
  1. Correspondence to Claire Khouja; claire.khouja{at}york.ac.uk

Abstract

Background This overview and analysis of UK datasets was commissioned by the UK government to address concerns about children’s consumption of caffeinated energy drinks and their effects on health and behaviour.

Methods We searched nine databases for systematic reviews, published between 2013 and July 2021, in English, assessing caffeinated energy drink consumption by people under 18 years old (children). Two reviewers rated or checked risk of bias using AMSTAR2, and extracted and synthesised findings. We searched the UK Data Service for country-representative datasets, reporting children’s energy-drink consumption, and conducted bivariate or latent class analyses.

Results For the overview, we included 15 systematic reviews; six reported drinking prevalence and 14 reported associations between drinking and health or behaviour. AMSTAR2 ratings were low or critically low. Worldwide, across reviews, from 13% to 67% of children had consumed energy drinks in the past year. Only two of the 74 studies in the reviews were UK-based. For the dataset analysis, we identified and included five UK cross-sectional datasets, and found that 3% to 32% of children, across UK countries, consumed energy drinks weekly, with no difference by ethnicity. Frequent drinking (5 or more days per week) was associated with low psychological, physical, educational and overall well-being. Evidence from reviews and datasets suggested that boys drank more than girls, and drinking was associated with more headaches, sleep problems, alcohol use, smoking, irritability, and school exclusion. GRADE (Grading of Recommendations, Assessment, Development and Evaluation) assessment suggests that the evidence is weak.

Conclusions Weak evidence suggests that up to a third of children in the UK consume caffeinated energy drinks weekly; and drinking 5 or more days per week is associated with some health and behaviour problems. Most of the evidence is from surveys, making it impossible to distinguish cause from effect. Randomised controlled trials are unlikely to be ethical; longitudinal studies could provide stronger evidence.

PROSPERO registrations CRD42018096292 – no deviations. CRD42018110498 – one deviation - a latent class analysis was conducted.

  • nutrition & dietetics
  • epidemiology
  • public health
  • community child health

Data availability statement

Data are available upon reasonable request. All the data in the overview are publicly available, but not necessarily without charge. Those for the dataset analysis are available from the UK Data Service.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The main strength of this study was the novel use of a secondary data analysis to fill a gap in the evidence that was identified by the overview.

  • A strength of the overview was its robust methods, and that it only included reviews that used systematic methods.

  • A limitation of the overview was the strength of evidence of the primary research, most of which was from cross-sectional surveys.

  • The main limitations of the dataset analysis were that longitudinal data were not available, and the survey data could not be combined due to differences between surveys in their designs and measures reported.

Introduction

Caffeinated energy drinks (CEDs) are drinks containing caffeine, among other ingredients, that are marketed as boosting energy, reducing tiredness, and improving concentration. They include brands such as Red Bull, Monster Energy, and Rockstar. There is widespread concern about their consumption and effects in children and adolescents (under 18 years old).1–4 Some professional organisations have suggested banning sales to children.2 In the UK, warnings, aimed at children and pregnant women, are required on the packaging for drinks that contain over 150 mg/L of caffeine.5 An average 250 mL energy drink contains a similar amount of caffeine to a 60 mL espresso, and the European Food Safety Authority proposes a safe level of 3 mg of caffeine per kg of body weight per day for children and adolescents.6 Many drinks also contain other potentially active ingredients, such as guarana and taurine, and more sugar than other soft drinks, although there are sugar-free options.7–9 Children may be more at risk of ill effects than adults.10 11 Effects could be physical (eg, headaches), psychological (eg, anxiety) or behavioural (eg, school attendance or alcohol consumption).12 Available systematic reviews report a wide range of findings, including positive effects on sports performance.

In 2018, the UK government ran a consultation on implementing a ban on sales to children,13–15 and in March 2019 they published a policy paper.16 The research reported here was commissioned by the Department of Health and Social Care (DHSC), England, in 2018, to identify and assess the evidence on the use of CEDs by children. As the deadline was short, and as initial searches identified several systematic reviews, a systematic review of systematic reviews (referred to as overview, from this point onwards) was conducted. As only two UK studies were identified within the reviews included in the overview, UK datasets were sought, and a secondary analysis of relevant data was carried out to supplement the international literature and ensure relevance to UK policy. Full reports are available.17 18

The research questions (RQ) were:

RQ1. What is the nature and extent of CED consumption among people aged 17 years or under in the UK?

RQ2. What impact do CEDs have on young people’s physical and mental health, and behaviour?

Methods

This paper summarises the overview and dataset analysis.17 18 For the overview, a literature search was conducted during May 2018 and updated on 2 July 2021. EPPI-Reviewer software19 was used to manage the data. The gaps, identified by the overview and a search for primary studies, guided the search, conducted during August 2018, for UK datasets and their subsequent analysis. STATA v1320 was used to analyse the datasets. Ethical approval was granted by UCL’s Ethics Committee. Protocols were registered on PROSPERO (CRD42018096292 and CRD42018110498).

Search strategies

For the overview, we searched nine databases, focusing on research in health, psychology, science or social science, or general research. We completed forward citation searching in Google Scholar for 13 included reviews. The databases searched and the MEDLINE search strategy are in the online supplemental file (section 1). The search terms were based on three concepts: caffeine, energy drink, and systematic review. The searches were limited to the publication year of 2013 onwards, to identify the most recent systematic reviews. For the dataset analysis, search terms were based on caffeine and energy drink. We searched the UK Data Service21 (accessing over 6000 UK nation population datasets), with no restrictions.

Supplemental material

Inclusion criteria

For the overview:

  • Systematic review published since 2013

  • Extractable data on children under 18 years of age

  • Available in English

  • Patterns of CED use or associations with physical, mental, social or behavioural effects.

Four reviewers (GB, CK, GR and CS) screened references based on their titles and abstracts, and then screened potential includes on their full texts. The four reviewers double-screened batches of 10 references until their decisions to include or exclude each paper were the same on at least nine of the 10 (90%), then they screened individually. Disagreements and indecisions were resolved by another of the four reviewers, where necessary.

For the dataset analysis:

  • Downloadable datasets, representative of the UK or a constituent country

  • Information on the levels and patterns of CED consumption

  • Data on children under 18 years of age (adults could provide the data on their behalf)

  • Reporting primary (frequency, amount, or occurrence of drinking/not drinking (comparator)) or secondary (sugar consumption, cardiovascular health, mental health, neurological conditions, educational outcomes, substance misuse, sports performance or sleep characteristics) measures.

After a pilot batch, for which two reviewers (GB and DK) assessed datasets independently and discussed their decisions to include or exclude, the remaining datasets were screened, independently.

Data extraction

From the systematic review reports that met the overview inclusion criteria, we extracted details on/for: systematic review methods; included studies; CED consumption; associations with physical, mental, social or behavioural effects; and risk of bias assessment. One reviewer (GB, CK, GR or CS) extracted these data, which were checked by another reviewer. For the dataset analysis, one reviewer (GB or DK) extracted dataset characteristics (sample size, etc); details on participants (age, gender, etc) and consumption (how it was measured, etc); well-being and health outcomes, including potential confounders; and information on missing data and for risk of bias assessment.

Syntheses

The data extracted from the systematic reviews were synthesised in a narrative format due to variation between reviews. Prevalence was synthesised by the measure used, where possible. Associations were synthesised by whether they were physical, mental, behavioural, or social/educational, and summary tables were produced. One reviewer (GB, CK, GR or CS) synthesised the data and another checked each synthesis.

Each dataset was analysed for prevalence and frequency of CED consumption, and any variations by children’s characteristics. Most of the cross-sectional analyses were bivariate (exploring interactions between two features), with binary and multinomial logistic regression used to control for confounders. A latent class analysis (LCA) was conducted,22 for one dataset. The latent profiles were based on children’s health experiences, such as headaches, anxiety, or dizziness. The observed variables (11 indicators of child well-being) and latent variables (five classes of well-being) were identified from the data. Class membership was used as the dependent variable in multinomial logistic regressions. Descriptive associations were explored in bivariate analyses of the 11 indicators, separately. The results from individual datasets were synthesised in a narrative because meta-analysis was not deemed to be appropriate. Missing data were not imputed, as it was not possible to determine if they were missing at random. One reviewer (DK) analysed the data.

Risk of bias

AMSTAR223 was used to assess the risk of bias in the included systematic reviews, because some reviews included randomised controlled trials (RCTs) as well as non-RCTs. AMSTAR2 has questions on the protocol, inclusion criteria, search, selection, data extraction, risk of bias assessment, reporting, synthesis (RCTs and non-RCTs), and conflicts of interest; a question on relevance was added. The strength of the evidence was assessed using GRADE (Grading of Recommendations, Assessment, Development and Evaluation) criteria,24 which can be used to determine whether the evidence is strong or weak, based on any risk of bias, including in study design and size, consistency of the results, relevance to the population, and potential publication bias. Overlap, where the same primary studies appear in more than one review, was assessed.25 Overlap can lead to double counting of the results of a study, giving these more influence than those of other studies.26 Two reviewers (CK and GR) assessed risk of bias; random samples were checked by a third reviewer (GB). Datasets were not formally assessed, but all datasets met the quality assurance criteria of the UK Data Service.27 Data on exposure (quantity, frequency and type of drink), sample frame (characteristics of participants), and level of participation (response rate) were extracted, by one reviewer (DK), to determine their parameters.17 In line with National Institutes of Health guidance,28 no overall risk of bias score was produced for each dataset because overall scores can be misleading where the risk of bias on each criterion has a different impact on the reliability of the conclusions.

Patient and public involvement

We did not include young people in the research process.

Results

The overview searches identified 1102 references, after deduplication (see figure 1); 126 were screened on full texts. We included 15 reviews; six reported information on prevalence,12 29–33 and 14 reported associations.12 29–32 34–42 The reasons for exclusion, based on assessment of the full text, are reported in the online supplemental file (section 2). Most were excluded because they did not use systematic review methods or did not report information on children.

Figure 1

Flow diagram for the overview. CED, caffeinated energy drinks; T&A, title and abstract.

Three reviews focused on CEDs in children.12 30 41 One35 focused on children, with a section on CEDs alongside other drinks. The other 11 reported information on children alongside data for adults; one29 with CEDs alongside other drinks, and two31 32 focusing on alcohol mixed with CEDs. For summary and full characteristics, see the online supplemental file (section 3) and the full report.18

For the dataset analysis, as there was no facility to export results, it was not possible to record the flow of datasets through screening. Five datasets met the inclusion criteria; analyses were not possible for one dataset43 (see table 1). For full descriptions, see the full report.17

Table 1

Description of the five datasets included in the secondary data analysis

Risk of bias

There was a high risk of bias in all but three of the reviews—Visram et al,12 and Bull et al 37 Yasuma et al 41 (details in the online supplemental file, section 4)—meaning that some relevant evidence may have been missed. Overlap between studies in the reviews was slight (corrected covered area 3.2%; see the online supplemental file, section 5). The reviews did not include any analyses of the UK datasets that we analysed. Within the reviews, there were four small randomised controlled trials, while most studies were surveys with a high risk of bias; the application of GRADE criteria, which are used to assess the overall strength of the evidence found, suggests that the evidence is weak. Exposure, sample frame and level of participation for the datasets are reported in appendix 1 of the full report.17

UK studies in the overview

Of the 74 studies identified by the reviews that are summarised in the overview, two were UK surveys. One44–46 was a longitudinal (two time-points) cross-sectional survey of 11- to 17-year-olds in the south-west of England. The other47 was a survey of 13- to 18-year-olds across 22 European countries, one of which was the UK (2.6% of respondents).

Below and in tables 2–4, the overview results are summarised by research question, followed by highlights of the dataset analysis within each topic. The full results of the overview18 and dataset analysis17 are available online.

Table 2

Characteristics and main findings of reviews reporting prevalence of consumption

Table 3

Prevalence of CED consumption across datasets by school year (approximately weekly consumption with weighted percentages and unweighted sample sizes - see notes below)

Table 4

Characteristics and main findings of the reviews reporting associations with consumption

RQ1. Nature and extent of CED consumption

The overview included six reviews with data on prevalence of children’s CED consumption, and these are summarised in table 2.

Across reviews, prevalence varied by study location, population age range, and definition of drinking (ever drunk, in the past year, regularly, with alcohol, etc) from 13% to 67% of children having a CED in the past year.30 32 One meta-analysis29 of four studies in the Gulf states suggested that about two thirds of children consumed CEDs (not further defined; 65.3%, 95% CI 41.6 to 102.3 (as reported in the paper)). Across reviews, weekly or monthly drinking ranged from 13% to 54%48 of children. In one study, across Europe, UK children had the highest proportion of caffeine intake from CEDs, at 11%,47 but this might reflect a lower intake from coffee or tea. Across reviews, 10%49 to 46%50 of children had tried CEDs with alcohol.

In the UK dataset analysis, self-reported prevalence was relatively consistent across UK countries (see table 3), although there were differences in the questions asked. About a quarter of children aged 13 to 14 years consumed one drink or more per week (Smoking and Drinking Survey of Young People (SDSYP) data).51 Prevalence ranged from 3% to 32% of children—slightly lower than found in the overview.

Characteristics of drinkers

In the overview, more boys reported drinking CEDs than girls.12 29–32 Prevalence by age was inconsistent: for example, within the reviews, one study48 found that girls started drinking CEDs when they were younger; while one52 suggested that drinking prevalence peaked at 14 to 15 years; and another53 suggested that more older boys drank CEDs than younger boys, but more younger girls drank them than older girls. Prevalence by ethnicity was also inconsistent. Children with minority ethnicity drank more than white children,12 32 but white children drank more than black or Hispanic children, when drinks were mixed with alcohol.12 In the UK, drinking was associated with being male, older and lower socioeconomic status.45

In the dataset analysis, the SDSYP reported the most detailed information on sociodemographic characteristics. As in most of the overview evidence, prevalence increased with age, so that between a quarter and a third of children aged 15 to 16 years reported consuming one or more CED per week. More boys (29.3%) than girls (18.1%), and more children living in the North of England than in the South (for example, 33.1% in the North-East vs 16.5% in the South-East), consumed at least one can a week. More children who were eligible for free school meals (29.5%), than those who were not eligible (22.6%), drank CEDs weekly. These differences were robust to the impact of potential confounders (see the online supplemental file, section 6). Unlike the evidence from the overview, which suggested differences in consumption by ethnicity, the proportion of weekly CED consumers was within 3 percentage points of the average across all ethnic groups.

Motives and context

Three reviews reported on motives or context for consumption.12 29 32 The context was parties and socialising with friends or family12 32 35 or exams.29 Children’s motives included taste (particularly with alcohol), for energy, curiosity, friends drinking them, and parental approval or disapproval. Across the reviews, single studies suggested that more girls than boys drank CEDs to suppress appetite,54 while more boys than girls drank them for performance in sport.55 And about half of children knew that the drinks contained caffeine,56 while those who knew that the content might be harmful drank less.57

Motives and context were not measured in the UK datasets.

RQ2. Associations with drinking CEDs

Fourteen reviews reported associations and are summarised in table 4. Most reviews included cross-sectional evidence (surveys) or individual case studies. Three reviews12 40 42 reported prospective trials (four small RCTs in total), which assessed physical performance, cardiovascular response, or the effects of sleep education; one review reported prospective cohort studies.

As most of the evidence was from surveys, measured at a single time-point, cause cannot be distinguished from effect.

Physical health associations

Associations between drinking CEDs and physical symptoms were reported in all but one40 of the 14 reviews. CEDs improved sports performance.58 59 There was consistent evidence of associations with headaches, stomach aches and low appetite,12 35 42 and with sleep problems.12 30 35 42 Within the reviews, a trial of boys randomised to receive different doses of CED reported dose-dependent increases in diastolic blood pressure and decreases in heart rate.60 Across reviews,34 36–39 nine cases of adverse events were reported; eight children had cardiovascular events, and one had renal failure, following a single drink, moderate drinking, or excessive drinking (in a day or for weeks).

Analysis of the Health Behaviour in School Children (HBSC) 2013/14 data found that children drinking CEDs once a week or more, compared with those drinking less often, were statistically significantly more likely to report physical symptoms occurring more than once a week, such as headaches (22.2% vs 16.8%), sleep problems (13.6% vs 8.5%) and stomach problems (31.2% vs 23.1%).

Mental health associations

Associations between drinking CEDs and mental health were inconsistent.12 29 30 32 35 40 42 One review reported that improvements in mental health and hyperactivity were found in children who were randomised to receive an intervention to lower their intake of CEDs.61 Associations were found with stress, anxiety or depression,12 30 35 40 42 but two reviews12 40 also found studies that did not find an association. Some reviews included evidence of associations with self-harm or suicidal behaviour,30 35 40 42 and with irritation and anger.12 30 35 40 42

Secondary analyses of the HBSC 2013/14 data found that children who consumed CEDs at least once a week were statistically significantly more likely, than those who did not, to report low mood (20.3% vs 14.9%) and irritability (30.8% vs 18.0%) on a weekly basis.

Behavioural associations

Some evidence of associations between drinking CEDs and behaviour was reported.12 30–32 35 42 Drinking CEDs was associated with alcohol, smoking and substance misuse at a single time point,12 30 35 and at follow-up.41 CED consumption at baseline predicted alcohol consumption at follow-up.12 Consumption was associated with increased hyperactivity and inattention, and with sensation seeking.12 30 35 Injuries were associated with drinking CEDs with alcohol12 31 and without alcohol.12 30

Analysis of the SDSYP data found that higher proportions of children who consumed one or more cans per week had tried alcohol (59.1%) and smoking (39.7%), compared with non-CED consumers (alcohol 28.9%, smoking 10.4%).

Social or educational associations

Consistent associations between drinking CEDs and social or educational outcomes were reported.12 32 Within reviews, one UK study45 found an association between drinking CEDs once a week or more and poor school attendance. CEDs mixed with alcohol were associated with lower grades and more absence from school.32

Analysis of the SDSYP data found that almost half of children who had been truant or excluded reported drinking a can of CED on a weekly basis (49.5%), compared with less than a fifth of those who had not been truant or excluded (18.5%).

Well-being profiles

Using the HBSC 2013/14 dataset, we identified 11 indicators of well-being: weekly experience of irritability, sleep difficulties, nervousness, dizziness, headaches, stomach aches, and low mood; as well as low life satisfaction, feeling pressured by schoolwork some or a lot of the time, dislike of school, and low self-rated academic achievement. From these, using LCA, we identified five profiles: low psychological well-being (18.2% of children), high overall well-being (48.6%), low educational well-being (6.7% of children), low physical well-being (13.0%), and low overall well-being (13.5%). See the online supplemental file (section 6) for details.

After controlling for age, gender, rurality, smoking status, alcohol status and Family Affluence Scale (a measure of socioeconomic status; for more information see Hartley et al 62), the relative risk of having a low well-being profile, compared with a high well-being profile, was substantially higher for children who consumed CEDs at least 5 days a week (frequent), compared with those who rarely or never did. Relative to a high well-being profile, frequent consumers had a higher risk of low psychological well-being (RR 2.11, 95% CI 1.56 to 2.85) and low physical well-being (RR 2.52, 95% CI 1.76 to 3.61), and were over four times more likely to have low educational well-being (RR 4.81, 95% CI 3.59 to 6.44) and low overall well-being (RR 4.15, 95% CI 2.85 to 6.00). These data suggest that CED consumption is a marker of low well-being, but the analyses also showed that consumption was one of a cluster of factors (eg, smoking and drinking alcohol) in children with low well-being.

Discussion

Summary of the evidence

Prevalence varied according to the measures used and the ages of children. In the overview, CED consumption prevalence was up to 67% of children in the past year and, in the dataset analyses, up to 32% of children were consuming a CED at least 1 day a week, meaning that up to a third of UK children are regularly consuming caffeine. Evidence from the overview and the dataset analyses consistently suggests that boys drink more than girls, and that drinking tends to increase with age. Some evidence from the overview suggested higher prevalence in children from ethnic minority backgrounds, but no such association was detected in the UK data analysis. This could be due to factors such as area of residence or social class affecting well-being in children from ethnic minorities, where well-being is driving the differences in prevalence of CED consumption, rather than minority background. Reviews included in the overview found that most drinking of CEDs occurred at parties, around exams, with friends, or with family, and motives included taste, energy, curiosity, appetite suppression, and sports performance, which was reported to be improved. There was some evidence that knowledge of content was low, and that children who knew that the content might be harmful drank less, suggesting that education could reduce drinking.

Evidence from the overview suggests worse sleep, and raised blood pressure, with CED consumption, compared with reduced or no consumption. Both the overview and the dataset analysis found that children who consumed CEDs reported headaches, stomach aches and sleep issues more frequently than those who did not; although most studies were cross-sectional, some in the overview were longitudinal, showing changes over time.18 The overview identified consistent evidence of associations with self-harm, suicide behaviour, alcohol use*, smoking*, substance misuse*, hyperactivity, irritation*, anger, and school performance, attendance, and exclusion (*also found in the UK dataset analysis). This was consistent with findings reported in non-systematic reviews.10 63 64

The UK dataset analysis suggested that children who consumed CEDs 5 or more days a week had lower psychological, physical, educational and overall well-being than non-drinkers. It remains unclear whether drinking CEDs contributes to low well-being, or low well-being leads to CED consumption, or both. Alternatively, there may be a common cause, such as social inequality.

Strengths and limitations

The overview was limited by the amount of information reported in the included systematic reviews, and by their method limitations; all had a high risk of bias. They mainly included cross-sectional surveys or case reports, which means that cause or effect cannot be determined where an association is found. However, some prospective studies, including four small RCTs, were included in the reviews and where there were common measures, the evidence from these RCTs and from most of the cross-sectional studies within the reviews was consistent. This suggests that the associations found could be reliable. A strength of our work is that the UK evidence in the overview (two studies within the reviews) was supplemented by the analysis of UK data, which was mostly consistent with the non-UK evidence. These data support the idea that there is a link between drinking CEDs and poorer health and behaviour in children, although the cause is unclear. Overlap between reviews in the overview was slight (unsurprisingly, given the different foci of the reviews). There was no overlap between the reviews and the dataset analysis, meaning that the latter added new information. The wide range of tools used to measure prevalence made it difficult to summarise the overview evidence, and meta-analysis of the individual participant UK data was not possible, meaning that the conclusions are based on weaker evidence from single sources.

Recommendations for research

Standardisation is needed in the measurement of the prevalence of drinking—defining the dosage (in drinks and/or caffeine), timing (daily, weekly, etc) and population (age, ethnicity, etc). There was little evidence on children under 12 years old, and both the overview and dataset analysis found little evidence from the UK. Longitudinal data, from the UK datasets, should be collected to understand better the impact of consumption. RCTs may not be ethical, even where benefits are predicted, such as where children who consume CEDs are randomised to interventions to reduce or stop their drinking to see if this improves their well-being.

Conclusion

Based on a comprehensive overview of available systematic reviews, we conclude that up to half of children, worldwide, drink CEDs weekly or monthly, and based on the dataset analysis, up to a third of UK children do so. There is weak but consistent evidence, from reviews and UK datasets, that poorer health and well-being is found in children who drink CEDs. In the absence of RCTs, which are unlikely to be ethical, longitudinal studies could provide stronger evidence.

Data availability statement

Data are available upon reasonable request. All the data in the overview are publicly available, but not necessarily without charge. Those for the dataset analysis are available from the UK Data Service.

Ethics statements

Patient consent for publication

Ethics approval

This study does not involve human participants.

Acknowledgments

Thank you to Irene Kwan for assisting with data extraction for the review.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Twitter @katysutcliffe

  • Contributors GB, CK, GR and CS worked on all stages of the overview. GB, CK, DK and GR worked on the overview update. GB and DK completed all stages of the secondary data analysis. GB, KS, AS and JT supervised the work. All authors discussed the results and contributed to the final manuscript. JT is the guarantor of this work.

  • Funding This overview and secondary data analysis was funded by the National Institute for Health Research (NIHR) Policy Research Programme (PRP) for the Department of Health and Social Care (DHSC). It was funded through the NIHR PRP contract with the EPPI Centre at UCL (Reviews facility to support national policy development and implementation, PR-R6-0113-11003). Any views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the DHSC.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.