Article Text

Download PDFPDF

How effective are brief interventions in reducing alcohol consumption: do the setting, practitioner group and content matter? Findings from a systematic review and metaregression analysis
  1. Lucy Platt1,
  2. G J Melendez-Torres2,
  3. Amy O'Donnell3,
  4. Jennifer Bradley3,
  5. Dorothy Newbury-Birch4,
  6. Eileen Kaner3,
  7. Charlotte Ashton5
  1. 1Department of Social and Environmental Health, Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, London, UK
  2. 2Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
  3. 3Institute of Health and Society, Newcastle University, Newcastle, UK
  4. 4Health and Social Care Institute, Teesside University, Middlesbrough, UK
  5. 5Camden & Islington Public Health, London Boroughs of Islington and Camden, London, UK
  1. Correspondence to Dr Lucy Platt; lucy.platt{at}lshtm.ac.uk

Abstract

Background While the efficacy and effectiveness of brief interventions for alcohol (ABI) have been demonstrated in primary care, there is weaker evidence in other settings and reviews do not consider differences in content. We conducted a systematic review to measure the effect of ABIs on alcohol consumption and how it differs by the setting, practitioner group and content of intervention.

Methods We searched MEDLINE, EMBASE, PsycINFO; CINAHL, Social Science Citation Index, Cochrane Library and Global Health up to January 2015 for randomised controlled trials that measured effectiveness of ABIs on alcohol consumption. We grouped outcomes into measures of quantity and frequency indices. We used multilevel meta-analysis to estimate pooled effect sizes and tested for the effect of moderators through a multiparameter Wald test. Stratified analysis of a subset of quantity and frequency outcomes was conducted as a sensitivity check.

Results 52 trials were included contributing data on 29 891 individuals. ABIs reduced the quantity of alcohol consumed by 0.15 SDs. While neither the setting nor content appeared to significantly moderate intervention effectiveness, the provider did in some analyses. Interventions delivered by nurses had the most effect in reducing quantity (d=−0.23, 95% CI (−0.33 to −0.13)) but not frequency of alcohol consumption. All content groups had statistically significant mean effects, brief advice was the most effective in reducing quantity consumed (d=−0.20, 95% CI (−0.30 to −0.09)). Effects were maintained in the stratified sensitivity analysis at the first and last assessment time.

Conclusions ABIs play a small but significant role in reducing alcohol consumption. Findings show the positive role of nurses in delivering interventions. The lack of evidence on the impact of content of intervention reinforces advice that services should select the ABI tool that best suits their needs.

  • Systematic Review
  • Meta-analysis
  • Brief interventions on alcohol

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • A key strength of this review is the methodologically innovative approach to the meta-analysis through the use of a multilevel meta-analysis.

  • As a second sensitivity analysis we compared the findings from the multilevel model with a stratified analysis focusing on a subset of outcome variables. Findings from the two analyses were comparable.

  • Quality assessment criteria were used to assess risk of bias and the majority of studies were at low risk in relation to the randomisation procedure and monitoring of loss to follow-up.

  • A large proportion of studies did not provide information on other aspects of the study design including blinding of participants to the intervention, intention-to-treat analysis and blinding to outcome measurements.

  • Our review suggested limited effect for interventions delivered in community settings, but relied on a small number of studies across a wide variety of settings.

Introduction

Excessive alcohol consumption is a major public health concern, contributing to almost 4% of deaths worldwide,1 ranging from as high as 8% of deaths among men and women in the USA and Norway to 1.4% in the UK.2 ,3 It is estimated that over 10 million people in the UK alone drink more than the recommended daily units.4 Screening to detect individuals drinking alcohol at hazardous or harmful levels and the delivery of a brief intervention on alcohol (ABI) to reduce their consumption have been implemented in primary care settings where their efficacy and effectiveness have been demonstrated.1 The content of ABIs is varied, but usually focuses on the provision of structured advice, involving an assessment of individual risk with feedback and advice, or brief motivational interviewing that takes a more patient-centred approach, or a combination of both.5 Existing systematic reviews have found variability in effect by duration of intervention or number of visits, but this has not taken into account differences in content or provider.6–10 Although there is some emerging evidence that motivational interviewing can be more effective than ‘traditional’ advice (based on a provider-centred definition of a problem) across a range of health behaviours,11 this is not conclusive.12 Further, while the efficacy and effectiveness of ABIs have been demonstrated in primary care settings,13–15 the evidence base in health settings beyond primary care is weaker with moderate or no effect found in college16 ,17 and community settings.18 Some benefits have been observed from a small number of studies in accident and emergency (A&E) departments,19 ,20 as well as in general hospital settings but among mainly male patients.21 ,22 Implementation research has shown that contextual factors affecting the routine delivery of ABIs in primary healthcare settings are closely linked to practitioners. However, there has been little research looking at the impact of practitioners on intervention effectiveness outside primary healthcare settings.23 ,24

In England, the Government's Alcohol Strategy calls for the increased implementation of ABIs in primary care and A&E settings, while targets for implementing ABIs in these settings as well as antenatal clinics have been set by the National Health Service (NHS) Scotland.25 ,26 The National Institute for Health and Care Excellence (NICE) guidance recommends that ABI should be offered opportunistically by a range of relevant practitioners and front-line staff, while also acknowledging that the strength of evidence was clearer in some health settings compared with others. Nevertheless, this guidance flagged the relevance of social care, criminal justice, community and voluntary sector professionals to supporting alcohol risk-reduction work.27 This recommendation has been implemented by some public health authorities, rolling out interventions in sexual health clinics and community settings such as criminal justice services, and has also been advocated by global health agencies including the WHO.28 Given the international-level, national-level and local-level support for the expansion of ABIs beyond primary care settings, there is an urgent need to understand how a brief intervention process (including setting, provider and content) moderates their effectiveness in order to inform their implementation.5 We therefore undertook a systematic review and metaregression to measure the effect of ABIs on alcohol consumption and how the effect differs by setting, provider group and content of intervention.

Methods

Search strategy and selection criteria

We followed the PRISMA guidelines on reporting of systematic reviews.29 Studies eligible for this review were peer-reviewed randomised controlled trials of ABIs published in English. We included all populations aged 16 years or older but excluded populations with complex health problems, for example, studies of people living with HIV, tuberculosis, hepatitis C virus or homeless populations where it is difficult to generalise findings to the general population. Similarly we excluded populations seeking help at specialist addiction centres, mental health services or antenatal clinics. We included studies with control groups comprising: treatment as usual; information-only; assessment only; no assessment; or non-intervention, and excluded control groups consisting of other interventions, including other brief interventions such as advice and extended psychological treatments. Brief interventions were defined as person-to-person discussions on alcohol between one and four sessions and not more than 2 hours total intervention time. Computerised interventions tested alone, group interventions and those that target multiple behaviours were excluded. We also excluded studies where no measure of alcohol consumption was reported.

The primary outcome of interest was a quantitative continuous measure of total alcohol consumption within a specified time frame (standard drinks, grams of ethanol or days of drinking) where the standardised mean difference between brief intervention and control group was measured at the time of follow-up.

We searched: MEDLINE; EMBASE; PsycINFO; CINAHL; Social Science Citation Index and Science Citation Index through Web of Science; Cochrane Effective Practice and Organisation of Care Group specialised register; and Global Health between 1966 and 2015. The search was conducted in January 2015. We also scanned citations and contacted experts in the field to minimise selection bias. The search terms used were: ‘Brief intervention’ OR ‘minimal intervention’ OR ‘early intervention’ OR ‘cognitive behavioural’ OR ‘screening’ OR ‘counselling’ OR ‘brief advice’ OR ‘identification’ OR ‘managed care’ or ‘motivational interview’ AND ‘Alcohol drinking’ or ‘binge drinking’ OR ‘alcohol consumption’ OR ‘alcohol units' OR ‘alcohol use and misuse’ OR ‘alcohol intake’ OR ‘alcohol rate binge drinking’ OR ‘beer or wine or lager or spirit drinking’ AND ‘randomized controlled trial’ OR ‘random allocation’ OR ‘double blind methods’ OR ‘clinical trial’ OR ‘controlled clinical trial’ OR ‘multi centre studies’. Searches were tailored to the search functionality of each database (see web appendix).

Eligibility assessment was conducted independently by two reviewers. Disagreements between reviewers were resolved by consensus. We selected a list of risk of bias criteria from recommendations in the Cochrane Collaboration Reviewers' Handbook to assess the quality of the trials.30 Criteria included methods used to generate the allocation sequence to produce comparable groups and concealment of allocation to determine whether intervention allocations could have been foreseen before or during enrolment; blinding of participants and providers to intervention groups; blinding of outcome assessment; incomplete outcome data (including intention-to-treat analysis); and measurement of attrition rate.

Data were extracted from each publication into a database piloted on five studies, independently by GJM-T, LP, AO and JB without blinding authors' names, study site, intervention or trial results. These researchers jointly reviewed the extracted data and 10% of studies were double extracted. Data were extracted on characteristics of trial participants, type of interventions (including content, duration, frequency, provider, setting), type of outcome measure, time of assessment and effect estimates.

We extracted continuous outcomes in the units in which they were presented and then converted them into Cohen's d for comparability. When extracting continuous outcomes, we preferred estimates that were analysis of covariance adjusted for baseline score, followed by unadjusted post-test scores and finally repeated measures or ‘change score’ models. Change score models were reparametrised into a raw score metric using r=0.5, with sensitivity analysis at r=0.1 and r=0.9. Though past reviews have attempted to convert all measures to ‘natural units’ such as grams of ethanol, we decided that this was inadvisable because of the large number of trials in this review and because of our goal to include all relevant information, a key benefit of multilevel meta-analysis models.

Data synthesis

We grouped intervention content into three categories (figure 1). The first was motivational interviewing, including motivational interviewing-style, advice approaches such as FRAMES, motivational enhancement therapy as adapted for Project MATCH (Project MATCH Research Group, 1998) or brief motivational interviewing. We also identified a second subset of trials that tested specific enhanced interventional protocols for motivational interviewing (eg, drink less) or additions to motivational interviewing (eg, cognitive–behavioural approaches) from other therapeutic modalities and labelled this category motivational interviewing ‘plus’ (MI plus). A third subset included brief advice approaches, often labelled as such without any additional information.

Figure 1

Categories and definitions of interventions by content, provider and setting.

Intervention providers were grouped into: counsellors (defined as any mental health providers including clinical and research psychologists or clinical social workers); general practitioners (including primary care providers and general physicians); nurses (including research or clinical nurses on secondment); peer-delivered and different providers (but with no fixed provider). Setting of intervention delivery was categorised as: A&E services; community-based delivery that included a range of non-clinical settings; primary or ambulatory care delivered in clinical settings as outpatient services; hospital inpatient services and university services.

The systematic review protocol was registered on PROSPERO at the University of York (CRD42014014799).

Statistical analyses

We grouped outcomes hierarchically. We identified an overarching set of outcomes addressing quantity of alcohol consumption, from which we created two subsets of outcomes: (1) amount of alcohol consumed per unit of time; and (2) amount of alcohol consumed per drinking occasion. We also identified an overarching set of outcomes addressing frequency of alcohol consumption, from which we created a subset of outcomes including (1) frequency of any drinking occasion; and (2) frequency of binge drinking occasions.

For each overarching set and subset of outcomes, we specified five models: (1) an unconditional model that included all eligible continuous outcomes; (2) a model that included a grand mean-centred covariate for time of follow-up postbaseline, to address differences in follow-up; (3) a model including where the intervention was initially delivered and time of follow-up; (4) a model including the provider of the intervention and time of follow-up; and (5) a model including the content of the intervention and time of follow-up. To estimate mean effects for all groups simultaneously, we refit models with no intercept.31 We used the statistical package metafor,32 which implements advanced meta-analysis models, in the R environment for all multilevel analyses.

For our main analysis, we used a multilevel meta-analysis method to estimate the pooled effect sizes.33 Models included random effects on the effect size and study levels because of anticipated heterogeneity both within and across studies. Several trials tested different intervention or provider types in the same experiment, but insufficient trials did this to treat intervention as a ‘within-trial’ covariate. In order to adequately model these two moderators, we split the control groups in two for these trials and treated each intervention–control comparison as a separate trial. This avoided double-counting participants across intervention–control comparisons. Moreover, several studies presented results stratified by group. In our multilevel meta-analyses, we included these in the same cluster. We tested for the effect of our hypothesised moderators by conducting a multiparameter Wald test on provider, setting or content coefficients as appropriate. We additionally examined the residual heterogeneity, measured as I2, between the time-adjusted model and the models including each of the three sets of covariates. We regarded a p<0.05 as statistically significant and a p<0.10 as marginal, but not significant.

Sensitivity check

In addition to sensitivity analysis on the correlation used for repeated measures conversion, we estimated a set of metaregressions for each subset of outcomes including one effect size per relevant comparison for each of first and last follow-up in the included trials. We did this by combining intervention and control groups where appropriate, and by selecting effect sizes within studies that used shorter time periods for measurement and timeline follow-back procedures over general frequency/quantity questionnaires. We also treated non-overlapping subgroups from the same study as separate data points as suggested by Borenstein et al.34 Sensitivity analyses were estimated in Stata V.13.1 (Stata Corp 2013) and R (R Core Team. A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2016). We did not undertake meta-analysis of effect sizes from common time points because these models would have been poorly powered.

Results

We identified a total of 4551 records from the search of electronic databases and 41 records from key experts. A total of 52 studies met our inclusion criteria, with three studies presenting different outcomes for the same data and therefore considered as one.35–37 One study was dropped as it only contained biological outcomes which were not included in the main analyses.38 The review and selection process is summarised in figure 2.

Figure 2

Flow chart of systematic review and study selection. ABI, brief interventions for alcohol; RCT, randomised controlled trial.

Included studies contributed data for 29 891 individuals. Table 1 presents a summary of study characteristics (country, age, sex and sample size) as well as type of intervention (setting, provider and content), key outcomes and time of assessment. Most studies originated from Europe or North America with the exception of three studies from Australia, Taiwan and Thailand.72 ,76 ,77 Almost half (45%) of the studies were conducted in the USA and 22% in the UK.

Table 1

Characteristics of included studies

In total, 68% of trials were delivered in primary or healthcare settings (hospital or A&E). Only six studies were conducted in community settings defined as: military;55 ,61 ,62 research sites recruiting a sample through a household survey;64 and women at risk of alcohol-exposed pregnancy (defined as aged 18–44 years, with ineffective or no use of contraceptives, sexually active in the past 6 months, but not currently pregnant or planning a pregnancy) recruited via the media, in a prison, community health centre and a gynaecology centre;67 and one criminal justice setting.87 The most common providers included counsellors, who were the sole providers of interventions in 43% of trials, and physicians who accounted for 24% of trials. A minority category of different providers (8%) included a combination of psychologists, social workers or research nurses. Intervention categories were well distributed, though a majority of trials (47%) included motivational interviewing alone and 39% included MI ‘plus’. A total of 50 trials reported 275 eligible effect sizes on outcomes measuring quantity of alcohol consumed with a mean follow-up of 9 months. This is summarised in table 2.

Table 2

Summary of study characteristics

The majority (71%) of studies were categorised as low risk of bias in relation to randomisation and allocation concealment strategies. In the majority of studies, the process used to assess blinding of participants and providers as well as outcome assessment was unclear. Intention-to-treat analysis was conducted in 47% of studies and loss to follow-up assessed in the majority (80%) of studies. This is summarised in table 3 and risk of bias assessment for all trials is included in the online web appendix table 1.

Table 3

Summary risk of bias assessment

Metaregression on combined quantity and frequency outcomes

Interventions produced a beneficial effect at reducing the quantity of alcohol consumed by 0.15 SDs—a small but statistically significant effect (see table 4). This effect persisted after controlling for time to follow-up and when examining the subset of outcomes. In unconditional models and models controlling for time of follow-up, study-level heterogeneity as measured by I2 (ie, the percentage of variation between effect sizes due to heterogeneity rather than chance) was in the small-to-moderate range (0–40%) as defined by the Cochrane Handbook.30 Findings were robust to sensitivity analysis on the pre-post correlation in change score models. The mean time-adjusted effect of brief alcohol interventions on frequency of alcohol consumption outcomes was similar in magnitude (d=−0.15, 95% CI (−0.20 to −0.11)), but lower in heterogeneity (I2=23%), compared with the effect on the quantity of alcohol consumption (table 5). The time-adjusted effect remained statistically significant when limited to the subset of outcomes (frequency of drinking occasions d=−0.12, 95% CI (−0.19 to −0.06) and frequency of binge drinking d=−0.17, 95% CI (−0.23 to −0.11)).

Table 4

Results of multilevel metaregression for quantity outcomes

Table 5

Results of multilevel metaregression for frequency outcomes

Setting

For all quantity outcomes the setting of intervention did not appear to fully explain heterogeneity between studies, with residual heterogeneity at 34% and a statistically marginal but non-significant joint test of moderators (p=0.09). Interventions conducted in university settings (d=−0.20, 95% CI (−0.39 to −0.09)) and in primary or ambulatory care (−0.20 to (−0.27 to −0.13)) appeared to be most effective, with a small but statistically significant effect of the intervention. Interventions delivered in community settings (military, criminal justice, research sites and targeted recruitment) did not appear to be effective (−0.03 (−0.16 to 0.10); table 4).

For all frequency outcomes, the setting of intervention did not explain heterogeneity (residual I2=25%, Wald p=0.54). Of subgroups with statistically significant pooled effect sizes, interventions delivered in university contexts appeared to be most effective for frequency outcomes (−0.21, (−0.33 to −0.08)). Analysis was hampered by the small numbers of studies in several categories (table 5).

When limiting the analysis to the subset of either quantity or frequency outcomes the setting of intervention did not explain heterogeneity (all joint tests of moderators p>0.10).

Provider

In the model including all quantity outcomes, the provider of intervention did not meaningfully explain heterogeneity, based on I2 for this model (34%). Interventions delivered at least in part by nurses appeared to have the largest effect by magnitude (d=−0.23, 95% CI (−0.33 to −0.13)), though this difference was not supported by a significant joint test of moderators (Wald p=0.09).

Analyses with more specific sets of outcomes revealed a similar picture. Examination of effects at the first time point for the amount of alcohol per unit time showed that interventions delivered at least in part by the nurses (d=−0.30, 95% CI (−0.47 to −0.12)) were the most effective, with a significant joint test of moderators (Wald p=0.048; see online web appendix table 2). Interventions delivered by a range of different providers were least effective and did not yield a statistically significant effect. However, few studies were included in this category of providers. The provider of intervention explained some heterogeneity when the analysis was limited to the amount of alcohol per unit time (residual I2=32%, Wald p=0.01) but not per drinking occasion.

For frequency outcomes, the provider of intervention did not explain heterogeneity either combined (Wald p=0.17) or for drinking occasion per unit time (Wald p=0.73) but the effect was marginal, but non-significant, for bingeing occasions (Wald p=0.07).

Content

For quantity outcomes, the content of intervention did not explain a statistically significant amount of heterogeneity (residual I2=39%, Wald p=0.54), with little apparent reduction in I2. While all content groups had statistically significant mean effects, brief advice appeared to be most effective (d=−0.20, 95% CI (−0.30 to −0.09)) with the impact of motivational interviewing (d=−0.13) and MI plus (d=−0.16) also statistically significant.

For frequency outcomes, the content of intervention did not explain a significant amount of heterogeneity (residual I2=29%, Wald p=0.48). Effects by the content group for motivational interviewing were similar to those in the analysis of quantity outcomes, though brief advice did not have a statistically significant effect on the frequency of alcohol use (−0.08 (−0.26 to 0.09)).

Estimates of heterogeneity remained the same when limiting the analysis to the subset of either quantity or frequency outcomes.

Sensitivity check: metaregression on subset of outcomes by first and last time point

Overall effect estimates based on first and last time point were similar to the corresponding value reported in the main analysis, but estimates of heterogeneity (measured through I2) tend to be higher. Setting of intervention explained some heterogeneity for the alcohol per unit time outcome at the first time of marginal significance (residual I2=49%, Wald p=0.08). Findings also suggest that the provider explained some heterogeneity (residual I2=43%, Wald p=0.05) with nurses having the biggest effect (d=−30, 95% CI (−0.41 to −0.20)) and interventions delivered by different providers had the least effect (d=-0.07, 95% CI (−0.12 to −0.03)). The content of intervention explained some heterogeneity (residual I2=43%, Wald p=0.04), brief advice was the most effective (d=-0.25, 95% CI (−0.42 to −0.07)) and motivational interviewing was least effective (d=-0.09, 95% CI (−0.15 to −0.04); figures 35). With the exception of content, evidence of heterogeneity did not remain significant at the last time point. There was no evidence of heterogeneity for alcohol consumed per drinking occasion or for either subset of frequency outcomes. All findings are summarised in the online web appendix tables 2–5.

Figure 3

Metaregression analysis on alcohol consumed per unit time at first follow-up by setting of intervention. A&E, accident and emergency.

Figure 4

Metaregression analysis on alcohol consumed per unit time at first follow-up by provider of intervention.

Figures 5

Metaregression analysis on alcohol consumed per unit time at first follow-up by content of intervention.

Discussion

Our findings provide important new evidence on how the effectiveness of brief alcohol interventions differs by setting, provider and content, informing us of optimum modality. Our findings show that the provider of intervention may matter. We observed some reductions in heterogeneity in the multilevel analysis of amount of alcohol consumed per unit time, and interventions delivered by nurses having the most effect in reducing the quantity of alcohol consumed, but not the frequency of consumption. This finding builds on other evidence showing a modest effect of brief interventions delivered by non-physicians (nurses and healthcare workers) in primary care settings.24 We found that neither setting nor the content appeared to significantly moderate intervention effectiveness: we found little evidence on the effectiveness of brief interventions in community settings or A&E ; brief advice was the most effective content in reducing the quantity of alcohol consumed but not the frequency of drinking and there seemed to be little difference in the effect of MI or MI plus on either the quantity or frequency outcomes.

While the setting did not explain heterogeneity, findings show that university and ambulatory/primary care settings were the most effective in terms of magnitude of effect size, which is supported by previous reviews in this field.14 ,15 ,17 Prior research has suggested that while ABIs delivered in A&E settings may be effective in reducing alcohol consumption among hazardous and harmful drinkers,19 it may not provide the most appropriate context for discussion on alcohol use.88 The brevity of visits, lack of privacy for the delivery of the intervention and severity of injury may hinder the interaction between the patient and the practitioner reducing effectiveness.88–91 Other evidence shows that discussion of drinking behaviours is facilitated by a good relationship between the practitioner and the client.73 Our finding of increased reduction in alcohol consumption when the intervention is delivered by a nurse is important. The majority of previous research has focused on physician-led interventions, but there is growing evidence to support the effectiveness of nurse-led interventions in primary care and other settings.24 ,92 ,93 As the largest group of healthcare workers with repeated patient contact and with a health promotion remit as part of their role, they are well placed to deliver ABIs.92 ,94 Barriers to nurses delivering the interventions include lack of time, worry about losing trust of the patient and inadequate training.95 ,96 Resources and training should be provided to support nurses to undertake this role and embed it within services. The provision of ABIs under the category of different providers was not associated with a reduction in the consumption in alcohol. This may be related to problems with training of different providers, but the category was small and included a diverse range of providers, making the finding difficult to interpret. Similarly only a moderate effect was associated with counsellors, but again this definition encompasses a diverse group of practitioners ranging from clinical psychology students75 to alcohol workers with specialist training in alcohol counselling.56

While our categories of intervention content did not meaningfully or statistically explain heterogeneity in either quantity or frequency outcomes in the multilevel analysis, they did in the stratified analysis for first and last assessment time points. Effect sizes for quantity outcomes for all three classes of content were statistically significant, with brief advice yielding the largest effect. This provides important empirical evidence that brief advice can reduce alcohol intake, where evidence was lacking, and corroborates previous research that demonstrated no difference in effect between brief advice and longer motivational interviewing in reducing the harmful levels of drinking in A&E, primary care and criminal justice settings.12 ,56 ,97 ,98

Strengths and limitations

A key strength of this review is the use of a multilevel meta-analysis method to integrate all the relevant effect sizes from the included studies. This circumvented problems in other systematic reviews around the selection of specific effect sizes for meta-analysis. However, we were unable to explicitly model correlation between outcomes within studies, though simulation evidence suggests that this may not have a large impact on the estimation of intervention effects.99 We used Cohen's d to standardise outcomes. While this is common across many systematic reviews addressing continuous outcomes, it is uncommon for systematic reviews of alcohol outcomes, where standardisation is often in terms of standard drinks or grams of ethanol consumed. This may somewhat limit comparability between reviews, but it was a critical step in employing the multilevel meta-analysis model we used. As a second sensitivity analysis, we compared the findings from the multilevel model with a stratified analysis focusing on a subset of outcome variables. Findings from the two analyses were comparable. The stratified analysis of quantity of alcohol consumed per unit time suggested stronger effects of setting, provider and content of intervention at the first time point of assessment than indicated in the multilevel models but with comparable effect estimates within each category. Tests for publication bias do not yet exist for multilevel meta-analyses. While our tests using all available effect sizes did not reveal significant publication bias on either the quantity or frequency outcomes, it is unlikely that this is the best way to test publication bias in the context of dependent effect sizes. While we used the broadest categories appropriate for setting and provider of interventions, the number of studies included in the meta-analysis examining frequency outcomes meant that metaregressions were likely underpowered. We did not examine the effect of sex, ethnicity or age as a covariate since the sample size would have been too small to conduct a multivariate metaregression analysis. As the number of trials grows, this meta-analysis should be repeated in order to better estimate the differences between categories and examine the effect of other factors.

These findings should also be viewed in the context of study-level heterogeneity. In our multilevel meta-analyses, heterogeneity was surprisingly low considering the diversity of settings, providers and modalities included in this body of evidence. One possible reason for this is that because we included all relevant outcomes, we avoided some of the ‘random errors’ that may arise when only selecting one outcome per study. That is, including more information from each study will provide an estimate of statistical heterogeneity that more meaningfully accounts for study-level differences. This is not to say that it was inappropriate to explore this heterogeneity through structured and prehypothesised subgroup analyses, as was done here. Rather, the magnitude of difference in effects between studies may not be as pronounced as would be expected in a systematic review with such diverse interventions. While there was a low risk of bias in relation to some aspects of the study design (randomisation, loss to follow-up), there was a high percentage of unclear risk for many criteria, limiting our ability to fully assess the risk of bias. Because of the substantial number of categories for many of our metaregressions, we were unable to conduct a sensitivity analysis on risk of bias as that would have resulted in underpowered models.

Further research is needed to examine the effectiveness of ABIs in community settings. Our review suggested limited effect but relied on a small number of studies across a wide variety of settings. Our review excluded the use of computer-based interventions, which may be an important approach to reaching populations who do not consider themselves at risk. Some evidence shows that computer-delivered interventions with personalised feedback can effectively reduce alcohol consumption at short-term and long-term follow-up; however, the evidence is weaker when comparing direct feedback between face-to-face and computerised feedback.85 Our findings clearly show the importance of provider in effective delivery of ABIs and it will be important for future research to measure effectiveness of computerised feedback against different providers. Subsequent trials should also comprehensively describe intervention components to enable finer-grained analysis of the relationship between specific aspects of intervention modalities and their effectiveness.

Findings of this review contribute significantly to the understanding of the key processes involved in the delivery of effective ABIs, and have important policy implications for the design of preventative alcohol strategies both in the UK and internationally. The review provides important new evidence on the effectiveness of brief advice in reducing quantity of alcohol consumed and the role that nurses play in moderating the effectiveness of interventions. Resources should be prioritised to provide further support and training for nurses to deliver ABIs, as well as to undertake research to understand why nurse-led interventions are more effective so that appropriate training can be provided to other practitioners.

Acknowledgments

The authors would like to acknowledge Antonio Gasparinni and Colin Muirhead who provided statistical advice on the multilevel meta-analysis and sensitivity check applied in the review.

References

View Abstract

Footnotes

  • Twitter Follow Dorothy Newbury-Birch at @dotbirch

  • Contributors LP and CA developed the study protocol with advice from EK. LP conducted the search with assistance from DN-B. LP and DN-B checked the eligibility criteria of all manuscripts with help from AO. AO and JB conducted the data extraction and validation of extraction. GJM-T developed the statistical approach and conducted all statistical analyses in collaboration with LP. All authors commented on the manuscript.

  • Funding The study was funded by Camden and Islington Public Health, who commented on the study protocol, analysis and interpretation of findings.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.