Article Text

Download PDFPDF

Integration of academic and health education for the prevention of physical aggression and violence in young people: systematic review, narrative synthesis and intervention components analysis
  1. G.J. Melendez-Torres1,
  2. Tara Tancred2,
  3. Adam Fletcher3,
  4. Rona Campbell4,
  5. James Thomas5,
  6. Christopher Bonell2
  1. 1 DECIPHer, School of Social Sciences, Cardiff University, Cardiff, UK
  2. 2 Department of Social and Environmental Health Research, London School of Hygiene and Tropical Medicine, London, UK
  3. 3 Cardiff University, Cardiff, UK
  4. 4 DECIPHer, Bristol Medical School, University of Bristol, Bristol, UK
  5. 5 EPPI-Centre, UCL Institute of Education, University College London, London, UK
  1. Correspondence to Dr G.J. Melendez-Torres; melendez-torresg{at}cardiff.ac.uk

Abstract

Objectives To systematically review evidence on the effectiveness of interventions including integration of academic and health education for reducing physical aggression and violence, and describe the content of these interventions.

Data sources Between November and December 2015, we searched 19 databases and 32 websites and consulted key experts in the field. We updated our search in February 2018.

Eligibility criteria We included randomised trials of school-based interventions integrating academic and health education in students aged 4–18 and not targeted at health-related subpopulations (eg, learning or developmental difficulties). We included evaluations reporting a measure of interpersonal violence or aggression.

Data extraction and analysis Data were extracted independently in duplicate, interventions were analysed to understand similarities and differences and outcomes were narratively synthesised by key stage (KS).

Results We included 13 evaluations of 10 interventions reported in 20 papers. Interventions included either full or partial integration, incorporated a variety of domains beyond the classroom, and used literature, local development or linking of study skills and health promoting skills. Evidence was concentrated in KS2, with few evaluations in KS3 or KS4, and evaluations had few consistent effects; evaluations in KS3 and KS4 did not suggest effectiveness.

Discussion Integration of academic and health education may be a promising approach, but more evidence is needed. Future research should consider the ‘lifecourse’ aspects of these interventions; that is, do they have a longitudinal effect? Evaluations did not shed light on the value of different approaches to integration.

  • systematic review
  • violence
  • community child health

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • We used an exhaustive search including 19 databases and 32 websites.

  • We used an innovative method to describe key components in this class of interventions.

  • However, it was challenging to identify studies for inclusion.

  • Meta-analysis was not possible because of the diversity of outcomes and raters.

Introduction 

Violence among young people is a public health priority due to its prevalence and harm to young people and the wider society.1 2 One UK study found that 10% of young people aged 11–12 reported carrying a weapon and 8% admitted attacking someone with intent to hurt them seriously.3 By age 15–16, 24% of students reported they have carried a weapon and 19% reported attacking someone with the intention to hurt them seriously.3 Early aggression and antisocial behaviour are strongly linked to adult violent behaviour.4 5

School-based health education can be effective in reducing violence.6–8 However, school-based health education is increasingly marginal in many high-income countries, partly because of schools increasing focus on attainment-based performance metrics. In England specifically, health education is not a statutory subject,9–11 and school inspectors have a limited focus on how schools promote student health.12

One way to avoid such marginalisation is to integrate health education into academic lessons. For example, health-related content can be seamlessly integrated into existing academic lessons or discrete additional health education lessons can also include academic learning elements. This strategy may bring other benefits because: larger ‘doses’ may be delivered; students may be less resistant to health messages weaved into other subjects; and lessons in different subjects may reinforce each other.13 14 Conversely, those teaching academic subjects may be uninterested or unqualified to teach health topics. Though theories of change in this class of interventions are diffuse, one important way in which they could be effective is by promoting developmental cascades involving the interplay of cognitive and non-cognitive skills.15 16 Interventions integrating academic and health education could address violence by developing: social and emotional skills such as self-awareness, self-regulation, motivation, empathy and communication17; healthier social support or norms among students15 18 19; knowledge of the costs20 and consequences21 of substance use; media literacy skills to critique harmful media messages; and modifying students’ social norms about antisocial behaviours.13 20 22–24 Our work synthesising the theories of change underlying these interventions (Tancred et al, in press) identified that interventions aimed to integrate and thus erode boundaries between academic and health education, between students and teachers (so that relationships were improved and teachers might function more effectively as behavioural role models) and between classrooms and schools and schools and families (so that violence prevention messages communicated in classrooms might be reinforced by messaging in other settings).

Despite policy interest in these interventions, they have not previously been the subject of a specific systematic review. Previous systematic reviews have focused on socioemotional learning interventions or school-based interventions generally,6–8 without considering interventions that specifically integrate with academic lessons as defined above. Our focus on violence is informed by preliminary consultation, scoping work and logic model development suggesting that violence is an outcome especially amenable to these interventions. In the present review, we examined the characteristics of interventions that integrate academic and health education to prevent violence, and synthesised evidence for their effectiveness. That is, our research questions were: what are the overarching features relevant to integration of interventions that integrate academic and health education, and are these interventions effective at different key stages (KS) in reducing physical aggression and violence?

Methods

This review was part of a larger evidence synthesis project on theories of change, process evaluations and outcome evaluations of integration of academic and health education for substance use and violence. We registered the protocol for this review on PROSPERO (CRD42015026464, https://www.crd.york.ac.uk/prospero/), and it is enclosed as online supplementary file 1.

Supplementary file 2

Inclusion and exclusion

Studies were included regardless of publication date or language. We included randomised controlled trials of interventions integrating academic and health education, the former defined as specific academic subjects or general study skills. We defined education as ‘health education’ seeking to improve the health and well-being of students (including social and emotional learning and other forms of violence prevention). We included school-based interventions that seamlessly incorporated health education into existing academic lessons and interventions that provided discrete health education lessons with additional academic components. Interventions could be delivered by teachers or other school staff such as teaching assistants, but may also have been delivered by external providers, for example, from the health, voluntary or youth service sectors. We did not include interventions solely addressing social conduct in the classroom; relationships with peers or staff; attitudes to education, school or teachers; or aspirations and life goals. Our definition also excluded interventions which: were delivered in mainstream subject lessons but did not aim to integrate health and academic education; trained teachers in classroom management without student curriculum components; or were delivered exclusively outside of classrooms, as these did not seek to integrate academic and health education. Interventions focusing on targeted health-related subpopulations (eg, children with cognitive disabilities) were excluded as we were interested in universal interventions.

For this review, we focus on violence outcomes, defined as the perpetration or victimisation of physical violence including convictions for violent crime. While we preferred direct measures of physically violent and physically aggressive behaviours, we included outcomes that were a composite of physical and non-physical (eg, verbal or emotional) interpersonal violence, but excluded composite measures that also included items not focused on interpersonal violence, such as damage to property.

Search strategy

In our original search, undertaken between November and December 2015, we searched 19 databases and 32 websites, and contacted subject experts (see online supplementary file 2 for full details). We subsequently updated our search in February 2018 using PsycINFO and CENTRAL, as all of our original study hits were recovered from these databases.

Supplementary file 1

Study selection

Pairs of researchers double-screened titles and abstracts in sets of 50 references until 90% agreement was reached, with disagreements discussed at every stage. Subsequently, single reviewers screened each reference. We located the full texts of remaining references and undertook similar pairwise calibration with disagreements discussed, followed by single screening. Reports were translated into English where necessary. Using an existing tool,25 we extracted data independently in duplicate from included studies and assessed trials for risk of bias using a modified version of the Cochrane assessment tool.26 Authors were contacted where study data were missing.

Synthesis methods

We undertook an intervention components analysis.27 This was undertaken inductively by one researcher and audited by two other researchers, and used intervention descriptions to draw out similarities and differences in intervention design using an iterative method. Intervention descriptions were read and reread and then coded manually. The goal of this analysis was to use a set of descriptors to characterise aspects of the integration of academic and health education in the intervention. Intervention descriptions were rarely detailed enough to permit ‘deep’ engagement with the specific content of the interventions provided in included evaluations. The intervention components analysis identified overarching domains that accounted for similarities and differences between interventions in their integration of academic and health education, and developed within each domain a set of overlapping categories that described these similarities and differences. Finally, we synthesised outcomes narratively due to the heterogeneity in included outcome measurement. We categorised the timing of intervention effect by period of schooling, defined in terms of English schools’ KS system. KS1 includes school years 1–2 (age 5–7 years), KS2 includes years 3–6 (age 7–11 years), KS3 includes years 7–9 (age 11–14 years), KS4 includes years 10–11 (age 14–16 years) and KS5 includes years 12–13 (age 16–18 years).

We could not formally assess publication bias because heterogeneity in outcome measurement precluded meta-analysis.

Patient and public involvement

Because this review focused on public health interventions that were generally preventive in nature, patients were not involved per se. However, stakeholders were extensively consulted in the development of research questions and in assessing the implications of the findings. In addition, findings were disseminated via stakeholder events, and a series of one-to-one consultations took place to ensure the relevance and salience of study findings.

Results

In our original search, we found and screened 76 979 references, of which we retained 702 for full-text screening and were able to assess 690. Of 62 relevant reports included in the overall project, 10 evaluations of eight interventions were reported in 14 papers that considered violence and are reported in this review. Our update search yielded 2355 references, of which we retained 41 for full-text screening and included six papers reporting three evaluations (figure 1). This yielded a total of 13 evaluations reported in 20 papers.

Figure 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart. 

Included studies and their quality

All trials randomised schools except the Bullying Literature Project, which randomised classrooms (table 1). All evaluations were conducted in the USA, except for Gatehouse,28 which was an Australian study, and Learning to Read in a Healing Classroom,29 30 which took place in the Democratic Republic of the Congo. All control arms consisted of education-as-usual or waitlist controls, though Second Step31–33 offered a brief antibullying intervention with low take-up.

Table 1

Characteristics of included studies

Interventions were diverse and are summarised below in the intervention components analysis. Only two interventions (Bullying Literature Project,34 Youth Matters35) were wholly delivered by external staff. Several (Gatehouse,28 Positive Action,36 Steps to Respect37) linked classroom-based delivery to school-level work to support and reinforce implementation. Promoting Alternative Thinking Strategies (PATHS)38 and Reading, Writing, Respect and Reconciliation (4Rs)19 also emphasised teachers’ professional development.

Evaluation quality varied (table 2). Appraisal was hampered by poor reporting of some aspects of trial methods. Only four studies reported evidence of low risk of bias for random generation of allocation sequence; the remainder were unclear. Only one study reported information on concealed allocation. In Linking the Interests of Families and Teachers (LIFT),39 outcome assessors were blinded, resulting in low risk of bias in this domain, but all other interventions were of unclear risk of bias. All interventions included reasonably complete outcome data, and in only one evaluation did unit of analysis issues pose a risk of bias. In some studies such as Steps to Respect, follow-up was shorter than intervention length. Evaluations also differed in size, ranging from 7 classrooms to 63 schools.

Table 2

Appraisal of included studies

Intervention components analysis

This identified four themes describing included interventions: approach to integration, position of integration, degree of integration and point of integration. Included interventions are described in table 1, and the components analysis is summarised in table 3.

Table 3

Key themes in the intervention components analysis

Approach to integration

Interventions approached the rationale for and strategy of integration in different and overlapping ways. These overlapped across interventions, but were not mutually exclusive, and described the types of academic foci that interventions used to integrate academic and health education. Several (4Rs, Bullying Literature Project, Steps to Respect, Youth Matters) focused on literature as a focus for integration, using children’s books as a prompt for social–emotional learning. These interventions targeted language arts or literacy lessons as an opportunity to provoke discussion, role play and model positive strategies to avoid violence. Gatehouse explicitly used a ‘critical literacy’ approach to inspire reflection on programme lessons in English classes. Another approach to integration emphasised local development, where interventions supported teachers to link health education across academic subjects in each school in a ‘local’ fashion. For example, in PATHS, teachers received suggestions on how to integrate programme learning across English, history and social studies lessons, while in Second Step, this was an encouraged aspect of classroom delivery. In both cases, teachers received guidance and support to integrate health education messages into academic education, but were given substantial latitude to determine how and when to do this in the school day. A third approach was linking to developmental concerns, emphasising not so much the comprehensive integration of academic and health education but rather the inter-relationships between academic success and broader development, health and well-being. These interventions viewed academic education through a ‘health’ lens, in addition to viewing health education through an ‘academic’ lens. From a conceptual perspective, this meant that the inter-relationships between academic achievement, and student health and well-being were emphasised in theories of change. From a practical perspective, this meant that interventions paired activities such as study skills lessons with social–emotional learning (eg, in PATHS). For example, the theory of change underlying Gatehouse related to the creation of healthy social milieus in schools that would also support academic attainment; practically, this manifested as enhancement of academic lessons to improve interpersonal skills and emotional regulation. Similarly, Positive Action tied together individual student attainment with student health and well-being in their theory of change, with lessons focused on problem-solving and goal setting, among other topics.

Domains of integration

Some interventions (4Rs, Bullying Literature Project and Youth Matters) were exclusively classroom-focused while others (Gatehouse, Steps to Respect) used classroom and whole-school strategies to reinforce and extend learning. For example, Gatehouse involved school implementation support teams, while Steps to Respect deployed a school-wide ‘policy team’ to revise and develop antibullying policies. Other interventions, (PATHS, Positive Action) used classroom, whole-school environment and external domain (parent information) strategies consistent with the health-promoting schools approach promulgated particularly by the WHO, which in the USA is known as the Comprehensive School Health Programme model.40

Degree of integration

In some interventions, health education was fully integrated (woven seamlessly) into everyday academic lessons (Gatehouse, 4Rs, Youth Matters), while in partially integrated interventions, health education involved distinct lessons, although also covering academic learning (Positive Action).

Timing of integration

Most interventions were multiyear, though two involved only 1 school year (LIFT, Bullying Literature Project).

Intervention effects

Perpetration measures included bullying (physical or physical/verbal), aggression against peers and others and violent behaviours including injuring others. Measures involved different raters, including students, teachers and observers. Victimisation measures ranged from physical violence specifically to interpersonal aggression more generally. Heterogeneity of definition, measurement and form of effect sizes precluded meta-analysis. No included studies described effects for KS1 or KS5. Measures and corresponding effect estimates are included in table 4.

Table 4

Measures used in included studies and effect estimates

Violence perpetration: KS2

Across the 10 evaluations reporting outcomes in this KS, effects were inconsistent, including within studies by rater.

In LIFT,39 effects at the end of the first intervention year on observed physical aggression in the playground were similar for students with different levels of baseline aggression (d=−0.14 at mean, 1 SD and 2 SD above the preintervention mean); these findings being described as ‘statistically significant’. However, after the first intervention year of 4Rs,19 there were no effects on teacher-reported aggression (regression-estimated b=0.02, SE=0.05, based on a 1–4 scale). After the second intervention year,15 there were effects on teacher-reported student aggression (d=−0.21, p<0.05). The Bullying Literature Project also reported no effects on physical aggression rated by teachers for individual students (IG [intervention group]: M=1.12, SD=0.47, n=95 vs CG [control group]: 1.19, SD=0.47, n=55; p=0.67) or student self-reports (M=1.20, SD=0.44, n=90 vs M=1.14, SD=0.36, n=42; p=0.84) at 1 week postintervention.34 This finding was the same in the Bullying Literature Project—Moral Disengagement version (F(1, 80)=0.83, p=0.431), though only combined student-reported physical and emotional bullying estimates were available.41

Findings for Steps to Respect differed by type of rater. At the end of the first intervention year, the first evaluation of Steps to Respect37 reported evidence of decreased bullying based on playground observation (F(91.3)=5.02, p<0.01) but not direct aggression based on student report (F(68.7)=2.05, p>0.05). The second evaluation of Steps to Respect42 revealed a similar pattern. While teacher reports of physical bullying perpetration were less in intervention schools than in control schools at the end of the first intervention year (OR=0.61, t(29)=−3.12, p<0.01), student reports suggested no difference between schools on bullying perpetration (t(29)=−1.06). Moreover, in PATHS,38 small positive effects of the intervention on student-reported aggression at the end of the first intervention year (d=−0.048, 95% CI −0.189 to 0.092) and at the start (d =−0.064, 95% CI −0.205 to 0.076) and end (d =−0.048, 95% CI −0.188 to 0.093) of the second intervention year gave way to a small deleterious intervention effect at the end of the third year (d=0.082, 95% CI −0.060 to 0.224). Opposite effects were found on teacher-reported aggression, with initially small, negative intervention effects at the end of the first (d=0.036, 95% CI −0.105 to 0.178) and start of the second intervention year (d=0.035, 95% CI −0.107 to 0.178) but progressively greater effects at the end of the second (d=−0.005, 95% CI −0.146 to 0.136) and the third (d=−0.199, 95% CI −0.338 to –0.060) intervention years.

In contrast, two evaluations showed consistently positive results across different measures. In Positive Action Chicago,36 students reported lower counts of bullying behaviours (incidence rate ratio (IRR)=0.59, 95% CI 0.37 to 0.92) and of serious violence-related behaviours, including cutting or stabbing someone on purpose (IRR=0.63, 95% CI 0.45, 0.88). Findings from Positive Action Hawaii43 were similar for student-reported violent behaviours (IRR=0.42, 90% CI 0.24 to 0.73) and teacher-reported violent behaviours (IRR=0.54, 90% CI 0.30, 0.77). For students in the fourth or fifth intervention year, intervention recipients were less likely to report cutting or stabbing someone (OR=0.29, 90% CI 0.16 to 0.52) or shooting someone (OR=0.24, 90% CI 0.14, 0.40). Teachers were less likely to report that students hurt others (OR=0.61, 90% CI 0.38, 0.97) or got into lots of fights (OR=0.63, 90% CI 0.47, 0.84).

However, in Youth Matters,35 students in intervention schools were not less likely to report bullying perpetration (OR=0.85, 95% CI 0.29 to 1.47, p=0.585) after the second intervention year. Evaluators explored use of latent class analyses to classify intervention recipients as victims, bullies or bully–victims. Proportions of intervention and control recipients classified as bullies or bully–victims were not significantly different by study arm at the end of the first (IG: 21%, n=356 vs CG: 22%, n=392) or second (19%, n=244 vs 23%, n=293) intervention years.44

Violence perpetration: KS3

The three evaluations examining violence perpetration outcomes in KS3 had dissimilar results. At the end of the sixth intervention year of Positive Action Chicago,45 students receiving the intervention reported lower counts of violence-related behaviours than no treatment controls (IRR=0.38, 95% CI 0.18 to 0.81; equivalent to d=−0.54). Students also reported fewer bullying behaviours (d=−0.39), and parents reported that their children engaged in fewer bullying behaviours (d=−0.31). Significance values for these estimates were not presented, but both were supported by significant condition by time interactions in multilevel models, indicating that the intervention group showed an improved trajectory over time as compared with the control group. In contrast, after the third year from baseline in Youth Matters,44 proportions of students were not different in the collective bully and bully–victim groups (both groups 16%; IG n=283, CG n=289). Findings for Second Step were reported at the end of the first, second and third years of intervention. At the end of the first school year, students in intervention schools had decreased odds of physical aggression (OR=0.70, p<0.05) but not sexual harassment and sexual violence perpetration (OR=1.04, p>0.05).33 These findings did not hold to the end of the second school year for physical aggression (OR=0.80, 95% CI 0.59 to 1.08), but sexual harassment and sexual violence perpetration was significantly reduced in intervention schools in Illinois (OR=0.72, 95% CI 0.54, 0.95) but not Kansas (OR=0.99, 95% CI 0.71, 1.48).32 At the end of the third school year, there were no direct effects of Second Step on sexual harassment perpetration (β=0.005, SE=0.012); findings for physical aggression were not available.31

Violence victimisation: KS2

While the seven evaluations reporting outcomes in this KS were similar in follow-up period, they did not point to a clear effect. Students receiving the ‘original’ Bullying Literature Project were not different from their peers in physical victimisation by teacher report on individual students (IG: M=1.04, SD=0.23, n=95 vs CG: 1.04, SD=0.21, n=55; P=0.39) or student self-report (M=1.35, SD=0.54, n=90 vs M=1.43, SD=0.66, n=42; P=0.57) 1 week postintervention.34 However, students receiving the Bullying Literature Project—Moral Disengagement version did report decrease in victimisation (both physical and emotional combined) after the intervention (IG: M=1.76, SD=0.81 to M=1.60, SD=0.66, n=42 vs CG: M=1.23, SD=0.38 to M=1.38, SD=0.53, n=42), with a significant time-by-treatment interaction in an analysis of variance (F(1, 80)=7.42, P=0.047).41 PATHS measured student-reported victimisation using standardised mean differences, and found small, non-significant increases relative to the control arm at: the end of the first intervention year (d=0.044, 95% CI −0.098 to 0.185); the start (d=0.074, 95% CI −0.067, 0.216) and end (d=0.092, 95% CI −0.050, 0.234) of the second year; and the end of the third year (d=0.089, 95% CI −0.053, 0.231) of intervention implementation.38 Steps to Respect, evaluated in two different trials, also found no differences in student-reported bullying victimisation at the end of the first intervention year in the first (IG: M=0.80, SD=1.51 vs CG: M=0.86, SD=1.44; F<1)37 or second trial (M=2.11, SD=1.03 vs M=2.18, SD=1.06; t(29)=-1.15).42 The first trial included playground observation at the end of the first intervention year, which was suggestive of lower levels in bullying victimisation, though these differences were marginally non-significant (M=0.9, SD=0.82 vs M=1.01, SD=0.83; F(72.4)=3.74, p<0.10).37 Learning to Read in a Healing Classroom examined relational and physical victimisation after 1 year of intervention implementation and found no significant effect of the intervention (weighted d=−0.01, SE=0.06).29 30 Finally, Youth Matters examined bullying victimisation through continuous and dichotomous measures. At the end of the second intervention year, the difference in log-transformed continuous scores suggested a decrease (difference=−0.171, SE=0.083, p=0.049), as did the difference in dichotomous scores (OR=0.61, p=0.098).35 However, a latent class analysis that sought to describe transitions into, and out of, bullying victimisation did not suggest a difference between groups at this point.44

Violence victimisation: KS3 and KS4

Intervention evaluations reporting violence victimisation outcomes in KS3 (Youth Matters,44 46 Second Step32 33 and Gatehouse28) and KS4 (Gatehouse28) suggested no evidence of effectiveness. In Youth Matters, differences in the log-transformed scores for bullying victimisation suggested a decrease in victimisation in intervention recipients as compared with controls, but this difference was not significant (regression-estimated difference=−0.123, SE=0.068, p=0.08).46 However, at the end of the third intervention year, fewer students in the intervention than control group were members of the victim or bully–victim classes (36%, n=283 vs 45%, n=289).44 Based on our own χ2 test, this difference was significant (p=0.029). In Second Step, neither peer victimisation (OR=1.01, p>0.5) nor sexual harassment and violence victimisation (OR=1.01, p>0.05) were different between students in intervention schools and control schools after the first intervention year.33 This remained the case at the end of the second intervention year (peer victimisation: OR=0.94, 95% CI 0.75, 1.18); sexual victimisation: OR=0.91, 95% CI 0.72, 1.15).32 Gatehouse,28 which was implemented from year 9, found no evidence of a change in bullying victimisation at the end of the first (OR=1.03, 95% CI 0.86, 1.26)), second (OR=1.03, 95% CI 0.78, 1.34) or third (OR=0.88, 95% CI 0.68, 1.13) intervention years, which corresponded to the first 2 years of KS4.

Discussion

While the integration of academic and health education remains a promising model for the delivery of school-based health education, randomised evaluations were variable in quality and did not consistently report evidence of effectiveness in reducing violence victimisation or perpetration. Evidence was concentrated in KS2, with few evaluations in KS3 or KS4. Moreover, evidence was stronger in quantity and in quality for violence perpetration as compared with victimisation. Unfortunately, evaluations that measured perpetration did not always also measure victimisation, preventing a meaningful comparison of consistency of effects.

Few interventions showed consistent signals of effectiveness. Though a formal moderator analysis was not possible, certain intervention models appear more effective than others. Specifically, evaluations of Positive Action in both Chicago45 and Hawaii43 showed consistently positive results across diverse measures. This may reflect the involvement of the intervention developer, a factor often associated with improved intervention fidelity (although Positive Action was not unique in this respect among interventions included in our review). It may also reflect that Positive Action included classroom, whole-school and (in the Hawaii trial) external domain strategies delivered over multiple school years. Though Gatehouse28 was similar to Positive Action in its focus on multiple systems, Gatehouse targeted adolescents, whereas Positive Action was delivered from KS2 and also included work with parents. Another possible explanation for our results is that effects for these interventions may take time to emerge. This is plausible given the developmental focus of many of these interventions, and evidence of links between early aggressive behaviour and later violence.4 5 For example, there was some evidence that effects on aggressive behaviour in 4Rs began to emerge after the second intervention year.19 While findings were somewhat contradictory across different outcomes for PATHS, there was some evidence that teachers of intervention students reported less aggression in later years of the intervention.38 Another key feature of Positive Action was the use of a model that linked academic and health education to developmental concerns. That is to say, this intervention focused on improvements in academic engagement and study skills both enhancing, and being enhanced by, student health and well-being; this was a feature of intervention activities and of the underlying theory of change. Moving forward, intervention strategies that combine multiple domains over several years and that use both subject-specific learning alongside linking to developmental concerns may be more effective than classroom-only interventions, single-year interventions or interventions that use literature alone; this should be a target for future research.

This systematic review has strengths and limitations. Identifying relevant studies was challenging often because of poor intervention description. We were unable to undertake meta-analysis or assessment of publication bias, though the preponderance of null results suggests that projects with non-significant findings are being published. Finally, the diversity of outcome measures and of raters precludes a complete and consistent picture of the effectiveness of these interventions via standardised measures. For example, measures that included physical violence and aggression were at times combined with verbal forms of interpersonal violence; while we preferred measures of physical violence and physical aggression, we included outcomes where these behaviours were included as part of a composite. Consistency and clarity in outcome reporting will be especially important as ‘core outcome sets’ become relevant in planning evaluations in public health and social science. Most studies focused on bullying, while evaluations of Positive Action43 45 generally provided the most direct test of violent behaviours specifically.

Future research should seek to understand better the life course aspects of these interventions: that is, how does early school-based intervention impact later-life violent behaviours? From a policy perspective, it is clear that the integration of academic and health education, while possibly an effective intervention, will need to be considered alongside interventions involving other systems to prevent violence. Future evaluations will also contribute by considering the effects of integration in a diversity of ways and mechanisms of action for integration in different types of academic education. For example, contrasts between full and partial integration, which included evaluations did not address, could inform an understanding of how much integration is necessary to support health education messages.

Acknowledgments

The authors acknowledge Ms Claire Stansfield for her assistance in designing and conducting the searches.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.

Footnotes

  • Contributors GJMT undertook study screening and selection, led the meta-analyses and drafted the initial manuscript. TT undertook study screening and selection, extracted data and contributed to drafting the initial manuscript. AF undertook study screening and selection. JT and RC provided methodological and substantive advice. CB undertook study screening and selection, extracted data and contributed to drafting the initial manuscript. All authors revised the manuscript and approved the final manuscript as submitted.

  • Funding This work was funded through National Institute for Health Research Public Health Research Programme grant 14/52/15. The work was undertaken with the support of The Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UKCRC Public Health Research Centre of Excellence. Joint funding (MR/KO232331/1) from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the Welsh Government and the Wellcome Trust, under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged.

  • Disclaimer The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

  • Competing interests None declared.

  • Patient consent Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement All data are publicly available.