Objectives To assess the reproducibility of an educational intervention EdAl-2 (Educació en Alimentació) programme in ‘Terres de l'Ebre’ (Spain), over 22 months, to improve lifestyles, including diet and physical activity (PA).
Design Reproduction of a cluster randomised controlled trial.
Setting Two semi-rural town-group primary-school clusters were randomly assigned to the intervention or control group.
Participants Pupils (n=690) of whom 320 constituted the intervention group (1 cluster) and 370 constituted the control group (1 cluster). Ethnicity was 78% Western European. The mean age (±SD) was 8.04±0.6 years (47.7% females) at baseline. Inclusion criteria for clusters were towns from the southern part of Catalonia having a minimum of 500 children aged 7–8 year; complete data for participants, including name, gender, date and place of birth, and written informed consent from parents or guardians.
Intervention The intervention focused on eight lifestyle topics covered in 12 activities (1 h/activity/session) implemented by health promoting agents in the primary school over three academic years.
Primary and secondary outcomes The primary outcome was obesity (OB) prevalence and the secondary outcomes were body mass index (BMI) collected every year and dietary habits and lifestyles collected by questionnaires filled in by parents at baseline and end-of-study.
Results At 22 months, the OB prevalence and BMI values were similar in intervention and control groups. Relative to children in control schools, the percentage of boys in the intervention group who performed ≥4 after-school PA h/week was 15% higher (p=0.027), whereas the percentage of girls in both groups remained similar. Also, 16.6% more boys in the intervention group watched ≤2 television (TV) h/day (p=0.009), compared to controls; and no changes were observed in girls in both groups.
Conclusions Our school-based intervention is feasible and reproducible by increasing after-school PA (to ≥4 h/week) in boys. Despite this improvement, there was no change in BMI and prevalence of OB.
Trial registration number: Clinical Trials NCT01362023.
- PUBLIC HEALTH
- PRIMARY CARE
- PREVENTIVE MEDICINE
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
Reproducibility of studies is rare because of the complexity of replicating an intervention programme. Studies in obesity prevention, such as EdAl (Educació en Alimentació), need to be reproducible, especially those improving a healthy lifestyle, including after-school physical activity, to reinforce beneficial practices in childhood.
Statistical methods controlling for confounders and taking into account clustering of data.
Failure to assess treatment adherence to evaluate reproducibility and feasibility.
Dietary habits were noted via a questionnaire that did not take into account the quantities of the different types of food items consumed.
Obesity (OB) has become a disease of epidemic proportions.1 However, this increasing tendency towards excess weight in childhood and adulthood2 observed in some countries (the UK, France, South Korea, the USA and Spain) has stabilised despite the absolute rates being a cause for concern.1 OB prevalence in children and adolescents is higher in southern regions of Europe.3 ,4
Accumulation of fat tissue constitutes an increased disease risk in childhood, as well as in adulthood.5 This disease risk has a multifactorial aetiology, such as an unhealthy diet and sedentary lifestyle.6 ,7
The Organization for Economic Co-operation and Development (OECD) has predicted an increase of 7% in excess weight prevalence in adulthood over the period spanning 2010 to 2020.8 The WHO proposes the prevention and control of OB prevalence as key in the updated ‘Action Plan 2008–2013’ in which effective health promotion is considered as the principal strategy.9
Since excess weight status in adulthood is almost invariably predicated on childhood and adolescent weight, OB prevention should start early in life.10 The optimum age to start an intervention is between the ages of 7 and 8 years because children are more receptive to guidance.11 The school is an ideal place for the promotion of healthy nutrition and lifestyle habits12 and, as some studies have shown, such interventions have inspired changes in nutritional habits and body mass index (BMI) status13 ,14; the message is received by all schoolchildren, irrespective of ethnic and socioeconomic differences.9 The effectiveness of an intervention is when educational strategies and environmental factors such as healthy nutrition and physical activity (PA) habits coincide since both aspects are essential in preventing childhood OB.15 Currently, European children spend more of their leisure time in sedentary activities such as watching television (TV), video games or on the internet. These activities represent a decrease in physical movement and lowering of energy expenditure and, as such, are risk factors for OB.16
We had designed the EdAl (Educació en Alimentació) programme as a randomised, controlled, parallel study applied in primary schools, and implemented by university students acting as Health Promoter Agents (HPAs).17 This intervention was deployed in Reus (as an intervention group) with the neighbouring towns of Salou, Cambrils and Vilaseca as a control group. The interventions focused on eight lifestyle topics covered in 12 activities (1 h/activity/session) in 7–8-year-old children, and implemented by HPAs over three school academic years. We found that the EdAl programme successfully reduced childhood OB prevalence in boys by 4.39% and increased the percentage of boys who practise ≥5 after-school PA h/week.18 The EdAl programme needed to be reproduced in other localities, and with other children, to demonstrate the effectiveness of this intervention.19
The outcomes of the EdAl programme supported the feasibility of improving PA in childhood. However, an educational intervention, such as our EdAl programme implemented by HPAs, also tests complex components such as healthy lifestyles including diet and PA recommendations. Owing to the complexity, such interventions are difficult to rationalise, standardise, reproduce and administer consistently to all participants.19
There has been one study in the literature that has reproduced its programmes in other locations. Described as the Kiel Obesity Prevention Study (KOPS), the results demonstrated the efficacy and feasibility of implementing new nutritional concepts.20 We tested the reproducibility of the EdAl programme in a geographical area (Terres de l'Ebre) about 80 km away from where the original EdAl programme was designed and implemented. We designed a cluster (town group) randomised controlled trial, the rationale being that since good communications exist between the schools of the same town, this could contribute to schools of the intervention group ‘contaminating’ those of the putative control group.
We describe the primary-school-based study to reduce the prevalence of childhood OB (The EdAl-2 study); the objective remains an intervention to induce healthy lifestyles, including diet and PA recommendations. The study was conducted in 7–8-year-old schoolchildren over three academic years (22 months active school time).
The original protocol, rationale, randomisation, techniques and results of the initial EdAl programme have been published in Trials.17 ,18 The current study (EdAl-2) was conducted in exactly the same way so as to assess whether comparable results could be achieved in a different location. The exact intervention is described in more detail in online supplementary file 1, and in this manuscript link. The EdAl-2 study was approved by the Clinical Research Ethical Committee of the Hospital Sant Joan of Reus, Universitat Rovira i Virgili (Catalan ethical committee registry ref 11-04-28/4proj8). This study was registered in Clinical Trials NCT01362023. The protocol conformed to the Helsinki Declaration and Good Clinical Practice guides of the International Conference of Harmonization (ICHGCP). The study followed the CONSORT criteria (see online supplementary additional file 2).
For logistics reasons, the EdAl-2 programme was reduced by 6 months, from 28 to 22 months.
To approximately ensure a minimum 500 inhabitants of 7–8 years of age per cluster, before randomising the towns (clusters), a statistician who was not familiar with the study objectives and the school identities matched the towns on population size. The coordinating centre (in Reus) developed a cluster randomisation scheme to have a study sample in which the schools in Amposta were designated as cluster A (intervention) and 9 towns around Amposta (Sant Jaume d'Enveja, Els Muntells, l'Ametlla de Mar, El Perelló, l'Ampolla, Deltebre, l'Aldea, Lligalló del Gànguil and Camarles) as cluster B (control). The eligibility criteria of clusters were to be semirural towns from the southern part of Catalonia with a minimum of 500 children of 7–8 years of age in each cluster.
The sociodemographic indicators in all towns were similar to that of the original EdAl programme in Reus. Children attending the schools in both groups (intervention and control) lived in proximity within each school's catchment area. Intervention institutions included five schools involving 18 classrooms and 457 pupils in Amposta. Control institutions consisted of 11 schools involving 23 classrooms and 531 pupils in the nine towns around Amposta. The children in this study are in the second and third grades of primary education (7–8-year-olds). Schoolchildren were enrolled in May 2011 (children born in 2002–2003) and followed up for three school academic years (2012–2013). The study was completed in March 2013.
To be representative of the child population, the schools selected needed to have at least 50% of the children in the classrooms volunteer to participate. We offered the programme to all schools, whether public (funded by the government and termed ‘charter’ schools) or private, which included fee-paying and/or faith schools. Inclusion criteria were: name, gender, date and place of birth, and written informed consent from the parent or guardian of each participant. A questionnaire on eating habits (Krece Plus) developed by Serra Majem et al,21 and PA, level of parental education and lifestyles developed by Llargues et al22 were filled in by the parents at baseline and at the end of the study.
The original EdAl Reus protocol was followed.17 ,18 The educational intervention activities focused on eight lifestyle topics based on scientific evidence23 to improve nutritional food item choices (and avoidance of some foods) and healthy habits such as teeth-brushing and hand-washing and overall adoption of activities that encourage PA (walking to school, playground games), and to avoid sedentary behaviour.23
Each of the eight topics described in figure 1 was integrated within educational intervention activities of 1 h/activity, prepared and standardised by the HPAs, and implemented in the children's classrooms. In the first school academic year, we focused on four topics: (1) to improve a healthy lifestyle; (2) to encourage healthy drinks intake (and avoidance of unhealthy carbonated/sweetened beverages); (3) to increase the consumption of vegetables and legumes and (4) to decrease the consumption of candies and pastries while increasing the intake of fresh fruits and nuts. These corresponded to four standardised activities (1 h/activity). In the second year, the remaining four of the eight selected lifestyle topics were addressed: (5) to improve healthy habits within a set timetable (home meals, teeth-brushing, hand-washing) and PA participation; (6) to increase fruit intake; (7) to improve dairy product consumption and (8) to increase fish consumption. These corresponded to four standardised activities. Finally, in the third school academic year, four standardised activities were introduced that reinforced the eight lifestyle topics implemented in the previous two academic years. Thus, the intervention programme was based on eight lifestyle topics incorporated within 12 activities which were disseminated over 12 sessions (1 h/activity/session), and prepared, standardised and implemented as four activities per school academic year by the HPAs in the school classrooms.
Assessment of the reproducibility of the EdAl programme was based on primary outcomes such as the prevalence of OB (overall as well as stratified by gender), according to the International Obesity Task Force (IOTF)24 recommendations for better international comparisons of data. Secondary outcomes included: changes in measures of adiposity (overall as well as stratified by gender) such as the BMI z-score (based on the WHO growth charts25 and waist circumference, incidence and remission of excess weight (overweight (OW) and OB), as well as changes in lifestyles (eating habits and PA h/week). All outcomes were analysed in the intervention and control groups. Weight, height and waist circumference values were obtained as described previously.17 Prevalence of underweight was analysed according to Cole et al26 using 17 kg/m2 as a cut-off point. The BMI z-score was calculated using the population values of the WHO Global InfoBase.25 To identify the risk factors of OB, the OB category was determined according to the WHO criteria since this is based on data from countries that have a low OB prevalence25 and, as such, provide an understanding of the protective (or risk factors) for OB in our own population. To obtain a measurement of overall improvement in lifestyle, we generated variables such as the maintenance of status in each category as well as the status in relation to changes in each category over the 22-month period.
We calculated that to have an 85% chance (at a two-tailed 5% significance level) of detecting a difference of five percentage points between the intervention and control groups (3–8%) with respect to OB prevalence at baseline of the EdAl study,18 354 participants would be required in each of the participation groups. Allowing for an attrition rate of up to 10%, we aimed for 393 participants in each group.
Analyses were conducted on student-level data. Descriptive variables were presented as means and CIs (95% CI). General linear mixed models (GLM) were used to analyse differences between the intervention and control pupils with respect to prevalence of OB. Repeated measures of GLM were used to analyse the trend of the BMI z-score between baseline and end-of-study values. The McNemar test was used to analyse change-over-time of food habits, after-school PA h/week and hours TV/day categories, in the intervention and control groups. The continuous variables studied in each group were compared using analysis of variance (ANOVA).
To evaluate the risk and protective factors involved in childhood OB, logistic regression analyses were performed at baseline, with no distinction between the intervention and control groups. The OR and 95% CI were calculated for dietary patterns and lifestyles, based on the Krece Plus Questionnaire21 and the AVall Questionnaire,22 respectively.
The main analyses were performed with the modified intention-to-treat (mITT) population, that is, participants with baseline and end-of-study data on weight, height and date of birth, and written informed consent. The analyses did not use any imputation missing method, the assumption being that missing data were random. Statistical significance was defined by a p<0.05. The statistical analyses were performed with SPSS V.20.0 for Windows (SPSS Inc, Chicago, Illinois, USA).
Figure 2 shows the recruitment and flow diagram of pupils in the intervention and control groups over the course of the study. The mITT population in the intervention and control groups was 320 and 370 pupils, respectively. At 22 months, the mean age was 9.67 (95% CI 9.60 to 9.73) in the intervention group (9.68 years in boys and 9.65 years in girls) and 9.86 (95% CI 9.79 to 9.91) in the control group (9.85 years in boys and 9.84 years in girls). The differences in age were not significant in relation to gender.
The characteristics of the study group are summarised in table 1. At baseline, the intervention and control groups were homogeneous in BMI status. The ethnicity of the population was predominantly Western European in the intervention and control groups (77.5% vs 78.9%, respectively) while 7.5% vs 10.8% was Eastern European; 10.3% vs 3.5% was Latin American; 3.4% vs 6.2% was North African Arab. At baseline, there was a significant difference in the distribution with respect to Latin American children (10.3% in the intervention group and 3.5% in the control group; p<0.001). The distribution was random. Of note, there were no significant differences in distributions of OB and/or OW. Also, no differences were observed in terms of response to the intervention in relation to ethnicity.
Figure 2 shows the recruitment and retention of pupils in intervention and control schools. Among the 916 pupils assessed at the beginning of the study, 690 (75.3%) pupils (73.6% of those allocated to the control group and 77.5% of those allocated to the intervention group) were reassessed three academic courses later, and valid measurements were obtained. The rate of parental consent was 95.7%. Dropouts in both groups are assumed to be missing at random.
Primary outcome: prevalence of OB
At 22 months of the study, OB prevalence assessed by IOTF criteria was similar in the intervention and control groups (p=0.628; table 2).
At 22 months of the study, the status of OW prevalence (according to IOTF criteria) was similar between groups (p=0.086).
There were no significant differences in the BMI z-score between the intervention and control groups (p=0.400; table 3). Despite no differences in the BMI z-score, the boys in the intervention group did not have an increase in percentage fat mass (19.96–20.02%: p=0.896), whereas girls in the intervention group (22.06–23.55%; p<0.001), together with boys (19.18–20.64%, p<0.001) and girls (23.26–24.98%) in the control group, had a significant increase.
The remission and incidence of OB were similar in the intervention and control groups, as well as when stratified with respect to gender.
After 22 months of the study, there were 19.7%, 11.2% and 8.2% more girls in the intervention group who consumed a second fruit per day, one vegetable per day and fast-food weekly than girls in the control group (p<0.001, p=0.017 and p=0.013, respectively). However, there were 17.9% and 17.8% more boys in the intervention group who consumed pastry at breakfast and more than one vegetable a day, compared to boys in the control group (p=0.002 and p=0.001, respectively). Conversely, there were 12.9% and 12.2% more girls in the control group who consumed legumes and cereal breakfast than girls in the intervention group (p=0.013 and p=0.032, respectively; table 4).
Table 5 summarises the time spent in after-school PA, watching TV, playing video games and other leisure-time activities. At 22 months, the percentage of boys in the intervention group who performed ≥4 h after-school PA/week was increased by 15% (p=0.027) while there were 16.6% more boys in the intervention group watching ≤2 h TV/day (p<0.009). The results indicate less sedentary behaviour in intervention than control individuals.
Differences between intervention and control pre–post intervention programme.
At 22 months, participants who were normal weight at baseline increased after-school PA to ≥4 h/week. This reflects a rise to 32.7% in boys (p=0.002). However, in girls, the changes were not statistically different (p=0.134). No statistically significant differences were observed in the control group.
Impact of certain additional factors on OB
The ORs of OB, using BMI z-score criteria, were related to some of the more relevant dietary habits and lifestyles. Thus, breakfast dairy product consumption (OR=0.336; p=0.004) and ≥4 after-school PAh/week (OR=0.600; p=0.032) were protective factors against OB. Conversely, doing <4 h/week PA (OR=1.811; p=0.018) increased the risk of childhood OB.
The EdAl-2 programme, a reproducibility study in Terres de l'Ebre, shows that intervention is useful for improving weekly after-school PA. However, the OB prevalence remained unchanged at 22 months, as has been shown in the data on stability of OB prevalence observed in some European countries.8 Despite the maintenance of OW and OB prevalence in both groups, fat mass percentage had increased in girls of the intervention and control group, whereas it remained similar in boys of intervention group.
As proposed by Kain et al, designing a new school-based intervention study needs to have some critical aspects considered. These include the following: the random allocation of schools, although methodologically desirable, is not always possible; participation of parents is very limited; OB is not recognised as a problem; and increasing PA and implementing training programmes for teachers is difficult due to an inflexible curriculum and lack of teachers’ time. Unless these barriers are overcome, OB prevention programmes will not produce positive and lasting outcomes.27 As such, our programme of HPA-implemented intervention activities in classrooms is an attractive alternative that circumvents lack-of-teacher-time.
The EdAl-2 programme confirmed that after-school PA (in terms of h/week) can be stimulated in primary school as part of a healthy lifestyle. As we had observed in the original EdAl programme18 at 28 months of intervention, there was an increase of up to 19.7% of children dedicating >5 h/week to extra-curricular physical activities.18 Further, the after-school PA was maintained despite cessation of the intervention programme.28 The effect of the EdAl programme during its implementation and after the official cessation indicated an impact on PA, whereas modification towards healthy food choices occurred according to the site of the programme's implementation, and was not consistent.
Interventions to prevent OB in the school setting have shown dramatic improvements.29 However, successful studies in OB prevention need to be reproducible, especially those improving healthy lifestyle such as after-school PA, to confirm best childhood practices.
Reproducibility of studies is rare because of the complexity of trying to replicate a programme. To standardise a method, it is essential to be able to reproduce appropriate levels of an intervention, especially one that involves behavioural changes. The feasibility of our intervention was confirmed in two different towns and over two different timecourses (the first in Reus over 28 months, and the second in Amposta over 22 months).
Also, it is important to assess treatment adherence in order to evaluate reproducibility and feasibility.19 For example, the KOPS study20 demonstrated that nutritional knowledge was increased as a result of the intervention in the two cohort studies (KOPS 1 and KOPS 2).20 However, the study was unable to show whether there were differences in OW outcomes, weight categories or lifestyles between the two cohorts. Some multicentred studies have attempted to reproduce methodological aspects in interventions conducted in different countries or different populations. However, while multicentred studies are usually implemented concurrently, reproducibility involves the applicability of the intervention at different sites and/or different times in order to validate the initial findings. One example of this is the Pro Children Study,30 which, as a multicentred study, had been applied in different countries simultaneously and had demonstrated its efficacy and feasibility.
The ALADINO study presented the OB status prevalence in Spain, which, according to the IOTF, is about 11.4% in children around 9 years of age.31 In the EdAl-2 study, the OB prevalence was similar, but lower in the intervention group than the equivalent in the ALADINO study and as well in the EdAl-2 control group.
The EdAl-2 study showed a significant improvement of 16.7% in the young boys in the intervention group who participated in the ≥4 h/week after-school PA. Further, the increased numbers of children in the intervention group who performed ≥4 h/week after-school PA, who were normal weight at baseline, suggested that the intervention was effective not only in the primary-school healthy population but also in preventing OB over the longer term due to the PA being maintained.
In the dietary habits aspect of the EdAl-2 study, we observed that the increase in healthy lifestyle habits, such as the increase in fruit and vegetables consumption and increasing PA h/week while maintaining low TV h/day, is promising lifestyle changes that could induce a reduction of OW and OB over the long term.
In the EdAl-2 study, we observed that consumption of dairy products at breakfast was a protective factor against OB.
Several studies have shown that participating in PA was a protective factor against OB and that spending >2 h watching TV was a risk factor for childhood OB. A recent Spanish study showed that leisure-time PA was a protective factor against OB (as with our present study) and that performing >4 h/week is a protective factor while watching TV for this amount of time was, according to Ochoa et al,32 associated with OB.
There are several limitations to our study. First, we evaluated dietary habits via a questionnaire that did not take into account the quantities of the different types of food items consumed. These data would be important in addressing the quantity versus quality debate in OB or OW prevalence. Second, assigning control groups according to towns surrounding the intervention town could be a limitation. However, schools in the same town have good relationships and communications with each other and this could entail a possible contamination between schools if assigned to intervention or control status within the same town. This cross-contamination would be minimised if the schools themselves were assigned to intervention or control. Third, the significant difference in Latin American ethnicity between the two groups of the study at baseline could be a limitation. However, there were no significant differences in distributions of OB and/or OW. Also, no differences were observed in terms of response to the intervention study in relation to ethnicity. Fourth, when asked about fast-food consumption, the participants interpreted this as pertaining only to fast-food outlets such as burger shops, and did consider other concepts such as frozen pizza consumed at home. Finally, another limitation could be the proportion of females who may have started puberty in the course of the study. This implies changes in body composition. However, both study groups (intervention and control) had a similar proportion of females with a similar age, and this could cancel out the effect.
Further, EdAl-2 demonstrated that performing >4 h/week after-school PA, plus having dairy products at breakfast are protective factors. Hence, we believe that participating in >4 h/week after-school PA and continuing with a healthy breakfast are key points in preventing childhood OB.
Our school-based intervention is feasible and reproducible by increasing after-school PA (to ≥4 h/week) in boys. Despite this improvement, there was no change in BMI and prevalence of OB. This suggests that our intervention programme induces healthy lifestyle effects (such as more exercise and less sedentary behaviour), which can produce anti-OB benefits in children in the near future beyond the limited length of our current study. However, the effects on girls’ behaviour need to be more closely studied, together with a future repeat of our study in a different population.
The authors express their appreciation to the university medical and health science students of the Facultat de Medicina i Ciències de la Salut, Universitat Rovira i Virgili (Reus, Spain) as well as the staff and parents of the pupils of the primary schools of Amposta, Sant Jaume d'Enveja, Els Muntells, l'Ametlla de Mar, El Perelló, l'Ampolla, Deltebre, l'Aldea, Lligalló del Gànguil and Camarles for their enthusiastic support of this study.
Review history and Supplementary material
EL and LT contributed equally.
Contributors MG, EL, LT and RS designed the study (project conception, development of the overall research plan and study oversight). MG, EL, LT, RQ and RS conducted research (hands-on conduct of the experiments and data collection). EL, LT, MG and RS provided essential materials (applies to authors who contributed by providing constructs, database, etc. necessary for the research). DM, EL and LT analysed data or performed statistical analysis. RS, MG, LT, DM and EL drafted and revised the manuscript (authors who made a major contribution). The final manuscript was read and approved by all co-authors. RS, MG take primary responsibility for the study and manuscript content.
Funding This work has been supported by Diputació de Tarragona 2011 which give a grant to Universitat Rovira iVirgili, and Ajuntament d'Amposta which provided the foods to develop the activities in the schools.
Competing interests None.
Patient consent Obtained.
Ethics approval The EdAl-2 study was approved by the Clinical Research Ethical Committee of the Hospital Sant Joan of Reus, Universitat Rovira i Virgili (Catalan ethical committee registry ref 11-04-28/4proj8).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Technical appendix, statistical code and data set available at the Dryad repository in: “Data from: EdAl-2 (Educació en Alimentació) programme: reproducibility of a cluster randomised, interventional, primary-school-based study to induce healthier lifestyle activities in children” (10.5061/dryad.t5825;005496).
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.