Skip to main content
  • Study protocol
  • Open access
  • Published:

Scaling up community-based obesity prevention in Australia: Background and evaluation design of the Health Promoting Communities: Being Active Eating Well initiative

Abstract

Background

There is only limited evidence available on how best to prevent childhood obesity and community-based interventions hold promise, as several successful interventions have now been published. The Victorian Government has recently funded six disadvantaged communities across Victoria, Australia for three years to promote healthy eating and physical activity for children, families, and adults in a community-based participatory manner. Five of these intervention communities are situated in Primary Care Partnerships and are the subject of this paper. The interventions will comprise a mixture of capacity-building, environmental, and whole-of-community approaches with targeted and population-level interventions. The specific intervention activities will be determined locally within each community through stakeholder and community consultation. Implementation of the interventions will occur through funded positions in primary care and local government. This paper describes the design of the evaluation of the five primary care partnership-based initiatives in the 'Go for your life' Health Promoting Communities: Being Active Eating Well (HPC:BAEW) initiative.

Methods/Design

A mixed method and multi-level evaluation of the HPC:BAEW initiative will capture process, impact and outcome data and involve both local and state-wide evaluators. There will be a combined analysis across the five community intervention projects with outcomes compared to a comparison group using a cross-sectional, quasi-experimental design. The evaluation will capture process, weight status, socio-demographic, obesity-related behavioral and environmental data in intervention and comparison areas. This will be achieved using document analysis, paper-based questionnaires, interviews and direct measures of weight, height and waist circumference from participants (children, adolescents and adults).

Discussion

This study will add significant evidence on how to prevent obesity at a population level in disadvantaged and ethnically diverse communities. The outcomes will have direct influence on policy and practice and guide the development and implementation of future obesity prevention efforts in Australia and internationally.

Trial registration

ACTRN12609000892213

Peer Review reports

Background

Obesity is a growing public health issue and there is now widespread agreement that the complex etiology of obesity requires a multifaceted approach to prevention [1–4]. Community-based interventions provide an opportunity for community assets to be utilized with efficiency and direction [3]. There is now emerging evidence of the effectiveness of community-based and community-wide, multi-strategy approaches to obesity prevention [1, 5–9].

A community-based, capacity-building approach aims to promote sustainable skill development, strengthen communities and increase the ability of individuals to effectively address and improve health outcomes [10, 11]. Such an approach has the potential to influence the underlying social and economic determinants of health in a flexible, sustainable, equitable and safe manner [12]. To determine the sustainability of effective intervention activities, evaluation is required both in the intermediate and long term [13].

The aim of this paper is to describe the evaluation design of the five Primary Care Partnership (PCP)-based intervention sites in the Health Promoting Communities: Being Active Eating Well (HPC:BAEW) initiative to promote healthy eating and physical activity in disadvantaged communities across Victoria, Australia. The intervention will operate at a whole-of-community level within five intervention sites using a multi-setting, multi-strategy capacity-building approach. The evaluation objectives are to: 1) assess the extent to which the initiatives have been implemented as planned (process evaluation), and 2) evaluate the impacts and outcomes of the intervention when compared to a comparison sample.

Methods/Design

Intervention communities

Each intervention community has a specific primary target population, which ranges from children aged 0-12 years (including primary/elementary school students); to adolescents aged 12-18 years (secondary school students) and working adults. Secondary target populations include the wider community, older adults and specific disadvantaged groups (e.g. low income, ethnic minority, rural) within the community. The primary and secondary target groups for each intervention community are shown in Table 1, along with the characteristics of the communities.

Table 1 Intervention community characteristics and target groups.

Preparation for evaluation

The evaluation was not funded until after the funding and initiation of the five intervention projects. Therefore, prior to developing the evaluation plan, draft project action plans were reviewed in detail in conjunction with the project coordinators and affiliates for each of the projects and a matrix was developed to provide an overview of the implementation activities in each community. This is presented in Table 2.

Table 2 The intervention approaches for the objectives of the five Health Promoting Communities: Being Active Eating Well intervention communities*.

A logic model was also developed on the basis of the action plans and frameworks being utilized to guide the intervention activities (see Figure 1). This logic model extended comparable models developed for other similar community-based projects, and provides a practical method for systematically collecting evaluation data for community projects [14].

Figure 1
figure 1

Program logic model of the Health Promoting Communities: Being Active Eating Well initiative.

Evaluation design

The evaluation design will be quasi-experimental, repeat cross-sectional, with outcomes compared between intervention and comparison areas at two time points within the project duration (2008/9 and 2010). The socio-ecological model of health has been utilized to develop the intervention activities and evaluation design. This framework focuses attention on five key determinants of health behavior: individual factors, interpersonal and primary groups; institutional and organizational factors, community factors and public policy [15]. The model assumes that appropriate changes in the social environment will produce changes in individuals and the support of individuals in the population is essential for implementing environmental changes [16]. Consistent with this framework, impact and outcome data will be collected at the community, setting and individual levels. Table 3 provides an overview of the evaluation data to be collected.

Table 3 Overview of the multi-level and mixed methods evaluation data to be collected

Comparison groups

Appropriate comparison groups for each target (age) group will be selected from across the state. Comparison schools will be randomly drawn from Victorian schools matched on demographics including school type (government/non-government), school size, level of disadvantage (using the Socio-Economic Index for Areas [SEIFA] index of advantage/disadvantage Victorian decile from the 2006 Census [17]) and location (Local Government Area and region). Comparison workplaces will be matched on the demographic characteristics of the intervention workplaces, including the workplace size, type and location.

Sample size

The sample size calculations were primarily designed to account for intervention outcomes and detect a meaningful level of change compared to the comparison group. As such, calculations were based on a difference in behavior prevalence of > 15% and zBMI > 0.15 units between intervention and comparison groups, while also accounting for the design effects of clustering by schools and workplaces. Detecting differences within this design will require a sample of approximately 5,200 students (approximately 2,400 primary students and 2,800 secondary students). For the adult sample, 245 people in the intervention and a matched comparison sample will have the power to detect a 13 percentage point difference in behavioral outcomes (power of 80%) and difference of 1.7 BMI units between intervention and comparison samples with 80% power at a significance level of 0.05.

Process evaluation

The primary methods to assess the extent to which the intervention activities have been implemented and determine program reach (process evaluation) will include: document analysis (e.g. meeting minutes, action plan versions, reports, school/workplace policies, food service menus, and curriculum); key informant interviews; participant feedback; focus groups; case studies of participants/community organizations and surveys. At a local level, project managers and workers will also capture the approaches to intervention development and promotion, participant recruitment, level of (and explanation for) participation and non-participation, demographics of participants (e.g. gender, socio-economic position, age group) and any publicity or press for the local project. Together this data will comprise the process evaluation.

Impact and outcome evaluation

Differences in individual and community-level impacts and outcomes will be measured using a cross-sectional design with differences between intervention and comparison groups assessed at the cluster (school, workplace, community) level as appropriate. Trained research staff (supported by project staff at baseline) will collect the anthropometric, behavioral, quality of life and environmental data from each school/workplace pre- (2008/9) and post- (2010) intervention activities. Data on socio-demographics will also be collected in two ways: direct data collection from the participant (age, gender, country of origin, residential address, school address) and from the community (region) using the 2006 ABS Census data (e.g. mean income, education, occupation, indigenous status, family structure, country of origin, English-speaking). This community level data will be used in hierarchical linear modeling to analyze the outcomes of the interventions. At the local level, additional intervention impacts will be captured through qualitative methods (narrative evaluation, case studies, photo diaries etc).

Anthropometry

Weight, height and waist circumference will be measured by trained researches in accordance with standard methods for the collection of anthropometric data [18]. All measurements will be taken in light clothing (one layer), without shoes, with all jewellry removed and pockets emptied. Cultural and body image sensitivities will be accommodated using previously published strategies [19]. Weight will be measured to the nearest 0.05 kg using electronic scales (A&D Personal Precision Scale UC-321). Height will be measured using a portable stadiometer to the nearest 0.1 cm (PE87 portable stadiometer) and participant hair styles which may interfere with the measurement process will be removed or adjusted. Participants will be instructed to stand with their weight distributed evenly on both feet, with their heels together and arms hanging freely by their sides. Four contact points between the participant's body and the measuring apparatus will be required (head, upper back, buttocks and heels) and the head aligned in the Frankfurt plane prior to the measurement being taken. Waist circumference will be measured to the nearest 0.1 cm at the end of a normal expiration on the horizontal line of the umbilicus using a standard flexible seamstress measuring tape for students and a constant tension tape figure finder for adults. Two measurements will be recorded for each parameter, and where there is a disagreement between two measurements (>0.1 kg for weight, >0.5 cm for height and >0.3 cm for waist circumference), a third will be taken. The mean of all measures will be used for analysis, and Body Mass Index (BMI) (weight in kg/height in m2) will be calculated to classify child and adult weight status using the International Obesity Task Force age-specific BMI cut-off points [20]. The scales and stadiometer will be re-calibrated every 1000th student measured and the flexible measuring tape verified against a designated 1 m metal ruler on a weekly basis to confirm the tape has not stretched.

Survey methodology

Surveys capturing information regarding nutrition and physical activity behaviors will be piloted and subsequently administered to all students in grade four and higher, and to all adults. Surveys will be based on those used in our previous and similar studies [12] and http://www.goforyourlife.vic.gov.au/hav/articles.nsf/practitioners/Be_Active_Eat_Well_Final_Reports?Open) and aligned with state-wide surveillance measures where possible.

Nutrition and physical activity behaviors

The behavioral surveys will contain 20 to 30 questions primarily focusing on the types and amounts of foods eaten on the previous day and the type, frequency and duration of sedentary behaviors and physical activity. Age-appropriate surveys will be used for younger and older children and adults.

Quality of life

Secondary school students and adults will also complete the Assessment of Quality of Life (AQoL) mark 2 [21, 22], a 20 item quality of life assessment tool comprising six dimensions: physical ability, social and family relationships, mental health, coping, pain and physical senses (vision, hearing and communication). Scores from the six dimensions will be combined to calculate an overall quality of life rating. The AQoL, is a utility-based instrument originally developed for Australian adults, which has now been recalibrated for use with adolescents (M. Moodie, personal communication, manuscript under review).

School environment

An assessment of the school environment will be conducted by a trained researcher with one to three school staff to complete a questionnaire designed to capture seven key elements of the school: demographics, internal and external food services, food/nutrition and physical activity policy(ies); nutrition environment; and the physical activity environment. The questionnaire is based on similar instruments that have been developed and used for environment audits [23] and a consensus answer will be recorded for each question.

Measures of deprivation and ethnicity

The postcode of each participant will be used to determine the SEIFA This is an area-level indicator of socio-economic status, with a low score on the SEIFA indicating an area of social disadvantage and a higher score an area less disadvantaged [17]. Information related to ethnicity and length of time since migration to Australia will also be collected.

Data entry, handling and statistical analysis

The child behavioral surveys will be scanned directly into an electronic database. The demographic, other survey (adult behavioral and AQoL) and anthropometric data will be double-entered into Stata (Version 10.1, StataCorp, College Station, Texas, USA). All statistical analysis on individual and school environment data will be conducted using Stata and quantitative analysis of the cross-sectional impact and outcome data will utilize regression analysis, hierarchical linear modeling, descriptive statistics and design corrected chi2 analysis, as appropriate. The SVY commands in stata will be used for all analysis to account for clustering and design effects and the primary analysis will be between the intervention and comparison groups post-intervention. Demographic data will be used to adjust for confounding (e.g. gender; socio-economic status), and additional data on smoking status and alcohol intake will be collected from adults. Qualitative data will be analyzed using content and inductive thematic methods, as appropriate. Data triangulation and mixed methods analysis will also be used where possible.

Consent and ethics

All adults participating in the evaluation will provide informed written consent. For younger participants (aged <18 years), parents will provide informed written consent and the participant will provide additional verbal consent prior to data collection. Various strategies will be used to maximize the response rate of participants. The project has been approved by the Deakin University Human Research Ethics Committee (HREC, EC98-2008), the Department of Health HREC, relevant hospital HRECs, the, Department of Education and Early Childhood Development (DEECD), the Office for Children Research Coordinating Committee, and the Catholic Education Offices (Melbourne and regional) as appropriate. All researchers involved in data collection will have a Victorian Police Check and/or a "Working With Children" (WWC) check.

Discussion

Currently, there is only limited evidence available about effective strategies to prevent obesity at a population level. The Health Promoting Communities: Being Active Eating Well initiative is an attempt to scale up intervention activities across multiple communities in a coordinated manner using a capacity-building and environmental focused approach. The evaluation of the initiative is challenging due to the late contracting of the evaluators and the necessity to co-ordinate the evaluation across multiple communities with varying target groups and intervention activities. Despite these challenges, the knowledge generated will add significantly to the evidence base and can inform future large and small scale obesity-related public health interventions internationally.

References

  1. Flynn MAT, McNeil DA, Maloff B, Mutasingwa D, Wu M, Ford C, Tough SC: Reducing obesity and related chronic disease risk in children and youth: a synthesis of evidence with 'best practice' recommendations. Obesity Reviews: An Official Journal Of The International Association For The Study Of Obesity. 2006, 7 (Suppl 1): 7-66.

    Article  Google Scholar 

  2. Summerbell CD, Waters E, Edmunds LD, Kelly S, Brown T, Campbell KJ: Interventions for preventing obesity in children. Cochrane Database Of Systematic Reviews. 2005, CD001871-3

  3. Economos CD, Irish-Hauser S: Community interventions: a brief overview and their application to the obesity epidemic. The Journal Of Law, Medicine & Ethics: A Journal Of The American Society Of Law, Medicine & Ethics. 2007, 35 (1): 131-137. 10.1111/j.1748-720X.2007.00117.x.

    Article  Google Scholar 

  4. Swiburn B, de Silva-Sanigorski A: Where to from here for preventing childhood obesity - an international perspective. Obesity (Silver Spring, Md). 2009, 18 (S1): S4-S7.

    Google Scholar 

  5. Egger G, Swinburn B: An "ecological" approach to the obesity pandemic. BMJ (Clinical Research Ed). 1997, 315 (7106): 477-480.

    Article  CAS  PubMed Central  Google Scholar 

  6. Taylor RW, McAuley KA, Williams SM, Barbezat W, Nielsen G, Mann JI: Reducing weight gain in children through enhancing physical activity and nutrition: the APPLE project. International Journal Of Pediatric Obesity: IJPO: An Official Journal Of The International Association For The Study Of Obesity. 2006, 1 (3): 146-152.

    Article  Google Scholar 

  7. Economos CD, Hyatt RR, Goldberg JP, Must A, Naumova EN, Collins JJ, Nelson ME: A community intervention reduces BMI z-score in children: Shape Up Somerville first year results. Obesity (Silver Spring, Md). 2007, 15 (5): 1325-1336. 10.1038/oby.2007.155.

    Article  Google Scholar 

  8. de Silva-Sanigorski AM, Economos CD: Evidence of multi-setting approaches for obesity prevention: translation to best practice for future interventions. Preventing childhood obesity: evidence, policy and practice. Edited by: Waters S. 2010, Uuay, Seidell: Wiley Blackwell,

    Google Scholar 

  9. de Silva-Sanigorski AM, Bell AC, Kremer P, Nichols M, Crellin M, Smith M, Sharp S, de Groot F, Carpenter L, Boak R, Robertson N, Swinburn BA: Reducing obesity in early childhood: Results from Romp & Chomp, an Australian community-wide intervention program. American Journal of Clinical Nutrition. 2010,

    Google Scholar 

  10. Smith A, Coveney J, Carter P, Jolley G, Laris P: The Eat Well SA project: an evaluation-based case study in building capacity for promoting healthy eating. Health Promotion International. 2004, 19 (3): 327-334. 10.1093/heapro/dah306.

    Article  PubMed  Google Scholar 

  11. NSW Health: A Framework for Building Capacity to Improve Health. 2001, Edited by Department NSWH. North Sydney

    Google Scholar 

  12. Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA: Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, Be Active Eat Well. International Journal Of Obesity (2005). 2008, 32 (7): 1060-1067. 10.1038/ijo.2008.79.

    Article  CAS  Google Scholar 

  13. Kumanyika S, Jeffery RW, Morabia A, Ritenbaugh C, Antipatis VJ: Obesity prevention: the case for action. International Journal Of Obesity And Related Metabolic Disorders: Journal Of The International Association For The Study Of Obesity. 2002, 26 (3): 425-436. 10.1038/sj.ijo.0801938.

    Article  CAS  Google Scholar 

  14. Medeiros LC, Butkus SN, Chipman H, Cox RH, Jones L, Little D: A logic model framework for community nutrition education. Journal Of Nutrition Education And Behavior. 2005, 37 (4): 197-202. 10.1016/S1499-4046(06)60246-7.

    Article  PubMed  Google Scholar 

  15. Sorensen G, Emmons K, Hunt MK, Johnston D: Implications of the results of community intervention trials. Annual Review Of Public Health. 1998, 19: 379-416. 10.1146/annurev.publhealth.19.1.379.

    Article  CAS  PubMed  Google Scholar 

  16. McLeroy KR, Bibeau D, Steckler A, Glanz K: An ecological perspective on health promotion programs. Health Education Quarterly. 1988, 15 (4): 351-377.

    Article  CAS  PubMed  Google Scholar 

  17. Statistics ABo: Socio-Economic Indexes for Areas (SEIFA), Australia - Data Only, 2006. 2006, Australian Bureau of Statistics

    Google Scholar 

  18. Davies P, Roodvelt R, Marks G: Standard methods for the collection and collation of anthropometric data in children. 2001, [http://www.health.gov.au/internet/main/publishing.nsf/Content/0B5E175AB3EBA8F8CA256F190004C273/$File/anthropometric.pdf]

    Google Scholar 

  19. Gibbs L, O'Connor T, Waters E, Booth M, Walsh O, Green J, Bartlett J, Swinburn B: Addressing the potential adverse effects of school-based BMI assessments on children's wellbeing. International Journal of Pediatric Obesity. 2008, 3 (1): 52-57. 10.1080/17477160701645202.

    Article  PubMed  Google Scholar 

  20. Cole TJ, Bellizzi MC, Flegal KM, Dietz WH: Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ (Clinical Research Ed). 2000, 320 (7244): 1240-1243. 10.1136/bmj.320.7244.1240.

    Article  CAS  Google Scholar 

  21. Hawthorne G, Richardson J, Osborne R: The Assessment of Quality of Life (AQoL) instrument: a psychometric measure of health-related quality of life. Qual Life Res. 1999, 8 (3): 209-224. 10.1023/A:1008815005736.

    Article  CAS  PubMed  Google Scholar 

  22. Richardson J, Day N, Peacock S: Measurement of the quality of life for economic evaluation and the assessment of quality of life (AQoL) Mark 2 instrument. The Australian Economic Review. 2004, 37 (1): 62-88. 10.1111/j.1467-8462.2004.00308.x.

    Article  Google Scholar 

  23. Carter M-A, Swinburn B: Measuring the 'obesogenic' food environment in New Zealand primary schools. Health Promotion International. 2004, 19 (1): 15-20. 10.1093/heapro/dah103.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Acknowledgements

We acknowledge the assistance of Rebecca Doherty, the project managers/officers from each of the five community intervention projects, and the editorial assistance of Tara Breheny. This study is funded by the Victorian Department of Health and the Office of Senior Victorians, at the Department of Planning and Community Development, and supported by the Department of Education and Early Childhood Development and the Catholic Education Offices. EW, LG and AdS are also supported by the Jack Brockhoff Foundation. LG and AdS are also supported by an NHMRC capacity building grant.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrea M de Silva-Sanigorski.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

AdS and KB drafted the initial manuscript, all authors contributed to the methods and design of the study, and all authors had critical input into the production of the final manuscript. All authors have read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

de Silva-Sanigorski, A.M., Bolton, K., Haby, M. et al. Scaling up community-based obesity prevention in Australia: Background and evaluation design of the Health Promoting Communities: Being Active Eating Well initiative. BMC Public Health 10, 65 (2010). https://doi.org/10.1186/1471-2458-10-65

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2458-10-65

Keywords