Article Text

Download PDFPDF

Kids in Communities Study (KiCS) study protocol: a cross-sectional mixed-methods approach to measuring community-level factors influencing early child development in Australia
  1. Sharon Goldfeld1,2,3,
  2. Karen Villanueva2,3,4,
  3. Robert Tanton5,
  4. Ilan Katz6,
  5. Sally Brinkman7,8,
  6. Geoffrey Woolcock9,10,
  7. Billie Giles-Corti4
  1. 1Department of Paediatrics, University of Melbourne, The Royal Children's Hospital, Parkville, Victoria, Australia
  2. 2Murdoch Childrens Research Institute, Parkville, Victoria, Australia
  3. 3Centre for Community Child Health, Royal Children's Hospital, Parkville, Victoria, Australia
  4. 4McCaughey Community Wellbeing Unit, School of Population and Global Health, University of Melbourne, Carlton, Victoria, Australia
  5. 5National Centre for Social and Economic Modelling (NATSEM), Institute for Governance and Policy Analysis, University of Canberra, Canberra, Australian Capital Territory, Australia
  6. 6Faculty of Arts and Social Science, Social Policy Research Centre, University of New South Wales, Sydney, New South Wales, Australia
  7. 7Fraser Mustard Centre, Telethon Kids Institute, Adelaide, South Australia, Australia
  8. 8School of Population Health, The University of Adelaide, Adelaide, South Australia, Australia
  9. 9Wesley Mission Queensland, Chermside, Queensland, Australia
  10. 10Centre for Evidence and Implementation, West End, Queensland, Australia
  1. Correspondence to Professor Sharon Goldfeld; Sharon.goldfeld{at}


Introduction Healthy childhood development in the early years is critical for later adult health and well-being. Early childhood development (ECD) research has focused primarily on individual, family and school factors, but largely ignored community factors. The Kids in Communities Study (KiCS) will test and investigate community-level influences on child development across Australia.

Methods and analysis Cross-sectional mixed-methods study exploring community-level effects in 25 Australian local communities; selection based on community socioeconomic status (SES) and ECD using the Australian Early Development Census (AEDC), a population measure of child development, to create a local community ‘diagonality type’, that is, those performing better or worse (off-diagonal), or as expected (on-diagonal) on the AEDC relative to their SES. Data collection includes stakeholder interviews, parent and service provider focus groups, and surveys with general community residents and service providers, mapping of neighbourhood design and local amenities and services, analysis of policy documents, and the use of existing sociodemographic and early childhood education and care data. Quantitative data will be used to test associations between local community diagonality type, and ECD based on AEDC scores. Qualitative data will provide complementary and deeper exploration of these same associations.

Ethics and dissemination The Royal Children's Hospital Human Research Ethics Committee approved the study protocol (#30016). Further ethics approvals were obtained from State Education and Health departments and Catholic archdioceses where required. ECD community-level indicators will eventually be derived and made publically available. Findings will be published in peer-reviewed journals, community reports, websites and policy briefs to disseminate results to researchers, and key stakeholders including policymakers, practitioners and (most importantly) the communities involved.

  • Neighborhood
  • Child development
  • Mixed methods
  • Indicators
  • Community

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See:

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.


Healthy child development is the foundation for human capital and the basis for future community and economic development.1 A significant body of convergent research emphasises the importance of the prenatal and early years for health and developmental outcomes throughout the life course.2 For a growing number of children, suboptimal developmental trajectories are well established by the time they start school, and become increasingly difficult and costly to modify with the passage of time.3 Thus, investing in young children is important for the prevention of disease later in life and contributes to their full participation in society as healthy and productive adults.4 ,5

Alongside this research, there is intervention, epidemiological, sociological and qualitative evidence all suggesting that local environments are important in supporting the family capacity necessary to raise children in ways that promote good developmental outcomes.6 ,7 The neighbourhoods or communities in which people live appears to impact health and well-being.8 While ‘neighbourhood’ is often used in other studies, in the Australian context ‘neighbourhood’ and ‘community’ are often used interchangeably (these terms are further defined on page 9).7 The research into neighbourhood effects on children was originally motivated by the observation that disadvantage seemed geographically concentrated and intergenerational. This then established the relationship between neighbourhood socioeconomic status (SES) and a number of children's health and developmental outcomes.9 Longitudinal research suggested structural characteristics such as poverty and demography were mediated through community-level social processes that influenced the functioning of families and children.10 ,11 Today, however, there is still limited understanding of the modifiable community-level factors likely to benefit outcomes for young children despite socioecological frameworks suggesting there are multiple levels of influence (individual, family, community) on early child development (ECD).12 ,13 Investigating these influences is thought best undertaken through a combination of quantitative and qualitative methods that can test these multiple influences on ECD.14 ,15

The Kids in Communities Study (KiCS) collaboration consists of six chief investigators (CIs) from Australian Universities, and investigators from academic, non-government and government sectors (herein ‘partner investigators’ (PIs)). It was established in 2007 to investigate the relationship between community-level socioeconomic, demographic and social processes and ECD using a multidisciplinary and multimethod approach. The conceptual framework that guides KiCS is derived from the social and health sciences and includes five community domains of influence: services, social, socioeconomic, physical environment and governance (see figure 1, from Goldfeld et al7). It was designed to wholly encompass community-level processes that take into account conceptual thinking to date including seminal work from Sampson et al,16 and Leventhal and Brooks-Gunn.10 Beyond the sociodemographic characteristics of residents, such theoretical models include elements of social ties/interaction (eg, social capital and ties between neighbours), institutional resources (eg, availability and accessibility of affordable, quality services), routine activities (eg, patterns of land use and daily routine activities such as the location of schools). Further information about the theoretical underpinnings of the KiCS framework and the description of the five community domains, is described in Goldfeld et al.7 The five community domains that form the KiCS framework is derived from the literature and recognises the community platform as a potential point of intervention for better ECD outcomes, through providing strong, healthy communities.7 The study aims to investigate how modifiable community-level factors in these five inter-related domains influence ECD using the Australian Early Development Census (AEDC); a population measure of ECD, and an adaptation of the Canadian Early Development Index (EDI).17

Figure 1

The conceptual framework. KiCS, Kids in Communities Study; SES, socioeconomic status. Adapted from Goldfeld et al7.

In 2009, 2012 and 2015 the Australian government implemented the AEDC across Australia for children in their first year of full-time schooling. The AEDC measures five domains of development: physical, social competence, emotional maturity, language and cognitive skills and communication. In 2012, data on 96.5% (n=289 973) of Australian children were captured by the AEDC; 22.0% of children were developmentally vulnerable in one or more AEDC domains.18 There was geographic variation in ECD, with higher rates of developmental vulnerability typically found in poorer areas; 15.2% of young children living in the least disadvantaged areas were developmentally vulnerable on one or more AEDC domain, compared with 31.7% of young children who lived in the most disadvantaged areas.18

Examination of national results, however, identified a number of communities where children's developmental results did not appear to align with the community SES as would be expected (ie, these areas were doing better or worse than expected). Further investigation suggested that these ‘off-diagonal’ communities may well hold great interest when exploring areas for intervention that may benefit or harm children's outcomes.19 This approach is central to the current extension of KiCS research. From the initial AEDC data in 2009, a pilot KiCS study funded by the Victorian Health Promotion Foundation (Vic Health) was established to test a series of measures and data collection approaches against the KiCS conceptual framework in two communities in Victoria (VIC), Australia.20 The study tested a combination of quantitative (community survey, mapping), and qualitative (interviews and focus groups) approaches to measure community assets and challenges in the context of the AEDC results. For the current study, peer-reviewed funding from a combination of government and non-government organisations (2014) enabled KiCS to expand to 25 local communities across five Australian states and territories: VIC, New South Wales (NSW), Queensland (QLD), South Australia (SA) and the Australian Capital Territory (ACT).

This study aims to identify modifiable (potentially amenable to change through policy) community-level factors that influence children's health and developmental outcomes in the 25 areas of high and low disadvantage across Australia. The objectives are to identify key community-level factors that appear to influence ECD and to examine how these factors interact in different community contexts with two specific research questions:

  • Are any community-level factors consistently related to better outcomes for children, particularly in communities whose outcomes are better or worse than expected for their level of disadvantage (ie, off-diagonal)?

  • Of these, what are the best measurable and modifiable community-level factors that influence children's developmental and health outcomes across communities?

Methods and analysis

To explore community-level influences on ECD, the study focuses on communities where children are developing well and where they are developing poorly relative to the SES of their local community. The study is designed to explore differences and commonalities between on-diagonal and off-diagonal local communities, as well as exploring community-level predictors of ECD (using the AEDC). The research uses a mixed-methods approach (quantitative and qualitative) conducted in three stages: stage 1: site eligibility criteria and recruitment; stage 2: data collection and field work; and stage 3: data analysis and knowledge exchange.

Stage 1: site eligibility criteria and selection

The definition of ‘community’

While the term ‘community’ may refer to a place or group of people with something in common, and ‘neighbourhood’ concerns the geographic construct or boundaries,7 for this study, our definition of ‘local community’ aligns with the AEDC nomenclature and geographic boundaries. The AEDC results are publicly reported as an area-level aggregate termed ‘local community’;21 the size of which varies, but in metropolitan and large regional areas, equates to ∼10 000 persons per area on average.22 ,23 AEDC local communities are the unit of investigation because these are the smallest areas for which AEDC data are publicly available and pockets of disadvantage can be hidden when larger areas are used. AEDC local communities are clustered within larger AEDC ‘communities’ or local government areas.

Site eligibility criteria and selection

The methodology for local community eligibility and selection is described in detail elsewhere,22 but briefly outlined here. The 2009 and 2012 national AEDC data and the Australian Bureau of Statistics (ABS) Socioeconomic Index for Areas Index of Relative Socio-economic Disadvantage (SEIFA-IRSD) have been paired to identify off-diagonal local communities and adjacent on-diagonal counterparts. The SEIFA indexes are a set of indexes of disadvantage produced by the ABS every 5 years using data from the Australian Census. A total of four indexes are produced, and the index used for this analysis was the Index of Relative Socio-economic Disadvantage (IRSD). This index is on a scale of high disadvantage (low values) to low disadvantage (high values). In this index, no indicators of advantage are used, so only indicators like low income, low education, low occupation and public housing are used. These indicators are then combined into one weighted index using a statistical method called principal components analysis to derive the weights for each indicator. More information on the calculation of the SEIFA index can be found in publications from the ABS.24 The SEIFA-IRSD has a relative ranking standardised across Australia to a normal distribution with a national average of 1000, and a SD of 100.25 The AEDC data are available from the Australian Department of Education and Training (previously Department of Education, Employment and Workplace Relations). Using a matrix of the AEDC and SEIFA-IRSD scores (quintile to quintile cross tabulation) on-diagonal and off-diagonal local communities are identified.

Using state-based and territory-based SEIFA scores, local communities with low AEDC scores (high developmental vulnerability) despite high SEIFA-IRSD scores (low disadvantage) are deemed ‘off-diagonal negative’. In contrast, local communities with high AEDC scores (low developmental vulnerability) despite low SEIFA-IRSD scores (high disadvantage) are considered ‘off-diagonal positive’. Those local communities performing as expected are considered ‘on-diagonal advantaged’ (high AEDC scores, high SEIFA-IRSD scores) or ‘on-diagonal disadvantaged’ (low AEDC scores, low SEIFA-IRSD scores; see figure 2, adapted from Tanton et al22).

Figure 2

On-diagonal and off-diagonal local communities. Green=on-diagonal; red=off-diagonal. AEDC, Australian Early Development Census; DV1, Developmentally vulnerable on one or more AEDC domain; SEIFA-IRSD, Socioeconomic Index for Areas, Index of Relative Socio-economic Disadvantage. Adapted from Tanton et al.22

Off-diagonal local communities were then mapped using Geographic Information Systems (GIS) software to identify on-diagonal local communities that were geographically close to off-diagonal local communities (ie, within the same or proximate local government areas). It was assumed that local communities in close proximity to each other are likely to share services (eg, childcare, early childhood programmes) and governance arrangements. In KiCS, there are 25 AEDC local communities, clustered within 12 AEDC communities (local government areas). A snapshot of the local communities, including their diagonality type (on or off diagonal) is shown in table 1.

Table 1

Snapshot of local communities

Stage 2: data collection and field work

The five KiCS community domains each have a set of subdomains. A variety of measurement methodologies are used, some of which are designed to capture several domains (ie, cross-domains). The specific domain and cross-domain measures are summarised in table 2. During the pilot testing a number of cross-domain methods were found to be relatively successful and pragmatic.20 Some of these methods have been amended for the main study. Each domain has a mixture of child-specific and broader community-level population approaches. The only exception is the service domain where only services for young children and their families will be included, rather than all services. Data collection for the 25 local communities is taking place from March 2014 until December 2016. The complete set of data collection approaches and measures is summarised in tables 2 and 3 and outlined in further detail below.

Table 2

Summary of community domains and subdomain/s and methodologies for data collection

Table 3

Summary of methodologies and sample population

Recruitment of participants in local communities

Recruitment of participants for the study is described in detail below under each data collection method. Briefly, state and territory PIs will be approached by the research team to provide recommendations of stakeholders and service provider contacts that may assist with the study. In this way, a snowballing technique26 is used to help identify potential participants for the study and/or those who can assist with recruitment of participants. Desktop analysis (eg, internet searches) is also used to find services and contacts within the communities. Community engagement and participant recruitment for this study relies heavily on the researchers conducting the field work, which involves a complex process of relationship building and trust. In order to prevent stigmatising on-diagonal or off-diagonal communities, the diagonality type of the local community is not mentioned during any form of public engagement with participants.

Qualitative data collection methods

The qualitative research in this study will explore factors that have previously been difficult to capture due to limited availability of data. A number of concurrent data collection activities will be undertaken. A field researcher in each state and territory is employed to engage with each community and conduct interviews, focus groups and gather policy documents.

Policy analysis: Policy document analysis will: (1) describe the policy context; (2) provide verification or support for other elements of the qualitative study; (3) identify individuals and organisations that are important in services and governance in the local area; and (4) provide history, goals, objectives and substantive context about governance, social capital and service environments in the communities. Policy documents may include: local area and local government documents focused on early childhood (eg, local early years plan); infrastructure reports; consultation reports and local annual reports focused on early childhood (eg, annual reports of key organisations operating in the area). As local communities are clustered within larger AEDC communities (ie, local government area) likely to share the same governance structure, ∼10–12 key policy documents will be obtained for each community. A desktop search and sourcing materials through stakeholders and PIs will be used to find policy documents available in the public domain.

Stakeholder interviews: The semistructured stakeholder interviews aim to obtain a deeper understanding of the community context, local governance, how stakeholders work together and member attitudes regarding children and families. Stakeholders will be individuals who either play a leadership role in the community and/or have significant local knowledge and contacts, for example, community champions, managers of early year services. Approximately 10–12 key stakeholders in each AEDC community (local government area) will be approached (ie, ∼120 in total). They will be identified using professional networks of community and government-based partners on the study. Using a snowball sampling methodology,27 interviewees will be asked to recommend other potential key stakeholders (preferably with different views from them) within their professional networks.28 Interviews will be conducted face-to-face in community settings or offices of individuals being interviewed, and will be audio recorded and transcribed. Phone interviews may occur if face-to-face interviews are not possible.

Focus groups: The focus groups will explore: (1) the degree of ‘social capital’ and ‘community cohesiveness’ (particularly attitudes towards and experiences of young children and their families); (2) the resources available to support the development of these social conditions; (3) views on quality, access and use of local services and amenities; and (4) attitudes towards local civic participation and local governance arrangements. For each local community, one focus group will be conducted with: (1) parents of young children (at least one child below 8 years old); and (2) service providers or practitioners. Each focus group will include 8–10 participants.

Participants for the focus groups will be recruited initially through PIs who have links to service providers and to families with young children in the community. For the parent focus groups, playgroup facilitators are asked permission to invite parents who participate in local playgroups to take part in the study. It is anticipated that the field researchers will piggyback on existing playgroups in the study communities for ease of running focus groups. To further assist with parent recruitment, flyers (simple, easy-to-read flyer) for the focus groups may be posted at community organisations (eg, public libraries and community centres) or circulated through local networks. Focus groups will run for ∼1–1.5 hours, and a $A25 gift voucher will be provided to parent participants in recognition of their involvement in the study. Focus groups will be held at a local venue (eg, community centre or school). Focus groups will be audio recorded and transcribed.

Quantitative data collection

The quantitative approaches of this study will provide a descriptive snapshot of the communities and will contribute to the modelling of estimated differences between communities. These data will complement the qualitative data to provide a more detailed understanding of each local community in order to address each research questions.

Service data and surveys: The service data collected will include quantity, quality, access and coordination for services related to children and families. Desktop analysis will be used to obtain information such as staff capacity, clientele, opening hours, accreditation, etc. To obtain data on service coordination and local networks, local service providers such as government representatives, school principals, general practitioners and playgroup leaders will be asked to complete a service survey online or in hardcopy at a focus group in which they attend. The aim is to obtain a service survey from at least one service provider representative from each service type within the local community (eg, general practitioner, primary school and childcare).

Community surveys: The community survey is designed to elicit general residents' (over 18 years old) perceptions and attitudes about the community. The survey includes questions of relevance to the service, social, physical and governance domains, using a combination of: (1) validated items from existing surveys;29–31 (2) derived items where existing items do not exist. Brief demographic questions will also be asked. The items are pilot tested for face validity (content and structure), and test–retest reliability (2 weeks apart), with a convenience sample of staff members at the Melbourne Royal Children's Hospital (n=32 participants). Items which have acceptable reliability (ie, κ or intraclass correlation >0.60) will be included in the final community survey instrument.32

Sample size: To have a representative sample of general community members (over 18 years old) at the smallest possible geography, a random sample of residential addresses will be requested from the Australian Electoral Commission (AEC), an organisation responsible for electoral records. In Australia, it is mandatory to vote in most State and all Federal elections, thus all residents eligible to vote (ie, those over 18 years old) are included on the electoral roll. A sample size of at least 350–390 surveys per local community is required at 95% confidence level, and 0.05 CI. Owing to budget and resources, the AEC will provide a random sample of 1000 residential addresses (name of resident and address information only) per local community (25 000 addresses in total). Thus, a 35–39% response rate is required.

Survey distribution: The community survey will be distributed in three waves, an approach adapted from the Dillman method.33 This approach (eg, prenotification, survey, postreminder) is considered best practice for enhancing response rates to large-scale population health surveys. Respondents have the option of completing surveys online via a web link to Research Electronic Data Capture (REDCap), an online data capture tool hosted on a secure server,34 by phone or returning the survey in a reply paid envelope. Participants will be deemed as having provided implied consent if they complete and return the anonymous survey, and will be offered a chance to win one of three $A300 supermarket gift vouchers.

Wave 1: prenotification letter (a month before survey distribution): wave 1 contains a letter inviting the resident to complete the survey online (or by phone). Wave 2: main survey (1 month after prenotification): wave 2 will only contain participants who did not respond to wave 1. Wave 2 involves posting a hardcopy version of the survey and reply paid envelope. Participants still have the option of completing the survey online or by phone. Wave 3: postsurvey reminder (1 month after main survey distribution): this stage will only contain remaining participants who did not respond in waves 1 and 2. Wave 3 involves posting a letter to remind them to complete the survey online or by phone (another hardcopy version of the survey will not be posted).

GIS and park audits: GIS software (ESRI ArcGIS v10; ArcGIS v10 [program]. Redlands, California, 2010) will be used to calculate spatial measures of the physical environment within and surrounding each local community. Measures include those aligned with the physical and service subdomains (table 2), and include measures previously found to be associated with child and adult behavioural and health outcomes (eg, walking, cycling and obesity).35 ,36 These include measures of walkability, or pedestrian friendliness of the environment; and distance to, and count of services (eg, libraries, maternal and child health services and childcare services), facilities (eg, recreation centres, community centers), and other venues (eg, parks). Where available, data from government and non-government sources are being used to calculate the measures. GIS measures are calculated at two geographic scales and linked to the outcome data to enable simple and more complex analyses, respectively: (1) local community level (∼10 000 persons on average); and (2) the ABS statistical area level 1 (SA1), an area of ∼400 persons on average.23

Detailed ‘quality’ data will be collected on local parks. Previous research suggests that residents do not necessarily travel to their closest park. Rather, they travel further distances to use a park with better facilities and features.37 Therefore, features of parks in each local community will be audited using a validated remote desktop park auditing tool.38 The ‘Public Open Space Desktop Auditing Tool’ (POSDAT) uses a combination of GIS software, Google Earth and Google Street view to capture park features and attributes. Park features include the presence or number of amenities (eg, seating and benches, barbeque facilities, playgrounds), aesthetics (eg, water features, shade along paths) and sporting activities (eg, tennis courts, basketball courts). To create a child/family-friendly ‘park quality’ score for each park, each feature will be weighted and summed; this has previously been done with both adults,39 and adolescents.40

Community demographics: The Australian Census occurs every 5 years. Existing information available from the ABS on the sociodemographics of residents within each local community will be obtained.

Stage 3: data analysis

Combining qualitative with quantitative methods (mixed methods) can provide a deeper and more comprehensive understanding of complexities underlying the potential pathways in which communities impact ECD.41 The mixed-methods investigations undertaken through this study will determine whether there are any consistent community-level factors associated with on-diagonal and off-diagonal communities.

Outcomes: There are two key outcomes. The first outcome is the local community ‘diagonality’ types (see A, B, C and D, in figure 2). The ‘off-diagonal’ local community types are those areas that are doing better (off-diagonal positive) or worse (off-diagonal negative) than their relative SES. These will be compared with the two on-diagonal local community types, that is, those areas that are doing as expected relative to their SES.

The second outcome is the proportion of children developmentally vulnerable on one or more AEDC domains, which is the same measure used for identifying the off-diagonal communities. The AEDC data are collected by teachers who complete an online checklist for each child in their first year of formal full-time school (∼5 years old) covering the five ECD areas previously noted of physical development, social competence, emotional maturity, language, and cognitive development (eg, academic learning), and general knowledge and communication.17 Children are scored on each of these domains, and categorised as ‘developmentally vulnerable’ (≤10th centile), ‘developmentally at risk’ (between 10th and 25th centiles) and ‘developmentally on track’ (≥25th centile)17 Children who are developmentally at risk on one or more ECD domain (ie, DV1) is typically reported in AEDC publications. Within the 25 local communities, there is AEDC information on 2598 children.

Analysis: The analyses will be conducted in two phases. Phase 1 will include descriptive analyses examining patterns by diagonality type (ie, the four on-diagonal and off-diagonal groups). Qualitative and quantitative descriptive analyses will be undertaken concurrently. Patterns of community factor convergence and divergence that differentiate on-diagonal and off-diagonal communities will be explored. Phase 2 will include more complex analyses (eg, multilevel modelling) using the breadth of the quantitative data.

Analysis phase 1: All transcribed qualitative data and field notes will be entered into QSR International's Nvivo V.11 software, designed to assist with organising and coding qualitative data (NVivo qualitative data analysis Software Version 11 [program]: QSR International Pty Ltd, 2015). Owing to the large amount of qualitative data, content analysis will be applied; this requires a deductive approach, where predefined categories are used to help ‘code’ the data. A comprehensive coding framework aligned with the study's domains and indicators was developed by the research team. Information that does not ‘fit’ within the existing coding framework but may be important to the study will be coded as ‘other useful information’. To ensure analytical rigour and consensus, issues will be discussed and consolidated through regular team coding discussions; such approaches have been used in previous studies.42–44 The analysis techniques will identify domains and factors which facilitate or hinder optimal ECD in the on-diagonal and off-diagonal communities. The proposed approach will be used to organise study findings and to create cluster themes that support the quantitative analysis and provide more detail on why the differences between local communities might exist. Any differences by diagonality type will be described and will provide further explanations for the quantitative findings. The quantitative data analyses (see below) will be explored concurrently with qualitative data analyses to determine areas of convergent and divergent results in regard to the on-diagonal and off-diagonal community comparisons. The qualitative data will also help to generate hypotheses that can be tested further with quantitative data.

Data reduction techniques (eg, cluster analyses and scales) will be used to combine quantitative variables and identify scores for the community domains and subdomains driving the differences between on-diagonal and off-diagonal communities across each of the domains. Data will include multiple measures from the ABS and other sources, the service and community surveys, and GIS. Owing to the small sample size, a priority will be to provide descriptive statistics of local community-level data using Stata (Stata Statistical Software: Release 13 [program]. TX: StataCorp LP.: College Station, 2013). However, in addition, we will also compare on-diagonal and off-diagonal communities using t-tests and χ2 tests of significant differences between means for the community types.

Analysis phase 2: Multilevel modelling of the quantitative data will be undertaken to identify which factors might influence the AEDC (as the outcome measure) in each local community focusing on the ecological framework of neighbourhood and family/individual factors. GIS and sociodemographic data calculated at a smaller geographic level (ie, ABS SA1 or an average of 400 persons per area) and linked to the outcome measures (ie, AEDC DV1 also calculated at the same level) provide the opportunity to conduct additional analyses with a larger sample, exploring the results for all children (n=2598) with an AEDC result nested within local communities and communities.

Study governance: The KiCS collaboration currently consists of six CIs from Universities across Australia, and 17 named PIs from a range of non-government and government organisations. The group of six CIs teleconference monthly to ensure consistency in site data collection and general project oversight. All investigators teleconference quarterly to discuss the progress of the study. An in-person meeting of all investigators occurs annually. Field researchers will collect data in study communities in each state and territory, overseen by the CI responsible for that state or territory. Day-to-day coordination of study activities will be performed by the project coordinator based in Melbourne, VIC.

Ethics and dissemination


This includes approval for all consent processes necessary for each of the data collection elements. For example, participants of a semistructured interview or focus group are required to provide written consent to be involved. Participants will receive a plain language statement describing the study, and will have the opportunity to ask any questions they may have before signing the informed consent form. For service and community surveys, a completed survey is deemed as having provided consent. All participants may decline participation at any time. Publication of data in all publications and reports will de-identify all participants.

Given the national scope of the study, ethics approval was granted by each state and territory where required. The Education Department in each state and territory approved research conducted in early childhood services and/or government primary schools. Moreover, Catholic archdioceses provided ethics approval for the Catholic primary schools approached by the study. For NSW and QLD only, their State Department of Health approved data collection within the study's local communities. In total, 21 ethics applications were submitted, and 18 were approved (82%).

Research dissemination and translation

Research translation is fundamental to this study and is considered from the outset. The KiCS PIs from a range of non-government and government organisations will assist with translation and dissemination of results to the communities. This study is well placed for a strong and strategic communications and dissemination plan that includes research and community capacity building, and effective research translation in a policy environment.

In addition to standard academic outputs (eg, manuscripts and conference presentations), it is anticipated that face-to-face or webinar seminars will be held at the local government councils, brief community reports and lay print media (eg, one-page research snapshots) will be used to release local findings to the communities involved. The uptake of the potential community indicators into social policy systems, and practices is imperative. Established ECD dissemination networks with communities, policymakers, practitioners (child development, education) and teachers already exist through the AEDC nationally.


The KiCS is setting out to examine community-level effects on young children's development. In doing so, there are a number of ‘frontier’ approaches necessary to investigate the question of community impact with any level of rigour and potential replicability and utility. The mixed methodologies in this study will enable convergence of qualitative and quantitative findings to provide a more in-depth understanding of the factors associated with ECD outcomes in communities.

Working towards healthy environments for young children and families requires input from a range of stakeholders across multiple disciplines including practitioners and policymakers from urban planning to paediatrics and education sectors. Moreover, community input is vital if communities are to use the findings. The final aim will be to use findings from this study to develop a set of indicators that will have utility for all communities considering how best to impact the development of their children. This will particularly be useful in the Australian setting where the AEDC data are available on a triennial basis. As such, communities may use these findings and indicators to develop more effective programmes and interventions. Indeed, there is increasing global interest in ‘place-based’ strategies from governments and philanthropic agencies around the world, propelled somewhat by the collective impact community action momentum and the emerging field of prevention science.4 While there is policy interest, the availability of rigorous approaches to data collection and indicators, underpinned by theory and tested for associations with ECD outcomes, is limited. Therefore, this study's findings will likely have timely policy utility and knowledge translation impact.

There are a number of limitations to this study. The 25 local communities constitute a small sample size in terms of generalisability. While the utility of existing community quantitative data can be enhanced by complementary qualitative data, even with deeper findings there will be limitations to how generalisable these can be across Australia. It is hoped that future studies will go on to test these approaches in further diverse communities. This approach will strengthen the generalisability while offering pragmatic measures in the interim. GIS data, while a useful analytic tool in examining community-level effects, are currently mainly available only for urban environments. Broader utility for use of GIS in regional communities is yet to be assessed.

The issues of scope and generalisability are a critical consideration for studies of this nature where we are seeking ecological causality. It is encouraging that previous studies in the social sciences have had significant findings from small sample sizes (eg, Coulton et al45) when focused on outcomes such as child protection notifications. Indeed our own social environment measures align with these studies and offer opportunities for interesting international comparisons. In a world of practicalities where the rhetoric for community change has outpaced the evidence, it is important to insert some level of measurement rigour that both facilitates the exploration of community understanding and suggests (rather than proves) some level of causal link. Measuring the domains of focus in this study (social, service, governance, physical and sociodemographic) are a real strength of the study. It will make an important contribution to the development of indicators that help communities and governments drive efforts towards better and more equitable developmental outcomes for young children.


The KiCS collaboration includes the University of Melbourne (lead institution), University of Canberra, University of New South Wales and the University of Western Australia. The partner organisations include: Federal and State governments (Australian Government Department of Education and Training; Australian Bureau of Statistics; Victorian Department of Education and Training; Australian Capital Territory Community Services Directorate; Children's Health Queensland Hospital and Health Service; South Australia Department for Education and Child Development; New South Wales Department of Education and Communities; Queensland Department of Education, Training and Employment; New South Wales Department of Families and Community Services); non-government (The Smith Family, Murdoch Childrens Research Institute, Wesley Mission Brisbane, The Benevolent Society, UnitingCare Children, Young People and Families); other Universities (University of British Columbia, Mount Saint Vincent University and University of California, Los Angeles). The Australian Research Council (ARC) and generous in-kind and financial support from partner organisations are gratefully acknowledged for their contributions to the study, including input into data collection methods, assistance with sourcing data, engaging with the community and ethics processes. SG is supported by a National Health and Medical Research Council (NHMRC) Career Development Fellowship (1082922) and BG-C by a NHMRC Senior Principal Research Fellow Award (1107672). Summer Wood is acknowledged for her contributions to study coordination and set-up. The field researchers including Anna Jones, Melanie Dare, Ju-Lin Lee, Alanna Sincovich, Ashleigh Wilson, Genevieve Smith, and Michelle Tennant are gratefully acknowledged for engaging with communities, recruitment of participants, field work, contributions to methods, and data analysis. Melanie Dare contributed to the selection of communities. Anna Jones assisted with the development of focus group questions, and Rachel Robinson led the development of the governance domain and interview questions. Rebecca Roberts contributed to the cleaning, processing and computing of GIS measures. We gratefully acknowledge the participants and stakeholders who have kindly provided their time, resources and input.



  • Contributors KV developed the first draft of the manuscript based on the existing protocol and contributed to study coordination, data collection, and data cleaning, and analysis. SG is the lead chief investigator (CI) of the study, along with RT, IK, SB, GW and BG-C as CIs who have contributed to the conception and design of the study. RT, Melanie Dare and SB selected the communities using on-diagonal and off-diagonal methodology, and led the sociodemographic domain. IK led the social domain and developed the focus group questions. SG led the service domain. BG-C and GW led the physical domain; and along with KV, led the conceptualisation of GIS measures. All authors provided critical feedback during manuscript development. Each author has approved the final manuscript.

  • Funding This study was supported by an Australian Research Council (ARC) Linkage Grant (LP130100411), and financial support from the partner organisations: Australian Government Department of Education and Training; Victorian Department of Education and Training; Australian Capital Territory Community Services Directorate; South Australia Department for Education and Child Development; New South Wales Department of Education and Communities; Queensland Department of Education, Training and Employment; Children's Health Queensland Hospital and Health Service; New South Wales Department of Families and Community Services; The Benevolent Society; and UnitingCare Children, Young People and Families.

  • Competing interests None declared.

  • Ethics approval Melbourne Royal Children's Hospital Human Research Ethics Committee (HREC; approval number 30 016).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement Unpublished data from this study include stakeholder interviews, parent and service provider focus groups, surveys with general community residents and service providers, mapping of neighbourhood design and local amenities and services, analysis of policy documents, and the use of existing sociodemographic and early childhood education and care data. The data are available to the Kids in Communities Study (KiCS) research team.