Predictors of non-response in a UK-wide cohort study of children's accelerometer-determined physical activity using postal methods
- Carly Rich1,
- Mario Cortina-Borja1,
- Carol Dezateux1,
- Marco Geraci1,
- Francesco Sera1,
- Lisa Calderwood2,
- Heather Joshi2,
- Lucy J Griffiths1
- 1MRC Centre of Epidemiology for Child Health, UCL Institute of Child Health, London, UK
- 2Department of Quantitative Social Science, Institute of Education, University of London, London, UK
- Correspondence to Carly Rich;
- Received 31 October 2012
- Revised 5 February 2013
- Accepted 6 February 2013
- Published 1 March 2013
Objectives To investigate the biological, social, behavioural and environmental factors associated with non-consent, and non-return of reliable accelerometer data (≥2 days lasting ≥10 h/day), in a UK-wide postal study of children's activity.
Design Nationally representative prospective cohort study.
Setting Children born across the UK, between 2000 and 2002.
Participants 13 681 7 to 8-year-old singleton children who were invited to wear an accelerometer on their right hip for 7 consecutive days. Consenting families were posted an Actigraph GT1M accelerometer and asked to return it by post.
Primary outcome measures Study consent and reliable accelerometer data acquisition.
Results Consent was obtained for 12 872 (94.5%) interviewed singletons, of whom 6497 (50.5%) returned reliable accelerometer data. Consent was less likely for children with a limiting illness or disability, children who did not have people smoking near them, children who had access to a garden, and those who lived in Northern Ireland. From those who consented, reliable accelerometer data were less likely to be acquired from children who: were boys; overweight/obese; of white, mixed or ‘other’ ethnicity; had an illness or disability limiting daily activity; whose mothers did not have a degree; who lived in rented accommodation; who exercised once a week or less; who had been breastfed; were from disadvantaged wards; had younger mothers or lone mothers; or were from households with just one, or more than three children.
Conclusions Studies need to encourage consent and reliable data return in the wide range of groups we have identified to improve response and reduce non-response bias. Additional efforts targeted at such children should increase study consent and data acquisition while also reducing non-response bias. Adjustment must be made for missing data that account for missing data as a non-random event.
This paper investigates the biological, social, behavioural and environmental factors associated with non-consent and non-return of reliable accelerometer data (≥2 days lasting ≥10 h/day) in a UK-wide postal study of children's activity.
Consent was less likely for children with a limiting illness or disability, children who did not have people smoking near them or had access to a garden and children who lived in Northern Ireland.
From those who consented, reliable data were less likely to be returned by boys, overweight/obese children, those who were not white, mixed or ‘other’ ethnicity, younger mothers, mothers without a degree, families with only one parent, households with just 1 or more than 3 children, children who lived in rented accommodation, had been breastfed or had a limiting illness or disability and children from disadvantaged wards.
Children who exercised less than twice a week, according to the parent-proxy report of physical activity, were less likely to return reliable accelerometer data.
Strengths and limitations of this study
This is the first large-scale accelerometer study using a postal distribution methodology to investigate the predictors of non-response associated with study non-consent and non-receipt of reliable data.
A wide range of biological, social, behavioural and environmental factors are investigated as potential predictors of non-response. But our findings may not be directly applicable to different ages.
The development of accelerometers enables the frequency, intensity and duration of free-living activity to be measured objectively in large-scale population studies. The majority of previous large scale accelerometer studies have demonstrated the use of the activity monitor to participants and distributed them in the context of a face-to-face meeting within a clinic1–3 or school setting.4–17 Although effective, the cost and time constraints of this data collection method can be substantial, particularly in large studies where subjects are geographically dispersed. The use of postal methods to distribute and return accelerometers can achieve higher population coverage than face-to-face administering and return, while also potentially reducing time and financial costs. Despite this, there are no large-scale accelerometer studies in UK children that have used this method.
Although non-response is a problem for nearly all large-scale studies, the use of a postal methodology may increase data loss and potentially introduce bias into study findings. Lack of face-to-face contact with researchers may reduce motivation for participation, or involve uncertainty for participants relating to the accelerometer wear or return protocol. There is also a dependence on external factors such as an efficient postal service and relying on subjects to return their accelerometers.
Few studies have examined predictors of consent in large-scale accelerometer studies in children. In those available, only the effects of gender17 and ethnicity5 have been investigated. No large-scale accelerometer studies using postal distribution methods have evaluated predictors of consent, and only one has evaluated differences between children who did and did not return reliable data.18 Gender, age and ethnic differences between children who did and did not provide reliable accelerometer data are well investigated in studies using face-to-face distribution methods,3 ,5 ,10 ,13 ,16 ,18–22 but the findings are inconsistent, possibly due to differences in study design, accelerometer protocol or study populations. Further research is needed to determine the factors associated with non-response in large-scale studies using a novel postal distribution methodology. This would enable researchers to minimise non-response, and also reduce the effect of bias through modification of analytical methods (eg, weighting analyses to account for non-response). Therefore, the aim of this study was to investigate the biological, social, behavioural and environmental predictors of non-response resulting from study non-consent and non-return of reliable accelerometer data in a UK-wide postal study of children's activity.
The Millennium Cohort Study (MCS) is a UK-wide prospective study of the social, economic and health-related circumstances of British children born in the new century.23 All families who were claiming Child Benefit (all UK residents qualify for Child Benefit if they have children under 16 years) when their children were aged 9 months were eligible for sampling. A stratified clustered sampling design was employed to ensure an adequate representation of all four UK countries, disadvantaged areas and areas with high minority ethnic populations in England. The original cohort (MCS1) comprised 18 818 children (18 295 singletons; response rate 72%) whose parents were first interviewed at home when their child was aged 9 months.24 Three further home interviews have been completed, at ages 3, 5 and 7 years. At age 7, accelerometers were used to measure children's activity. All children were invited to wear an accelerometer and written consent was obtained from the parents/guardians of those agreeing. Parents/guardians who gave consent were given an explanation on how their child should wear the accelerometer and were asked to demonstrate correctly putting a ‘dummy’ activity monitor on their child. Interviewers also explained how and when they should expect to receive their child's activity monitor, and how and when they should return the monitor.
Levels and patterns of physical activity (PA) were measured using the Actigraph GT1M uni-axial accelerometer (Actigraph, Pensacola, Florida). The Actigraph has been extensively validated in children against observational techniques,25 heart rate telemetry,26 indirect calorimetry27 and energy expenditure measured by doubly labelled water.28 A 15 s sampling epoch was selected in order to optimise the ability to capture the sporadic nature of children's activity.29 Accelerometers were programmed using ActiLife Lifestyle Monitoring System software (V.3.2.11) to start collecting data at 05:00 2 days after posting. Accelerometers (attached to an elasticated belt) were posted together with a parent cover letter, an information leaflet, a timesheet, a letter for the child's class teacher and a prepaid envelope (for returning the accelerometer) to families via UK Royal Mail first class delivery. Families were asked to complete a timesheet to encourage accelerometer wear, recording the time the accelerometer was first put on in the morning and taken off at night, and any periods during the day when the accelerometer was not worn (including time spent swimming). Distribution occurred between May 2008 and August 2009. A free-phone telephone number was provided for families to call if they had any further questions. Families were sent translated versions of the documents if requested at the MCS home interview. Children were asked to start wearing their accelerometer the morning after they received it on their right hip for seven consecutive days during all waking hours, but were asked to remove it during all aquatic activities as these monitors are not waterproof. If children were unable to wear their accelerometer on the week requested, they were asked to return it so that it could be recharged and reprogrammed for a more convenient date.
Parents/guardians were asked to return the accelerometer and completed timesheet as soon as possible after the monitoring period in the prepaid envelope. On return of the accelerometer, families were sent a certificate and a set of graphs summarising their child's weekly activity, together with a letter thanking them for their involvement. Three postal reminder letters were sent at weekly intervals to those not returning their accelerometer within 3 weeks after issue. The third reminder letter included an additional prepaid envelope. Further weekly reminders were issued by text, email or phone call depending on the contact details held. A final reminder letter offered families a £10 incentive gift voucher for the return of their accelerometer.
Accelerometer data processing
Accelerometer data were processed using the package pawacc30 developed in the R software environment for statistical computing (V.2.15.0).31 Accelerometer non-wear was defined as any time period of consecutive zero-counts for a minimum of 20 min5 and counts ≥11 715 counts/min were excluded as these values were regarded as extreme.32 Children with a wear time period of ≥2 days lasting ≥10 h/day were considered to provide reliable data.33 Full details on data processing are given in Geraci et al34
All analyses were conducted in STATA/SE V.11.0 (Stata Corporation, Texas, USA) and weighted using MCS survey and non-response weights to account for attrition between contacts and adjusted to allow for the clustered sample design. All singleton children that took part in the fourth sweep of the MCS (MCS4) interviews were included in the analyses (n=13 681). Twins and triplets were not included in the analyses because data were unintentionally not coded to allow the interview and accelerometer data for twins (n=332) and triplets (n=30) to be accurately linked. Sample sizes and weighted percentages were calculated for the total sample, and stratified for consenting and non-consenting children, and for children who did and did not return reliable accelerometer data, according to the potential predictor variables. Potential predictor variables are reported in table 1, and were chosen based on prior research investigating non-response in previous large-scale accelerometer studies and the MCS4 interviews35 ,36 so that we could determine if the sample was biased according to factors typically associated with PA in children.24–26
All potential predictor variables were entered into unadjusted logistic regression models. p Values were obtained from adjusted Wald tests. Multicollinearity was investigated to determine which variables were to be included in the adjusted logistic regression models because several of the variables reported similar concepts. This was achieved by examining the bivariate correlations between all potential predictor variables, and calculating the variance inflation factors (VIF). The VIF is an index that measures how much the variance of an estimated regression coefficient is increased because of collinearity.38 VIF values were calculated using the formula 1/(1–R2) after regressing each potential predictor variable against all other variables (where R is the correlation coefficient between two variables); VIF values greater than 2.5 are often considered a matter of concern.38 Multicollinearity was evident between ‘maternal occupation’ (VIF=2.83) and ‘whether the mother was in work or not’ (VIF=2.54; correlation coefficient=0.78), and between ‘government office region’ (VIF=2.49) and ‘country’ (VIF=2.53; correlation coefficient=0.77). In each case, one of the pair of variables was removed from the model, one at a time, and the VIFs recalculated. The removal of ‘mother in work or not’ and ‘government office region’ reduced any signs of multicollinearity (ie, all variables had VIF<2.5).
All the remaining variables were entered into two separate adjusted logistic regression models to determine the predictors of data loss resulting from study non-consent and non-return of reliable data. p Values were obtained from adjusted Wald tests to determine differences between the regression coefficients.
A total of 14 043 children (13 681 singletons) took part in the fourth sweep of the MCS interviews (figure 1). Parents of 13 219 (94.1%) children (12 872 singletons) gave consent for their child to wear an accelerometer Accelerometers were sent to 12 625 (95.5%) consenting children (12 303 singletons); 29 (0.2%) children were not sent an accelerometer because the fieldwork team were unable to send it during the requested time period, and full contact details of the remaining 565 (4.3%) children were unavailable. We obtained reliable data (≥2 days lasting ≥10 h/day) from 6675 (50.5%) consenting children (6497 singletons). A total of 7004, 6326, 5910, 5153, 4002 and 2244 consenting children had ≥1, ≥3, ≥4, ≥5, ≥6 and ≥7 reliable days of data lasting at least 10 h/day.
Biological, social, behavioural and environmental factors were all associated with study consent (table 2). Pakistani/Bangladeshi children were almost half as likely to consent compared with white children. Several social factors were associated with non-consent including mothers not working, mothers without a degree (with the exception of those with no qualifications), households with only one child or an income of £10 400 or less, households that spoke another language apart from English, and children who did not have people smoking near them. Children with a limiting illness or disability were half as likely to provide study consent compared with those without a limiting illness or disability. Children who exercised less than once a week or had never been breastfed were also less likely to provide consent. Consent was also less likely for children from ethnic wards, or those who lived in Yorkshire and Humberside, London or Northern Ireland.
After controlling for other predictor variables, consent remained significantly less likely for children who did not have people smoking near them and children with an illness or disability that limited daily activity (table 2). Consent was also less likely for children who had access to a garden, and those who lived in Northern Ireland.
Reliable data acquisition
All variables in the unadjusted models were associated with reliable data acquisition except residential country (table 3). Within the sample who consented and were sent accelerometers, we were less likely to receive reliable data from boys, overweight/obese children and those who were not white or ‘other’ ethnicity. The social factors associated with non-return of reliable data included younger mothers (<30 at birth of cohort child), mothers not in managerial, professional, lower supervisory or technical occupations, or not educated to degree level, households with just one, or four or more children, or who spoke English and another language, children who had people smoking near them, or who lived in a flat or maisonette, and families who did not own their own home or had a household income of less than £31 200. Lone parents were half as likely to return reliable accelerometer data compared with two parent families. We were also less likely to acquire reliable accelerometer data from children with a limiting illness or disability, those who exercised 1 day a week or less, or watched TV for 3–5 h on weekdays or who had been breastfed. We were also less likely to acquire reliable data from children without access to a garden, children from disadvantaged or ethnic wards, and those who lived in North East or North West England, Yorkshire and Humberside, West Midlands, London, Wales, Scotland or Northern Ireland.
After controlling for other predictor variables, reliable accelerometer data acquisition was significantly less likely from boys, overweight/obese children and those who were not white, mixed or ‘other’ ethnicity (table 3). More social factors remained significantly associated with non-return of reliable data than with consent including younger mothers (<30 at birth of cohort child), mothers without a degree (excluding those with ‘other’ qualifications), lone parent families, households with just one, or four or more children and children that lived in any type of rented accommodation. We were also less likely to acquire reliable data from children with a limiting illness or disability, children who exercised once a week or less or had been breastfed and children from disadvantaged wards.
Summary of findings
In this nationally representative cohort of UK children, a high proportion of families (94.1% of children interviewed; n=13 219) agreed to take part in a study that used postal methods to distribute and return accelerometers in order to measure children's PA. The use of a postal methodology enabled the MCS to acquire a large volume of reliable accelerometer data (n=6675; 51% of consenting children).
A number of different factors were associated with study non-consent and non-return of reliable accelerometer data in a nationally representative cohort of UK children (table 4). More differences were observed for the return of reliable data than in the consent to participate, quite likely to be due to the very high consent rate. In particular, a number of biological and social factors were related to non-return of reliable data that were not associated with non-consent. Social disadvantage was more apparent in children who did not return reliable data than in non-consenting children.
Comparisons with existing research
Few accelerometer-based studies of children's PA have investigated correlates of consent.5 ,17 Van Sluijs et al17 and Owen et al5 investigated gender differences between children who consented to wearing an accelerometer in two large-scale studies. In contrast to our study, girls were more likely to consent than boys in the Sport, Physical activity and Eating behaviour: environmental Determinants in Young people (SPEEDY)17 study, whereas Owen et al5 found no ethnic differences between consenting and non-consenting children participating in the Child Heart Health Study in England.
Only one large-scale study using postal methods to distribute and return accelerometers has investigated predictors of reliable data acquisition.18 Janz et al18 found no differences between boys and girls according to the number of days of reliable data they provided. Other large-scale studies using face-to-face distribution methods have investigated potential predictors of reliable data acquisition using a range of factors, but the findings are inconsistent. In four studies, younger children were more likely to provide reliable accelerometer data than older children,3 ,20–22 whereas another three found no age differences.10 ,16 ,19 In agreement with our study, boys were less likely to provide reliable data than girls in the Avon Longitudinal Study of Parents and Children (ALSPAC)20 and the UK Children’s Health and Activity Monitoring Program.13 In contrast, the National Health and Nutrition Examination Survey3 and the SPEEDY study17 reported that girls were less likely to return reliable data than boys: no gender differences in reliable data acquisition were reported in several other studies.10 ,19 ,21 In contrast to our study, no ethnic differences according to reliable data acquisition were reported by previous studies.5 ,13 ,19 ,21 The majority of previous studies report that weight status was not related to reliable data acquisition.10 ,13 ,16 ,39 However, in agreement with our study, overweight children were less likely to return reliable data than non-overweight children in the ALSPAC,20 whereas overweight children were more likely to provide reliable data than non-overweight children in Project EAST19
Few studies have investigated behavioural predictors of reliable data acquisition.10 ,16 ,21 No previous studies have reliably investigated whether PA predicts non-response. However, the Physical Exercise and Appetite in Children Study reported that they were more likely to acquire reliable data from physically active children than those who were less active.10 In contrast, Sirard et al21 reported that PA levels did not predict whether children returned reliable accelerometer data. Both studies compared the PA levels of children who did and did not return reliable data; however, PA is not reliably estimated in children without reliable data. Only studies with an alternative measure of activity can accurately estimate PA differences in non-response. Few studies have investigated social and environmental factors as potential predictors of reliable data acquisition, although studies have looked at socioeconomic status,10 child deprivation,13 local and area independent mobility,16 child19 and parental17 education and free school meal status.22
Strengths and limitations
The MCS4 is the first large-scale longitudinal cohort study to objectively measure PA in a socially and ethnically diverse population of children from all four UK countries. This is also the first large-scale accelerometer study using a postal distribution methodology to investigate the predictors of non-response associated with study non-consent and non-return of reliable data. The MCS provided a range of biological, social, behavioural and environmental information on children, their families and their environment, which enabled us to simultaneously examine a broad range of potential predictors. As this is a contemporary cohort, the findings of this study are applicable to the lives of young children now. Furthermore, we have used a robust accelerometer wear time threshold to define children with reliable data.33
However, our findings may not be applicable to different ages. PA levels vary according to age, and children's PA is very different from adult's PA in many respects;3 it is therefore unlikely that without further research the findings of this study can be applied to adult populations. Age has also been shown to be related to the return of reliable accelerometer data in several studies.3 ,20–22 In addition, although the UK country of residence did not predict non-response in our study, our findings may differ in other studies involving samples of children living in non-UK countries.
Many of the predictor variables in this study were based on parent-report measures, and therefore recall bias may have influenced the information collected. For example, maternal reports of smoking near the child at the age 7 sweep may have been underreported, although any underestimate in this is likely to lead to an underestimate of the effect.40 However, the information collected within the MCS using parent-report methods has been shown to be valid and reliable.41 ,42 Non-consent for children who did not have people smoking near them may reflect highly protective parents. A small number of the MCS children had missing data for the predictor variables. Since the MCS has a large sample size, imputing data for these missing variables would only increase the sample size by a small proportion. Several factors that were not investigated within this study may also influence non-response, for example, who the cohort children were interviewed by, whether they were sent, or tried to return an accelerometer during a postal strike, or which reminder methods were sent to the family to encourage return of the accelerometer.
Recommendations for study practice and further research
This study has reported the biological, social, behavioural and environmental factors associated with non-response in a PA study using postal methods to distribute and return accelerometers. Researchers should be aware of these factors and recognise potential bias occurring as a result of this methodology so that future studies can implement strategies to reduce the threat of data loss. For example, we found that the language spoken by the cohort families at MCS4 did not influence consent. This may be because non-English speaking families were offered translated versions of all study documents, and a translator was made available at the study interview. However, consent was less likely from children living in Northern Ireland; this may be because a different fieldwork agency conducted the home interviews in Northern Ireland than in England, Wales and Scotland. Considerable efforts are required by researchers and parents to encourage boys, non-white and overweight/obese children to wear and return their accelerometer as requested so that we can acquire reliable data from these populations. Lone parents and families with a large number of children may not have returned their child's accelerometer because they forgot, or did not have the time to do so. Therefore, it is crucial that studies issue timely reminders throughout fieldwork, and in particular, to these populations. Caution should also be taken if sampling children with an illness or disability that limits daily activity as non-response was very high among these children and may therefore bias study findings.
Further research should be aimed at investigating whether the predictors of non-response identified in this study also predict non-response in other large-scale accelerometer studies across different age groups and countries, and in studies using different accelerometer distribution and return methods. If studies are unable to increase response in the populations identified in our study, then researchers need to be aware of their influence on the validity of findings, and control for these factors in associated analyses. An important finding was that children who were reported to exercise once a week or less were less likely to return reliable data. As a result, study findings may be biased as inferences about the PA levels of the population that are based on the observed sample may not be the same as those based on the target sample. However, the PA predictor variable was based on the parent-proxy report of their child's usual weekly frequency of sport or any other PA. The limitations associated with parent-proxy reports of children's PA have been well defined.43 Although it is beyond the scope of the study, several statistical methods to deal with missing data have been developed and their performance in reducing estimation bias depends on the quality of the models that underpin them.44 Current work is being undertaken to develop response propensity weighting adjustments in the MCS4 accelerometer study.
Researchers should be aware of factors associated with non-response in a large-scale accelerometer study that uses postal distribution and return methods so that future studies can implement strategies to reduce the threat of data loss. Accelerometer studies in children who use our postal methodology need to encourage data return from boys, overweight/obese and non-white children, mothers who are young or who have few qualifications, families with only one parent or a large number of children, children who exercise less than twice a week and children living in various forms of disadvantaged circumstances. If studies are unable to increase response in these sections of the population, then researchers should weight analyses to account for non-response.
The work of the accelerometer data collection team (Jane Ahn, Florence Kinnafick and Richard Pulsford) is gratefully acknowledged, as is the co-operation of the participating MCS families.
Contributors CR, LJG, MCB and CD were responsible for the conception and design of the study. CR carried out the statistical analyses and drafted the manuscript. MG generated and produced the accelerometer data processing software. MCB, FS and CR also made substantial contributions towards accelerometer data processing. HJ, as director of the MCS, worked with CD to raise the funding from the Wellcome Trust, and oversaw the CLS collaboration in the project. LC made substantial contributions towards the accelerometer fieldwork protocol. All authors contributed towards revising the manuscript and have approved the final manuscript.
Funding The MCS4 accelerometer study was funded by the Wellcome Trust (grant 084686/Z/08/A). The MRC Centre of Epidemiology for Child Health is supported by funds from the UK Medical Research Council (grant G0400546). Research at the UCL Institute of Child Health & Great Ormond Street Hospital for Children receives a proportion of funding from the Department of Health's National Institute for Health Research Biomedical Research Centres funding scheme. The Millennium Cohort Study is funded by grants to the Centre for Longitudinal Studies at the Institute of Education from the Economic and Social Research Council and a consortium of government departments.
Competing interests None.
Ethics approval Northern and Yorkshire Research Ethics Committee (REC number: 07/MRE03/32).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement The MCS data for surveys 1–4 are currently available via the Economic and Social Data Service; the MCS accelerometer data will be available at the beginning of 2013.
this is an open-access article distributed under the terms of the creative commons attribution non-commercial license, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. see: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.