Introduction

Physical inactivity is a major risk factor for mortality and for several chronic diseases, including type 2 diabetes [1]. Large cohort studies are required to examine the etiology of chronic disease outcomes among healthy individuals, and in large, multi-site prospective studies of physical activity in relation to chronic disease, self-report methods such as physical activity questionnaires (PAQs) are currently the most feasible method for assessing physical activity. PAQs are commonly used for practical reasons such as limiting cost and reducing participant and researcher burden, and PAQs have been used for several purposes, including international surveillance (e.g., the International Physical Activity Questionnaire [IPAQ] [2]), risk stratification (e.g., the EPIC Physical Activity Questionnaire [EPIC-PAQ] [3]), and etiologic investigation (e.g. the short European Prospective Investigation into Cancer and Nutrition [EPIC]-Norfolk Physical Activity Questionnaire [EPAQ2] [4]). However, PAQs may misclassify an individual’s physical activity level due to deliberate misreporting or cognitive limitations related to recall or comprehension [5, 6]. Therefore, it is necessary to examine the validity of any self-report instrument using independent criterion methods in a population representative of that in which it is used for answering epidemiological questions.

The EPIC study was designed to investigate the relationship of nutrition and cancer in over 500,000 individuals from 10 European countries [7]. At enrolment (1992–2000), study participants completed questionnaires assessing diet and lifestyle factors, including physical activity. Specifically, physical activity was assessed by a brief questionnaire (the short EPIC-PAQ) interrogating occupational, household, and recreational activities during the past year [8].

An initial evaluation of the validity of questions selected from a more extensive questionnaire used in a pilot study of the EPIC protocol that resembled questions interrogated by the short EPIC-PAQ was performed in the Netherlands [9]. The authors assessed the validity and reliability of these representative questions against physical activity reported on 3-day diaries and determined that although the absolute validity and reliability of the questions for estimating physical activity energy expenditure (PAEE) was poor, the questionnaire would be suitable for ranking physical activity levels.

Accordingly, two indices for categorizing physical activity levels have been derived from the short EPIC-PAQ, the “Cambridge index” [3] and the “total physical activity index” [10]. The validity of these indices for categorizing individuals’ physical activity levels has not yet been assessed in the EPIC cohort. Therefore, the aim of this study was to evaluate the validity of these indices for ranking physical activity among adults from the 10 countries participating in the EPIC-Europe study using combined heart rate (HR) and movement sensing as the criterion. We also examined the validity of a newly-derived index considering only recreational physical activity.

Methods

Study population

In each of twelve centres across ten countries (Aalborg, Denmark; Paris, France; Potsdam, Germany; Athens, Greece; Florence, Italy; Bilthoven and Utrecht, Netherlands; Tromsø, Norway; Murcia and San Sebastian, Spain; Umeå, Sweden; Cambridge, UK), a sample of approximately 200 healthy individuals of a centre-specific age and gender distribution similar to that of the original EPIC-Europe cohort [7] was recruited. In accordance with the original EPIC-Europe design, healthy, middle-aged men and women were recruited in all centres, with the exception of France and Norway, where only women were included. The response rate varied across study centres from 37% in Norway to 97% in Italy, and retention of enrolled participants for the duration of the study was ≥87% in all study centres.

Study design

The study consisted of two visits held four to 5 months apart (mean time between visits = 4.53 months; SD = 1.02) (Fig. 1). At each visit, height was measured with a rigid, portable stadiometer, and weight was measured using a standard scale or a bio-impedance scale (Tanita®). Participants completed a general questionnaire that merged the Rose Angina Questionnaire [11] and the Physical Activity Readiness Questionnaire [12] to determine eligibility to engage in a sub-maximal physical activity calibration test (step test). In some study centres, a resting electro-cardiogram (ECG) was administered as an additional safety measure.

Fig. 1
figure 1

Study design: the EPIC-PAQ validation study

To standardize the study protocol across centres, the MRC Epidemiology Unit held a 2-day training workshop in Cambridge, UK, for the field workers from each study location (March 2007). For quality control, MRC Epidemiology Unit staff also visited study centres during the testing phase (March 2007–December 2008). Each centre obtained ethical approval from a local ethics board prior to participant recruitment, and informed consent was obtained from all participants.

Objective physical activity measurement methods

Eligible participants were fitted with a combined HR and movement sensor (Actiheart, CamNtech, Cambridge, UK), which was attached to the chest via two standard ECG electrodes [13]. An 8-min, ramped step test using a 200-mm step (Reebok, Lancaster, UK) was then performed to determine the individual relationship between HR and workload [14]. The equation for the relationship between PAEE and heart rate from the step test (3865 tests) was as follows;

PAEE [J/min/kg] = (6.22−0.003 * age + 0.28 * sex−0.0062 * SHR) * HRaS + 0.21 * age + 3.9 * sex−0.97 * SHR−31.8 (age in yrs, sex coded as 1 for men and 0 for women, SHR is sleeping HR in bpm, HRaS is HR above SHR in bpm).

Specifically, participants were asked to step up and down following a timed voice prompt at a step frequency that began at 15 body lifts per minute (60 steps/min) and increased linearly to a maximum of 33 lifts per minute, immediately followed by a 2-min seated recovery phase. Following the step test, the combined HR and movement sensor was initialized for long-term recording summarized into 1-min epochs, and participants were instructed to wear the monitor continuously for a minimum of 4 days of free-living data collection.

Data collected during free-living was downloaded to a PC and the HR trace was processed using a robust Gaussian Process regression method to handle potential measurement noise [15]. Activity intensity (J/min/kg) for each time point was estimated from the combination of movement registration and individually calibrated HR [14] using a branched equation framework [16]. Periods of non-wear were inferred from the combination of non-physiological HR and prolonged periods of inactivity, which were taken into account to minimize diurnal information bias when summarizing the intensity time-series into PAEE (kJ/kg/day) and time spent in moderate-to-vigorous intensity physical activity (minutes of MVPA/day). The intensity threshold for MVPA was set at 3 metabolic equivalent task units (METs), with 1 MET defined according to the Oxford resting metabolic rate equations [17].

Finally, we excluded measurement periods with less than 24 h of data and averaged daily estimates of PAEE and of MVPA from the two 4-day measurements. 11 individuals (9 women and 2 men) were excluded as they did not provide valid data. PA outcomes were weighted to account for divergence from the optimum monitoring duration of two 4-day measurement periods (i.e., individuals with at least 4 + 4 days were weighted 1.0, whereas those with fewer days were weighted less, e.g. an individual with 4 + 3 days was weighted 7/8).

Self-report physical activity methods (EPIC-PAQ)

The second visit followed the same protocol as the first visit, with the additional administration of the short EPIC-PAQ [3]. The English version of this PAQ has been published previously [3, 10]. Prior to objective monitoring of free-living physical activity, participants completed the EPIC-PAQ, which was administered by each centre in a format similar to the original EPIC administration, i.e., self-report (Denmark, France, Italy, the Netherlands, Norway, and the UK) or interview (Germany, Greece, San Sebastian and Murcia [Spain]). The PAQ administered in Sweden differed slightly from the EPIC-PAQ completed at other sites and is described separately (see below).

The EPIC-PAQ is comprised of four questions interrogating physical activity during the last year. The first question asks participants to indicate which category of occupational activity (sedentary, standing, manual work, heavy manual work) best defines their current job. As the EPIC-PAQs in Denmark and Sweden allowed for multiple responses, responses were collapsed into the four occupational activity categories above by taking the rounded-down average of all selected occupations, if any. Question two interrogates participation in several activities (walking, cycling, do-it-yourself [DIY], gardening, sports, and household chores) during both summer and winter, the third question asks about participation in vigorous non-occupational activities, and the fourth question assesses the number of floors of stairs climbed up per day, all referencing the past year.

From responses to these questions, participants were categorized into four physical activity levels (inactive, moderately inactive, moderately active, active) using the previously developed “total physical activity index” based on occupational activity and the duration of time spent in household chores and recreational activity [10] and the “Cambridge index” based on occupational activity and the duration of time spent in sports and cycling [3], as well as a newly developed “recreational index” (Table 1), as follows.

Table 1 Definitions of physical activity indices from the European Investigation into Cancer and Nutrition-Physical Activity Questionnaire (EPIC-PAQ)

We computed the total physical activity index according to previous recommendations [3, 10]. Briefly, to denote activity intensity, we assigned MET-values using standard methods [18]: 3.0 for walking and household activities; 4.0 for gardening; 4.5 for DIY work; 6.0 for cycling and sports; 8.0 for stair climbing; 9.0 for vigorous activity. To assign participants into one of the four physical activity levels of the total physical activity index, we cross-tabulated the four occupational categories with quartiles of sex-specific MET-h/week of total household and recreational activity, calculated as the sum duration of each activity from question two, averaged for summer and winter and multiplied by the corresponding MET-value.

The Cambridge index includes four categories of the sum duration of cycling and sports (h/week), cross-tabulated with occupational physical activity categories to assign participants into one of the four physical activity levels [3]. In addition, we calculated a recreational index based on quartiles of total MET-h/week from walking, cycling, and sports activities, to reflect modifiable physical activities.

In Umeå (Sweden), the PAQ inquires about occupational and leisure time activity during the past 3 months. Due to differences in this PAQ relative to the other EPIC centres, we did not compute a total physical activity index for this centre. The Umeå index was therefore based on the cross-tabulation of occupation (4 categories) and exercise (collapsed from 5 into 4 categories: never/non-regular; 1–2 times/week; 2–3 times/week; >2–3 times/week), which categorized individuals into one of four physical activity categories similar to the Cambridge index (inactive, moderately inactive, moderately active, active). Finally, the “recreational index” in Umeå was based on responses to the question on exercise participation.

Statistical methods

We present the characteristics of participants in each country using means and standard deviations for continuous variables and frequencies and percentages for categorical variables. Physical activity from the combined HR and movement sensor is described as medians and inter-quartile ranges (IQR), and the Kruskal–Wallis test was used to determine differences in physical activity by gender and by country.

For each country, the Pearson (r) and Spearman (σ) correlation coefficients were used to examine correlations of the total physical activity index, the Cambridge index, and the recreational index with PAEE and MVPA measured by the combined HR and movement sensor. Fisher-transformed correlations were estimated for each country, and random effects meta-analysis methods were used to calculate the combined correlation across countries. Heterogeneity across countries in the association of each physical activity index with PAEE and MVPA was evaluated by Forest plots and was assessed using the I-squared (I2) statistic. To examine heterogeneity in the association of each physical activity index with log-transformed PAEE and MVPA by age, gender, body mass index (BMI), and occupational status, we added the corresponding interaction term in multiple linear regression models and tested the significance of the interaction term.

We assessed the ability of the three indices to rank physical activity by calculating the mean PAEE and mean MVPA from the HR and movement sensor per activity category and then evaluating the P value for linear trend by general linear modelling across the four categories of the index. For each index, we also determined the mean energy difference (kJ/day) between each category of the index. All statistical tests were two-sided with significance defined as a P value <0.05, and all analyses were performed using SAS version 9.1 (Cary, North Carolina) except for the random effects meta-analysis, which was performed using STATA version 10.0 (StataCorp, College Station, TX).

Results

The study population included 1,941 participants with an average age of 53.8 years (SD = 9.4) and an average BMI of 25.8 kg/m2 (SD = 4.1). Women comprised the majority of the study population (70%), and they were younger (P = 0.018) and leaner (P < 0.001) than the men (Table 2). The mean age of participants at baseline varied across countries, ranging from 49.8 to 61.1 years for men and from 47.6 to 59.4 years for women. Compared with other countries, mean BMI was lowest among men and women from the Netherlands (23.5 and 22.6 kg/m2, respectively), while men and women from Greece had the highest mean BMI (27.8 and 27.0 kg/m2, respectively).

Table 2 Participant characteristics at baseline (mean, SD [standard deviation]), the EPIC-PAQ Validation study cohort (N = 1,941)

On average, participants wore the combined HR and movement sensor for 4.9 days (SD = 1.11) and 4.8 days (SD = 1.10) during the two respective measurement periods. Table 3 displays the median PAEE and time spent in MVPA. We observed heterogeneity in PAEE and MVPA across countries (P < 0.001), with the greatest PAEE among men in the Netherlands (median PAEE = 54 kJ/kg/day) and women in Spain (median PAEE = 46 kJ/kg/day) and the most time spent in MVPA among men in Sweden (median MVPA = 112 min/day) and women in the Netherlands (median MVPA = 88 min/day). Overall, PAEE (P value <0.001) and time spent in MVPA (P value <0.001) was greater for men than women.

Table 3 Physical activity energy expenditure (PAEE, kJ/kg/day) and moderate-to-vigorous activity (min/day) from the combined heart rate monitor and movement sensing

Over 40% of participants reported working in a sedentary occupation, and a substantial proportion of participants in Greece (45%) and the Netherlands (48%) were categorized as unemployed (retired or not currently working) (data not shown). Overall, women reported spending more time walking, in sports, and doing housework (P <0.05) compared with men, while men spent more time than women in home improvement activities (P <0.001) (data not shown).

Figure 2 shows the correlations between PAEE, MVPA, and the three self-reported indices of physical activity. Overall, we observed stronger correlations between PAEE and the Cambridge index (r = 0.33, 95% CI 0.28,0.38) compared with the total physical activity index (r = 0.14, 95% CI 0.04,0.24) and the recreational index (r = 0.22, 95% CI 0.16,0.28). We observed significant heterogeneity across countries in the correlations of the total physical activity index (I2 = 80.5%, P <0.001) and the recreational index (I2 = 48.5%, P = 0.04), but not the Cambridge index (I2 = 36.3%, P = 0.12). The overall correlation with time spent in MVPA was slightly stronger for the Cambridge index (r = 0.25 [95% CI 0.21,0.29] vs. r = 0.23 [95% CI 0.17,0.29] and r = 0.11 [95% CI 0.01,0.21] for the recreational and total physical activity indices, respectively);only associations of MVPA with the Cambridge index did not appear heterogeneous across countries (I2 = 0.0%, P = 0.85).

Fig. 2
figure 2

Meta-analysis (Forest plots) of the association (Pearson correlation coefficients) of PAEE (ac) and moderate-to-vigorous activity (df) measured by the combined HR and movement sensor with three physical activity indices from the EPIC-PAQ, by country and overall

In general, Pearson and Spearman correlation coefficients were similar in magnitude across study locations (Supplemental Table 1). Associations of PAEE and MVPA with the total physical activity index and the Cambridge index showed statistically significant interactions with sex (P value for interaction <0.001), whereas associations with the recreational index did not differ significantly between men and women (P value for interaction = 0.38 and 0.25 for PAEE and MVPA, respectively). We did not observe heterogeneity in the association of PAEE or MVPA with any of the indices by occupational status.

Each physical activity index was positively associated with PAEE (Fig. 3), effectively ranking participants into levels of physical activity. Results were similar for men and women, and statistically significant trends were also observed for the association of each index with MVPA (Supplemental Table 2). We observed some variability in the difference in PAEE (kJ/day, adjusted for body weight) between levels of each physical activity index. The average absolute difference between categories for men and women, respectively, was 283 and 225 kJ/day for the total physical activity index, 457 and 364 kJ/day for the Cambridge index, and 247 and 197 kJ/day for the recreational index.

Fig. 3
figure 3

Mean PAEE (kJ/kg/day) from the combined HR and movement sensor stratified by each physical activity category (1 = inactive, 2 = moderately inactive, 3 = moderately active, 4 = active) from the short EPIC-PAQ (a “Total physical activity index”; b “Cambridge index”; c “Recreational index”)

Discussion

The EPIC-PAQ is suitable for assessing habitual physical activity levels of European populations. All three indices were all capable of ranking individuals into levels of PAEE and MVPA. Furthermore, the physical activity indices derived from the EPIC-PAQ performed similarly among adults of the age range (18–92 years) and BMI range (BMI = 16.2–46.5 kg/m2) included in our study population, and validity of the indices did not vary by employment status.

Of the three indices evaluated, the Cambridge index appeared to provide stronger associations with objectively-measured PAEE and did not show heterogeneity across European populations. The heterogeneity for the total PA index was mainly driven by results from Netherlands and France. We can only speculate why the total PA index performed less well in these countries. One possible explanation may include a systematic over-reporting of home activities, which is part of the total PA index, in low active individuals as measured by the criterion method. The heterogeneity observed for the recreational index was driven by the low correlation observed in the UK sample. This was partly explained by the low prevalence of participation in cycling and sport in the UK population.

The results for the Cambridge index correspond with a recent validation study of the short EPIC-PAQ in an Australian population, which observed slightly better correlation of the Cambridge index than the total physical activity index with accelerometer-measured physical activity [10].

A number of studies have demonstrated the utility of the Cambridge index in observational research. In a recent cross-sectional study of men and women from nine European countries [19], the Cambridge index was inversely associated with BMI and waist-to-hip ratio. In a prospective follow-up, this index predicted gain in waist circumference [20] and was also predictive of increased mortality in a prospective study of UK adults [21]. The results of our validation study confirm that the Cambridge index suitably ranks participants’ physical activity levels in etiologic study settings.

Previous studies also investigated the criterion validity of the short EPIC-PAQ in selected European populations. Pols et al. [9] found that questions from the extensive EPIC-PAQ representative of the short EPIC-PAQ questions were valid when compared with physical activity diaries (r = 0.26–0.81) among 126 Dutch men and women aged 20–70 years. However, activity diaries rely upon self-reporting of physical activity in a manner similar to PAQs, and therefore may not represent a suitable criterion method for assessing the validity of a PAQ since the measurement error associated with diaries may be correlated with the error from the PAQ.

In the UK, the Cambridge index was shown to correlate with objectively measured physical activity assessed by four repeat periods of 4-day HR monitoring (r = 0.28) in 173 middle-aged participants [3]. Objective methods such as HR monitoring and accelerometry avoid the issue of shared sources of error and bias seen with activity diaries, but these methods also have limitations in PAQ validation studies. For example, current objective methods do not identify the type of physical activity nor the context in which it is performed, and therefore cannot investigate the validity of specific domains of physical activity, which would be possible using diaries. In addition, HR monitoring is a less valid measure of energy expenditure during sedentary and light activity because HR may be influenced by factors other than body movement, e.g. ambient temperature, emotional stress [22]. Similarly, a single accelerometer attached to the waist or trunk is less accurate for measuring energy expenditure associated with certain activities such as cycling, swimming, or upper-body movements.

Combined HR and movement sensing has emerged as a method to circumvent some of the limitations of the two respective methods and is a valid criterion measure for quantifying PAEE [2325]. Integrating HR with accelerometry offers benefits over the methods used as criterion measures of physical activity in previous validation studies of the EPIC-PAQ [4, 9, 10]. In addition, the combined sensor is worn continuously to avoid exclusion of water-based activities and sleeping time (as is often the case when using only an accelerometer on a waist belt). Precision of the energy expenditure estimate is further enhanced by individual calibration of the HR response to exercise [14, 26].

The estimated difference in measured PAEE, which effectively separated the four categories of self-reported activity from the Cambridge index, was about 460 and 365 kJ/D in men and women, respectively. Although these results should be interpreted cautiously, the observed difference is equal to the PAEE associated with about 20 min of brisk walking and may be useful when estimating effect sizes in observational research from studies using the short EPIC-PAQ.

Our study was conducted in a population selected to be representative of the original EPIC-Europe cohort within which the EPIC-PAQ was administered at baseline. The large size of our study population (N = 1,941), the inclusion of participants from ten European countries, and the standardization of study methods across countries are among the strengths of our study. Furthermore, we measured physical activity by combined HR and movement sensing for ≥4 days on two occasions separated by 4–5 months, and thus likely captured a wide range of usual physical activity patterns across European populations.

However, daily variability in physical activity, particularly differences between weekdays and weekend days, might have been better captured by one full week of physical activity monitoring, and within-individual seasonal differences in physical activity would be better assessed by more than two measurement periods [27]. Another limitation of our study includes the potential misclassification of participants’ physical activity levels based on occupational physical activity, as individuals who did not report current occupational activity were included in the lowest occupational activity category for the Cambridge index (Table 1b). However, correlations of the Cambridge index with objectively-assessed PAEE and MVPA were similar (r = 0.32 and r = 0.26, respectively) when we excluded participants with no reported occupational activity.

In conclusion, the EPIC-PAQ provides a brief, global assessment of habitual physical activity, and can be used to discriminate between levels of usual physical activity by means of the physical activity indices herein described. Our results suggest that the EPIC-PAQ, and the Cambridge index in particular, is suitable for ranking habitual physical activity of individuals across European populations. The difference in PAEE between categories may be useful when estimating effect sizes from observational research.