Article Text

Download PDFPDF

Adapting data collection methods in the Australian Life Histories and Health Survey: a retrospective life course study
  1. Hal Kendig1,2,
  2. Julie E Byles1,3,
  3. Kate O'Loughlin1,4,
  4. James Y Nazroo1,5,
  5. Gita Mishra6,
  6. Jack Noone4,
  7. Vanessa Loh1,4,
  8. Peta M Forder3
  1. 1ARC Centre of Excellence in Population Ageing Research (CEPAR), Sydney, New South Wales, Australia
  2. 2Centre for Research on Ageing, Health, and Wellbeing, Research School of Population Health, Australian National University, Canberra, Australian Capital Territory, Australia
  3. 3Research Centre for Gender, Health and Ageing, School of Medicine and Public Health, Faculty of Health, University of Newcastle, Callaghan, New South Wales, Australia
  4. 4Ageing, Work and Health Research Unit, Faculty of Health Sciences, University of Sydney, Sydney, New South Wales, Australia
  5. 5School of Social Sciences, University of Manchester, Manchester, UK
  6. 6School of Population Health, University of Queensland, Herston, Queensland, Australia
  1. Correspondence to Professor Hal Kendig; hal.kendig{at}anu.edu.au

Abstract

Objective Ideally, life course data are collected prospectively through an ongoing longitudinal study. We report adaptive multimethod fieldwork procedures that gathered life history data by mail survey and telephone interview, comparable with the face-to-face methods employed in the English Longitudinal Study on Ageing (ELSA).

Design The Australian Life Histories and Health (LHH) Survey was a substudy of the Australian 45 and Up Study, with data collection methods modified from the ELSA Study. A self-complete questionnaire and life history calendar were completed by the participants, followed by a computer-assisted telephone interview recording key life events.

Results The LHH survey developed and tested procedures and instruments that gathered rich life history data within an ongoing Australian longitudinal survey on ageing. Data collection proved to be economical. The use of a self-complete questionnaire in conjunction with a life history calendar and coordinated computer-assisted telephone interview was successful in collecting retrospective life course information, in terms of being thorough, practical and efficient. This study has a diverse collection of data covering the life course, starting with early life experiences and continuing with socioeconomic and health exposures and outcomes during adult life.

Conclusions Mail and telephone methodology can accurately and economically add a life history dimension to an ongoing longitudinal survey. The method is particularly valuable for surveying widely dispersed populations. The results will facilitate understanding of the social determinants of health by gathering data on earlier life exposures as well as comparative data across geographical and societal contexts.

  • Epidemiology
  • Public Health
  • Statistics & Research Methods

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • This study adapted traditionally resource-intensive data collection methods to more economically collect comprehensive life course data from geographically dispersed participants by utilising a combination of a self-complete questionnaire, a life history calendar and a computer-assisted telephone interview.

  • Although the Life Histories and Health Survey collected life history data retrospectively, the use of a life history calendar to aid recall enabled the collection of detailed life history data that would not otherwise have been collected for this early cohort of Australian baby boomers.

  • This study provides a unique opportunity to examine the influence of social structures and policy frameworks around health and well-being, allowing for comparisons between those who spent their entire lives in Australia and England, and English migrants to Australia. The study will investigate gender differences over the life course with respect to chronic disease, mental health and socioeconomic position.

  • This study may not be representative of all Australians (sampled from the state of New South Wales only). However, the data collected reveal a good variation in each of the study variables with differing experiences reported for life-long health and family structure across varying socioeconomic circumstances.

  • Overall, this study can contribute to our knowledge of the role of earlier life events on health and well-being outcomes for the early cohort of baby boomers in Australia.

Introduction

Governments in many countries are now focusing on how the postwar baby-boom cohort will age relative to earlier cohorts, given the different experiences they will bring to later life. Globally, there is an increasing attention directed towards understanding the impact of life-long socioeconomic opportunities on the resources and vulnerabilities accumulated over the life course to help identify effective points and strategies of intervention.1 This growing policy interest in the social determinants of health underscores the importance of societal factors in health and well-being and the ways in which cross-national comparisons can shed light on them.2

The associations between health and socioeconomic status (SES) are widely known.3–6 Life course research suggests that social and environmental disadvantage in childhood7–9 and midlife10 may be associated with continuing health inequalities in later life. Looking beyond health outcomes, a cross-sectional study of older Australians found that former occupation, education, income and home ownership were independently related to physical and social activity.11 Examining life course data may illuminate the causal factors underlying cross-sectional associations between social determinants and life outcomes. The life course research framework provides the capacity to examine the relationships between individual life experiences and changing social structures, and subsequent influences on health, well-being and productivity in later life.12 The pathways taken by individuals through life intersect with historical time and place to provide a framework for analysing the ‘longitudinal accumulation’ of transitions and events and their impacts on later life circumstances.8

The ideal method for collecting life course data is through a prospective longitudinal study using repeated measures across time.13 However, these methods cannot be applied when the cohort of interest is already older and there is no readily available source of retrospective data. In such life course studies, retrospective data are collected to obtain detailed information across multiple domains and events.14 Although collected at one point in time, these data can be scheduled across different time periods to simulate multiple observations that allow analysis of the coincidence and scheduling of time-varying covariates, and the modelling of transitions and trajectories in social and health states.15 Life history calendars (also known as life event or life grid calendars) have been shown to be effective in reducing recall bias and improving data quality in retrospective studies by providing a graphical time line that helps participants to anchor their responses in relation to different life stages and events.14 ,16–18 Such calendars have been used in the German Life History Study,19 the Panel Study of Income Dynamics in the USA,20 as well as the English Longitudinal Study on Ageing (ELSA),21 which was also used as the model for this study.

The Australian Life Histories and Health (LHH) Survey was based on two major ongoing cohort studies: the Sax Institute's Australian ‘45 and Up Study’ and ‘ELSA’. The LHH Survey was conducted as a substudy within the 45 and Up Study. Using Australia's national public health insurance database (Medicare), the 45 and Up Study recruited over 260 000 residents aged 45 years and older from the state of New South Wales (NSW), Australia. The study participants were invited to self-complete a questionnaire collecting demographic, lifestyle and health-related data, and provide consent for follow-up and linkage to a range of health databases. The methods and study sample have been described elsewhere.22 ELSA is a multidisciplinary cohort study that has collected information on the mental and physical health and socioeconomic circumstances for a representative national sample of English people aged 50 years and over since 2002.23 The advancement of ELSA's life history module was based on extensive work concerning the nature of memory and recall, supporting the use of life history calendars to collect accurate retrospective data.16 ,24

Life history calendars were used in ELSA in conjunction with face-to-face computer-assisted personal interviews (CAPI). While CAPI techniques for survey data collection are seen as the gold standard for research, they are resource-intensive and costly. In contrast, data collection using computer-assisted telephone interviews (CATI) require fewer resources, but remain relatively untested within a life course history framework. Face-to-face data collection was not a viable option in our study due to the geographical dispersion of study participants and cost inefficiencies. We adapted the ELSA data collection method by using life history calendars with CATI and the addition of a self-complete questionnaire. Previous research has shown that using life history calendars in CATI produce more accurate retrospective reports than conventional questionnaires.25

The LHH Survey aimed to collect retrospective data on social and health circumstances from birth and throughout adulthood to better understand how socioeconomic and individual circumstances across the life course and changing social structures might affect health, well-being and productivity outcomes in late middle age. This article describes the adaptation of ELSA's CAPI data collection procedures through the combined use of a self-complete questionnaire and CATI utilising a life history calendar as a memory aid.

Methods

The first objective was to redesign data collection from the CAPI-only mode to a questionnaire-plus-CATI mode. This approach was taken to reduce the participant's time spent on the telephone, to allow the participants to answer some questions in their own time as well as reducing financial and logistic costs for developing and delivering lengthy telephone interviews. The second objective was to adapt ELSA's life history interview questions for the Australian sample by removing or translating culturally or historically unsuitable items. The third objective was to develop a pen-and-paper life history calendar, which initially covered work, family, health and accommodation histories. As in the ELSA life history interview, LHH participants filled out the life grid in preparation for the follow-up interview. Some of the reminder events used in the ELSA life history calendar were adapted for the Australian context (see figure 1 for an example page from the LHH life history calendar).26

Figure 1

Example page from the life history calendar used in the, Life Histories and Health Survey.

Feasibility, pre-test and pilot studies

Testing of the study procedures began with a feasibility study in 2008 and was refined through a pretest study in 2010 and a pilot study in early 2011. The feasibility study was conducted to investigate the viability of collecting life course data through a combination of self-complete questionnaire and a telephone interview. A key objective in developing the study protocol was to achieve a balance between the time needed to gather extensive life history and health information and minimising the participant's fatigue during the telephone interview. The participants completed the questionnaire first and were then requested to fill in the life history calendar prior to the telephone interview. During the interview, the participants were asked to use the life history calendar as a memory aid when reporting their history information. The telephone interview was guided by structured questions and reflected the content requested in the life history calendar.

Following the feasibility study, the data collection instruments were revised and used in a pretest in 2010 to formally evaluate the CATI implementation. Further modifications were made to the data collection instruments and survey process before the pilot study was conducted in 2011. Table 1 summarises the aims and procedures for the feasibility, pretest and pilot studies, outlining the key decisions that were made at each step in the development of the survey protocol. The self-complete questionnaire, life history calendar and CATI remained unchanged after the pilot study.

Table 1

Summary of the development of study procedures and data collection instruments for the LHH Survey through the feasibility study, the pretest study and the pilot study

Main study

Participants

People were eligible to complete the LHH Survey if they were born between 1947 and 1951 (ie, baby boomers aged 60–64 in 2011), and had completed the baseline 45 and Up questionnaire in 2008, but had not taken part in a prior substudy. Based on the pilot study response rate, 2800 eligible people from the 45 and Up Study were invited to participate (stratified by gender and UK migrant status, see figure 2).

Figure 2

Flow diagram illustrating Life Histories and Health sample selection from within the 45 and Up Study framework.

Procedures

Data were collected from October 2011 to February 2012. Survey packs containing a participant information sheet, consent form, self-complete questionnaire, life history calendar and a postpaid reply envelope were sent by an external organisation specialising in postal surveys. The first mail-out wave included 1600 invitees, with a subsequent mail-out 2 weeks later for the remaining 1200 invitees. A reminder postcard was sent to non-responders 3 weeks after the initial mail-out and a replacement questionnaire was sent 3 weeks after the reminder postcard. Completed questionnaires and consent forms were returned by 1508 participants with an additional 70 invitation packs received marked ‘Return to sender’.

The final set of 1261 LHH participants provided consent to participate, sent back a self-completed questionnaire and participated in the follow-up telephone interview, reflecting an overall response rate of 45%. Follow-up interviews took an average of 26 min to complete (range: 15–70 min). Seventy participants had either lost or not completed their life history calendar when they were contacted for the follow-up interview. They were sent another life history calendar if needed and their interviews were rescheduled. There were 247 participants who completed the self-complete questionnaire, but did not participate in the follow-up interview. Compared with complete responders, the 247 participants who did not participate in the follow-up interview did not differ in current or childhood self-rated health, education, marital status or birth country (data not shown).

Measures

The measures used in the LHH project were largely based on those used in the ELSA life history interview27 and the baseline 45 and Up Study28 survey.

Self-complete questionnaire

In addition to standard demographics, the self-complete questionnaire included measures of childhood SES, relationship or bonding with parents,29 family composition and traumatic events across the life course. The self-complete questionnaire also contained measures of life-long health including birth weight, childhood hospital visits, long-standing illness and chronic disease across the life course, as well as measures relating to the participants’ current status covering self-rated health, psychological health,30 limiting pain and physical mobility. Outcome measures such as life satisfaction,31 quality of life32 and unpaid productivity were also included.

Telephone interview

The follow-up telephone interview collected life history data about paid work, non-paid work, residential locations and personal relationships with survey participants’ using their self-completed life history calendar as a memory aid. For each participant, every suburb (or country if overseas) they had lived in for 6 months or longer was recorded, with corresponding dates of residence. The participants also identified the number of years spent in personal relationships lasting 6 months or longer and the years in which these relationships occurred.

Paid work histories were given particular attention as these inform the measures of SES throughout adulthood. Details were recorded about each employment period lasting 6 months or longer, the sector (public vs private) and type (self-employed or not). The participants were asked whether each employment position involved heavy labour or physically demanding work, shift work, occupational hazards and whether they left the position due to poor health. Periods out of paid work were also noted, as well as the activities undertaken during this time (eg, caregiving). In addition, the participants identified which of their employment positions had made the ‘most significant contribution to [their] financial resources—the one that helped [them] get ahead in life.’ The participants were asked how many people (if any) they were responsible for and the level of education required for that position. The participants were also asked about their partner's current employment position.

Results

Participant characteristics

Table 2 presents the characteristics of the LLH participants and comparisons with age-matched participants in the 45 and Up Study, and the general Australian population using 2011 census data where available. Employment status in the LHH Survey was consistent with Australian census data, but the LHH participants tended to report higher educational qualifications and better self-rated health compared with the Australian population. The distributions for gender and birth country were influenced by the sampling framework and are provided for context.

Table 2

General characteristics of the LHH Survey participants compared with 45 and Up Study participants and the Australian population aged 60–64 years old

While there was some under-representation in terms of individuals with lower SES, as indicated by education and occupation, there were significant numbers of respondents across the full range of these variables for our analytical purposes.

Life course data summary

Figure 3 provides a summary profile of the participant's responses for different life stages across multiple domains. In terms of childhood SES, there was heterogeneity in father's occupation: one-third of them stated that their mother was in paid work during their childhood, and most of the participants reported modest housing with a few amenities and shared bedrooms. On average, the participants held 6.7 jobs over their life course and have spent 37 years in paid work.

Figure 3

Summary profile of the life course data collected from the Life Histories and Health Survey participants (n=1261).

Family variables include early life information on parental bonds and childhood separation, and time-specific information on major life events including death of parents, adult relationships, children, divorce or separation, and other traumatic events. Many participants experienced traumatic events in childhood, with 37.7% reporting at least one traumatic event and 13% experiencing separation from their mother prior to age 16. In adult life, the participants reported an average of 1.4 married or de facto relationships with 37.8% having been divorced or separated.

Missing data

Levels of missing data were generally relatively low and this was particularly apparent for work, health and accommodation histories, which are the key components of this study collected using the life history calendar and CATI combination. Certain items from the self-complete questionnaire had higher rates of missing data. For example, although 24% of participants reported experiencing severe financial hardship, only 64% of these people indicated the age at which the event was first experienced; this response pattern was similar for each traumatic event assessed. Health histories were also assessed in the self-complete questionnaire, but the data were more complete. For example, of the 9% of participants who had been diagnosed with heart disease, 86% recorded their age at diagnosis; and missing data were higher for weight at birth (23%) than for current weight (3.6%).

Analysis strategy

Planned analyses will identify how socioeconomic factors throughout life act independently, cumulatively and interactively to influence health and well-being outcomes in later life.33 ,34 Three types of hypothesised causal models, such as (1) critical period model; (2) sensitive period model and (3) accumulation model, will be analysed using a series of nested multiple regression analysis models.34 These models examine how socially patterned exposures and inequalities throughout the life course can influence health risks and socioeconomic position in late middle age. Social mobility will be used to describe the intrageneration and intergeneration variability in social status.35

As a second stage of the project, LHH and ELSA data will be harmonised to test hypotheses on how variation in the cross-national social, economic and policy contexts may have influenced exposures and outcomes earlier in life.

Discussion

The LHH Survey was designed to collect detailed life history data to better understand the role of earlier life events on health and well-being outcomes for the early cohort of baby boomers in Australia. For many studies, the requirement of collecting useful data (eg, accurate, thorough and relevant) must be balanced against the logistics of data collection (eg, cost, convenience). Our study collected important information on the life course determinants of health in a relatively resource-efficient manner. The extensive pretesting and piloting resulted in relatively low levels of missing data and high interview completion rates in the main study. The sample characteristics of the main study were broadly comparable with the broader Australian population and covered a wide range of socioeconomic characteristics with some under-representation of lower education and non-English-speaking migrants. These factors indicate that the study was successful in adapting the ELSA life history module into a postal self-complete questionnaire and follow-up telephone interview to reach geographically dispersed participants.

The implementation of a pen-and-paper life history calendar that participants retained as a memory aid for the follow-up telephone interview was vital for the adapted data collection method used in our study. Rescheduling the follow-up interview if the participant had lost or not completed their life history calendar appeared to contribute to the high rate of completed interviews while also keeping the interview duration to an acceptable level. Throughout each stage of the survey development, the interviewers and participants acknowledged the importance of the life history calendar as a memory aid for gathering life history information. In addition, using the self-complete questionnaire also reduced the length of the telephone interview, reducing operational costs as well as participant interview fatigue.

The primary strength of this project is the richness of the data and resultant potential for answering complex research questions. For example, comparisons between those who spent their entire lives in Australia and England, and English migrants to Australia, will give us a unique opportunity to examine the influence of social structures and policy frameworks around health and well-being. Our group of English migrants will provide particularly valuable insights into how health is influenced by early life experiences (in their country of origin) in contrast with life exposures in Australia as their country of destination. Analyses addressing these and other key research questions are currently underway.

As a substudy of the ongoing 45 and Up Study, the LHH Survey participants may be followed over time to determine how earlier socioeconomic trajectories can influence health and well-being transitioning into older age. Incorporating baseline data from the 45 and Up Study also provides an opportunity to investigate a series of different research questions relating to life histories. The baseline data include alcohol and tobacco use, diet and physical activity levels, which may function as explanatory factors linking socioeconomic trajectories to health outcomes in later life.

Despite the relative heterogeneity and representativeness of the main study sample, a few limitations should be noted. Although the sample comprises participants from urban and rural communities, the study recruited residents from the state of NSW, who may not be representative of all Australians. Comparisons with the Australian census data indicate that our sample is healthier and more highly educated than the general population. Although differential response rates may induce a bias into prevalence estimates, Mealing et al's36 estimates of exposure–outcomes relationships remained consistent in the presence of contrasting response rates. While it is difficult to evaluate whether subgroups of participants found the survey more challenging to complete (eg, those with lower education, or those who do not speak English as their first language), patterns of missing data were similar across participants. Figure 3 shows a good variation in each of the study variables with differing experiences reported for life-long health and family structure across varying socioeconomic circumstances. The data collected on participants’ work histories provide valuable information on SES at different time periods across the life course and allow for the assessment of social mobility over the life course and between generations.

This article has demonstrated the feasibility and value of life history data collection procedures and instruments that can economically increase the range of information collected on the socioeconomic context of ageing experiences over the life course. Systematic investigation of the varying temporal and societal context of ageing has the potential to widen understanding of the interplay between individual lives and changing social structures. This knowledge can inform action on the social determinants of health and optimal points in the life span and priority groups for social investments aimed at improving quality of life.

Acknowledgments

The authors thank Rosemary Cant, Rob Pedlow and the volunteer participants from National Seniors Australia and the Hunter Medical Research Institute (HMRI) for their involvement with the feasibility, pretest and pilot studies. This research was completed using data collected through the 45 and Up Study (http://www.saxinstitute.org.au). The 45 and Up Study is managed by the Sax Institute in collaboration with major partner Cancer Council NSW; and partners: the National Heart Foundation of Australia (NSW Division); NSW Ministry of Health; beyondblue; Ageing, Disability and Home Care, Department of Family and Community Services; the Australian Red Cross Blood Service; and UnitingCare Ageing. We thank the many thousands of people participating in the 45 and Up Study. The authors are also grateful for the generous help, cooperation and assistance received from Alison Cowle (The Sax Institute). Researchers from the Faculty of Health and Medicine at the University of Newcastle (JEB and PMF) are members of the Hunter Medical Research Institute (HMRI).

References

Footnotes

  • Contributors HK, JEB,KO, GM and JYN were responsible for the study inception and design. JN managed the field work, with data collection conducted by Crystal Clear Data for the self-complete questionnaires and Taverner Research McNair and Associates for the telephone interviews. PMF and VL were responsible for the amalgamation of the LHH data and statistical analysis. All the authors made contributions to conception and design, acquisition and management of data, or analysis and interpretation of data; were involved in the drafting the manuscript and/or provided critical revision for important intellectual content; and gave final approval of the manuscript to be published.

  • Funding Supported by an Australian Research Council Grant (DP 1096778, “Socio-economic determinants and health inequalities over the life-course: Australian and English comparisons”) with investigators from the Universities of Sydney, Newcastle and Queensland (Australia) and the University of Manchester (UK).

  • Competing interests None.

  • Ethics approval The 45 and Up Study was approved by the University of New South Wales Human Research Ethics Committee. The LHH Survey was approved by the University of Sydney Human Research Ethics Committee (#12744).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.