Original articleA high response is not essential to prevent selection bias: Results from the Leiden 85-plus study
Introduction
A highly representative sample of participants is no longer considered essential for generalizability in etiologic studies that report risk estimates rather than prevalence estimates 1, 2, 3. Even a minimum of 80% response in follow-up studies is debatable [4]. Generalizability depends on the ability to abstract universal scientific hypotheses or theories from a set of observations and not only from the statistical framework of these observations 5, 6. However, many studies in the elderly have a public health goal in addition to more scientific etiologic goals. In such community surveys, generating estimates that can be extrapolated to the general population, representativeness is still very important. Furthermore, it is essential to include frail elderly subjects in a study to investigate the determinants of and causal relations with chronic conditions. Refusal to participate due to ill health would surely invalidate results on the impact of chronic conditions in an elderly population [7].
A high response rate increases the validity of community-based studies, because a low response rate might lead to selection bias [8]. The success of the response depends to a great extent on the way eligible subjects are approached. A high response can be achieved by interviewing and examining elderly subjects in their homes, because frail elderly subjects are less inclined to visit a study site [9]. Other effective strategies to optimize response rates are notification in advance by mail, involvement of expert researchers, and the prospect of a small gift [10]. Another possibility to increase response is to approach eligible subjects who initially declined or did not respond at all 11, 12. Using these strategies surveys among the elderly have been conducted resulting in response rates between 60 and 90% 1, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23. Differences in characteristics and associations between the sample of participants and the source population, however, frequently remain unknown.
In the Leiden 85-plus Study, a research nurse visited all subjects who did not participate directly after the first approach by telephone. Through this additional effort more subjects were drawn into the study. Moreover, the nurse asked a few questions to those who refused to participate to get an impression of their health and well-being. In this way we collected data from the whole source population. This provided an excellent opportunity to test the hypothesis that the additional effort to increase the response rate had diminished selection bias.
Section snippets
Methods
The Leiden 85-plus Study is a series of gerontologic surveys of the population of the oldest old living in the town of Leiden, The Netherlands. The first survey started in 1986. The present survey is a community-based follow-up study in a delineated cohort of 85 year olds. Special topics within the Leiden 85-plus Study are atherosclerosis, cognitive function, chronic diseases, disabilities, and well-being.
Results
Between 1 September 1997 and 1 September 1999, 705 inhabitants of Leiden reached the age of 85. Fourteen inhabitants died before they could be enrolled in the study, and thus 691 subjects were eligible to participate in the study. A total of 511 subjects, the direct sample, participated directly after invitation by phone, resulting in a response rate of 74%. After the additional recruitment stage another 88 subjects were included after being personally approached by our research nurse. As a
Discussion
The design of our study in which vitually all subjects from the source population were visited at their place of residence, gave us the unique opportunity to compare characteristics of subjects from different samples of participants with all the subjects from the source population, including the nonparticipants. We tested the hypothesis that the additional effort to increase the response rate would diminish selection bias. We found that the direct sample with a response rate of 74% was
Acknowledgements
This study was partly funded by the Dutch Ministry of Health, Welfare and Sport. We would especially like to thank our expert nurse, Inge Mooijekind, for her enthusiasm and dedication in visiting all the subjects. Dr. Jan Vandenbroucke is acknowledged for his critical comments.
References (32)
- et al.
A large-scale prospective cohort study on diet and cancer in The Netherlands
J Clin Epidemiol
(1990) - et al.
Attrition in the Longitudinal Aging Study Amsterdam. The effect of differential inclusion in side studies
J Clin Epidemiol
(2002) - et al.
The Gloucestershire Longitudinal Study of Disabilityoutcomes in nonresponders, responders, and subsequent defaulters
J Clin Epidemiol
(1998) - et al.
Some methodological problems in the long-term study of cardiovascular diseaseobservations on The Framingham Study
J Chronic Dis
(1959) - et al.
The assessment of disability with the Groningen Activity Restriction Scale. Conceptual framework and psychometric properties
Soc Sci Med
(1996) - et al.
Development and validation of a geriatric depression screening scalea preliminary report
J Psychiatr Res
(1982) - et al.
Comparison of cause-specific mortality between respondents and nonrespondents in a population-based prospective studyten-year follow-up of JPHC Study Cohort I
Japan Public Health Center. J Clin Epidemiol
(2002) - et al.
Response bias in the Honolulu Heart Program
Am J Epidemiol
(1989) - et al.
The impact of response bias on estimates of health care utilization in a metropolitan areathe use of administrative data
Int J Epidemiol
(1999) Statistics in medical journalssome recent trends
Stat Med
(2000)