Elsevier

Preventive Medicine

Volume 49, Issue 6, December 2009, Pages 527-528
Preventive Medicine

Are secondary data sources on the neighbourhood food environment accurate? Case-study in Glasgow, UK

https://doi.org/10.1016/j.ypmed.2009.10.007Get rights and content

Abstract

Objectives

To assess the validity of a publicly available list of food stores through field observations of their existence, in order to contribute to research on neighbourhood food environments and health.

Methods

All multiple-owned supermarkets, and a 1 in 8 sample of other food outlets, listed in 1997 and 2007 in the public register of food premises held by Glasgow City Council, Scotland, were visited to establish whether they were trading as foodstores. Postcode sectors in which foodstores were located were classified into least, middling and most deprived neighbourhoods.

Results

In total, 325 listed foodstores were visited in 1997 and 508 in 2007. Of these 87% and 88%, respectively, were trading as foodstores. There was a very slight gradient in validity by deprivation, with validity higher in least deprived neighbourhoods, though this was not statistically significant.

Conclusions

There was reasonable, but not perfect, agreement between the list of food premises and field observations, with nearly 1 in 9 of sampled foodstores not present on the ground. Since the use of inaccurate secondary data sources may affect estimates of relationships between the neighbourhood food environment and health, further work is required to establish the validity of such data in different contexts.

Introduction

There has been increasing interest recently in the role of the neighbourhood food environment as an independent predictor of food choice, and thus of diet quality, in high income nations (McKinnon et al., 2009, Cummins and Macintyre, 2006). Studies have generally tended to measure exposure to food environments through the use of data on the location of retail outlets, which are used to calculate measures of accessibility to food outlets in terms of time, distance and density. For pragmatic reasons, the majority of these studies have relied on pre-existing data obtained from public, commercial and online sources rather than using ‘on the ground’ field observation methods (which are time and cost intensive) to characterise environmental exposures (Paquet et al., 2008, Wang et al., 2006).

However, studies of neighbourhood food environments and diet depend on the validity of the data sources used to enumerate the distribution and characteristics of food outlets. Investigations of the validity of commonly used food retail business directories in the USA have demonstrated problems with completeness and the retention of outdated information (Lanvin, 1998) and errors in reporting of store location and attributes (Schwartz, 1987). Assessments of the validity of such data in health research are very rare, with only one published study investigating agreement between published or online commercial sources and field observations. In that study, in Montreal, the authors reported that even though the level of agreement was not perfect, there was no evidence of significant levels of systematic error (Paquet et al., 2008). Thus little is known about the validity of secondary data sources in studies of environmental determinants of diet. The aim of the study reported here is to assess the validity of secondary data on the location of food outlets by quantifying agreement between a local government listing of food premises and direct field observation, and whether agreement varies by neighbourhood deprivation, and over time.

Section snippets

Methods

Data were collected as part of two large surveys of food price and availability in Glasgow during July, August and September of 1997 and 2007. Full details of the methods and substantive findings on neighbourhood differences in food price and availability based on the 1997 survey have been published elsewhere (Cummins and Macintyre, 2002). The methods employed in the 1997 survey were replicated in 2007 in order to ensure that consistent methods were used. Briefly, our sample frame at both time

Results

Table 1 shows the percentage agreement between the list and field observation for all the sampled stores, and by neighbourhood deprivation, in 1997 and 2007. In 1997, 86.8% of identified food stores were confirmed as currently trading, and in 2007, 88.0%. In both years, stores were more common in deprived areas. Agreement ranged from 86.6% to 87.5% in 1997, and 90.3% to 87.3% in 2007. There was a negative stepwise relationship between neighbourhood deprivation and percentage agreement – as

Discussion

Our data suggest that the overall level of agreement between publicly available secondary data on food outlets and observations ‘on the ground’ was high, but imperfect. Errors were slightly more common in more deprived neighbourhoods, and this relationship between error rate and deprivation may have slightly increased between 1997 and 2007 despite overall improvements in validity. Compared to Paquet et al. (2008) the lower positive predictive values reported here may be due to omission of false

Conclusions

This study represents the first attempt to assess the validity of secondary data sources of the neighbourhood food environment outside of Canada, and the first to investigate changes in validity over time. Our results suggest that the Public Register of Food Premises may be a useful for characterising the neighbourhood food environment in the UK, though it is not perfect and may underestimate exposure-effect associations. The data presented here is likely to be in the upper bounds of validity,

Conflicts of interest statement

The authors declare that there are no conflicts of interest.

Acknowledgments

This research was funded by The Leverhulme Trust and the UK Medical Research Council, WBS U.1300.00.006. Steven Cummins is supported by a National Institute of Health Research Fellowship. We are grateful to Kate Campbell for coordinating the data collection in shops in 2007, and the field workers for collecting the data.

References (10)

  • McKinnonR.A. et al.

    Measures of the food environment: a compilation of the literature 1990–2007

    Am. J. Prev. Med.

    (2009)
  • CarstairsV. et al.

    Deprivation and Health in Scotland

    (1991)
  • CumminsS. et al.

    The price and availability of food in Glasgow: a systematic study of an urban foodscape

    Urban Stud.

    (2002)
  • CumminsS. et al.

    Food environments and obesity—neighbourhood or nation?

    Int. J. Epidemiol.

    (2006)
  • LanvinM.R.

    A clash of the titans. Comparing America's most comprehensive business directories

    Database

    (1998)
There are more references available in the full text version of this article.

Cited by (59)

  • Validity of secondary retail food outlet data: A systematic review

    2013, American Journal of Preventive Medicine
    Citation Excerpt :

    Few studies13,18,24 elaborated on how secondary data were entered and edited or how duplicate or possible duplicate retail food outlets were eliminated or combined. Only one study27 did not use GIS software or other digital mapping systems to map the location of retail food outlets ascertained from at least one of the secondary data sources examined. Nevertheless, only three studies12,18,28 reported the number of retail food outlets ascertained via secondary data sources that were successfully geocoded (i.e., located the associated latitude and longitude).

  • Objective food environments and health outcomes

    2013, American Journal of Preventive Medicine
View all citing articles on Scopus
View full text