Article Text
PDF
Abstract
Objective To test a positive deviance method to identify counties that are performing better than statistical expectations on a set of population health indicators.
Design Quantitative, cross-sectional county-level secondary analysis of risk variables and outcomes in Indiana. Data are analysed using multiple linear regression to identify counties performing better or worse than expected given traditional risk indicators, with a focus on ‘positive deviants’ or counties performing better than expected.
Participants Counties in Indiana (n=92) constitute the unit of analysis.
Main outcome measures Per cent adult obesity, per cent fair/poor health, low birth weight per cent, per cent with diabetes, years of potential life lost, colorectal cancer incidence rate and circulatory disease mortality rate.
Results County performance that outperforms expectations is for the most part outcome specific. But there are a few counties that performed particularly well across most measures.
Conclusions The positive deviance approach provides a means for state and local public health departments to identify places that show better health outcomes despite demographic, social, economic or behavioural disadvantage. These places may serve as case studies or models for subsequent investigations to uncover best practices in the face of adversity and generalise effective approaches to other areas.
- positive deviance
- county data
- health outcomes
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The study offers an approach to identify places where health outcomes exceed expectations given traditional risk indicators.
This information might be useful to identify characteristics of places that allow higher than expected performance so that others may learn and benefit from them.
Limitations of the study include the cross-sectional and ecological design and the absence of direct data on what drives better than expected performance.
Introduction
‘Positive deviance’ has been viewed as a characteristic of individuals that allow them to achieve better health outcomes compared with other individuals with similar risk profiles.1–4 Persons facing social or economic obstacles to good health may nevertheless practise health-promoting behaviours when those behaviours are viewed as acceptable, affordable, effective and consistent with local culture.5–7 In this study, we extend the idea of positive deviance from characteristics of individuals to those of communities8 and hypothesise that communities may also possess collective attributes that allow them to outperform expectations given traditional risk indicators.
The majority of research on positive deviance has focused on characteristics of individuals that allow them to outperform expectations. For example, families living in impoverished conditions in Vietnam who nevertheless had children with good nutritional status were found to engage in certain behaviours and food choices that promoted better nutrition.5 Interventions were subsequently developed and tested to promote the adoption of these healthy practices in other households (see also Bisets Bullen9 for a review of child nutrition interventions based on positive deviance approaches). Another study, conducted in a largely Hispanic community in Texas at high risk for childhood obesity, found unique feeding behaviours and healthy habits among parents with normal weight children.1
However, it may be the case that features of communities can influence collective personal decisions about health behaviours, leading to positive deviant outcomes at the level of the group. Research on community-level positive deviance is sparse. Zullig et al 10 reported the results of a national county-level analysis of health-related quality of life and used spatial analysis techniques to identify county clusters that were underperforming or overperforming statistical expectations. Rust et al 7 have argued that attention should be given to identifying the critical elements present in some communities that allow them to achieve greater health equity under conditions of poverty or social vulnerability. They cite the well-known case of the sudden and unexpected elimination of an African American disparity in infant mortality outcomes in Dane County, Wisconsin, a phenomenon occurring at the level of the county. They also report results from a county-level analysis in Georgia showing that some counties with major social inequalities had paradoxically equitable health outcomes. Klaiman et al 11 used health expenditure data to identify Local Health Departments in Florida, New York and Washington that outperformed their peers on maternal and child health indicators. They found that contextual variables, such as type of community and funding, do not fully explain the positive deviant health departments and suggest further research into broader mechanisms, community partnerships and engagement as possible strategies that foster positive deviance.
Overall, it is not clear what forces may lead people in some communities collectively to pursue these positive approaches while other communities do not, although a number of theoretical approaches to understanding health behaviour at the level of the group or community (eg, social learning theory, theory of triadic influence)12 may be useful to generate and perhaps test possible explanations. Differences in safety net programme, public policies, financial resources or individual leadership may also play roles, although evidence on these points is limited. The question arises as to whether there may be general characteristics (social, cultural, historical, geographic, etc) of counties or other aggregate units that allow them to outperform expectations across multiple health dimensions or whether positive deviance characteristics are specific to outcome.
In the current study, we examine a set of health outcome measures and a set of ‘traditional’ risk indicators (eg, age, race, education, smoking, obesity, etc) of those outcomes to identify counties in one state, Indiana, performing statistically better an expected given those traditional risk indicators. We test the hypothesis that the same counties will be identified as top performers across multiple health outcomes. If this hypothesis is supported, it provides evidence that there are general forces within counties that enable them to outperform expectations that is unrecognised but general characteristics that lead to better outcomes. If the hypothesis is not supported, it suggests that high-performing counties are outcome specific and that unique features may be operating in a county for a specific outcome that lead to its success on that particular measure. In either case, we may identify characteristics within counties that are useful for other counties to model and adapt for local purposes, targeted either to a specific outcome or multiple outcomes.
Methods
Design
The study is a non-experimental, correlational investigation of the associations between a set of health outcome dependent variables and a set of social, economic, behavioural and demographic independent variables, measured at the county level for the state of Indiana. The study included anonymous, county-level aggregated data and university ethics review was not required.
Data
The choice of dependent variables was intended to represent a range of important and common health indicators. Likewise, the choice of independent variables was based on available data but was intended to represent many traditional risk indicators that have been studied in relation to these outcomes.13–19 To obtain the data, we downloaded the most recent (2015) County Health Ranking Data (http://www.countyhealthrankings.org/.) The variables in this dataset are themselves collected from a variety of sources and sometimes represent different years. All of the variables represent population percentages or per capita rates. We also downloaded National Cancer Institute data on total age-adjusted colorectal cancer incidence rates for Indiana counties (http://statecancerprofiles.cancer.gov/incidencerates/index.php.). We chose colorectal cancer among cancer types because it is relatively common and reducible through prevention efforts. Finally, we downloaded Centers for Disease Control and Prevention (CDC) age-adjusted mortality rate data for all circulatory diseases for Indiana counties (http://wonder.cdc.gov/ucd-icd10.html.). From these data sources we extracted the variables provided in table 1.
List of study variables
Analysis
Indiana has 92 counties. Therefore, it was necessary to identify from the long list of potential independent variables a smaller number to include in regression models. We examined bivariate Pearson correlations and eliminated housing quality, food insecurity, household income and college education because they were highly correlated (>0.65) with one of the other independent variables. Specifically, low housing quality correlated with income inequality (r=0.67); food insecurity correlated with childhood poverty (r=0.77); household income correlated with childhood poverty (r=-0.83) and college education correlated with health uninsurance rate (r=-0.67). Next, we ran multiple linear regression models for each of the seven dependent variables using a stepwise inclusion approach so that only variables related to the dependent variable at p<0.15 were retained. This approach also allows us to individualise covariates from the larger set for each dependent variable based on empirical evidence. Using the selected variables for each dependent variable, we found for each county the predicted outcome, the actual outcome and the difference between predicted and actual (the residual). Across the seven models, we examined the independent variables to determine whether there were common indicators across outcomes. We also sorted the counties by their residuals and examined the resulting lists to investigate whether the same counties were present at the extremes across the multiple outcomes. To quantify the level of agreement in the residuals, we found the Spearman rank correlations among the residuals, scoring the residuals in two alternative specifications. The first specification used the residual scores themselves. The second specification was based on standardising the residuals and categorising them into scores from 0 to 2, where 2=scored >1 SD above the mean, 1=midrange and 0=scored >1 SD below the mean; that is, each county received a score of 0, 1 or 2 for each outcome based on its residual. The majority of counties will be classified as ‘normal’ using this standardised approach, so that deviants on either side of the distribution will be fewer in number and stand out more clearly. The focus in this paper is on positive deviance counties, although some results are also presented for counties performing worse than expected.
Results
A summary of the county statistics (mean, SD and range) for the dependent variables is summarised in table 2. This table also provides summary statistics for the selected independent variables that were significant in one or more of the regression models. The last two columns of this table provide the SD and range for the residuals that were obtained from the regression models; for example, the mean county-level obesity rate was 31.8% and the regression models underpredicted or overpredicted obesity rates within a range of −5.4% to 5.0%.
Summary statistics for dependent and selected independent variables, Indiana counties
Table 3 provides a summary of the final regression models for the seven dependent variables. One variable, the teen birth rate, was included as an important risk for six of the seven outcomes. Hispanic population was an important indicator for five models, four of which indicated favourable outcomes and one unfavourable. Child poverty rates was an important risk in four models. (Finding teen birth rate in six of the seven models was unexpected, and we conducted an additional exploratory regression analysis using teen birth rate as the dependent variable. The final model (R1=0.50, F (df=79, 8)=10.0, p<0.0001) indicated that higher teen birth rates were associated with higher per cent of the population aged <18, higher child poverty, less high school education, higher unemployment, fewer primary care physicians, higher obesity rates, urban locations and smaller per cent African American populations.)
Results of linear multiple regression models
Across models, the mean Spearman rank correlation among the residuals was only r=0.10 (NS). County performance ranks on one outcome were weakly and non-significantly related to county performance ranks on other outcomes. After standardising the residuals and categorising them from 0 to 2, the Spearman r among the scores remained poor (r=0.14 NS). Finally, we found for each county the sum of the standardised scores across outcomes, with a possible range from 0 for the poorest performance across measures to 14 for the best possible performance. The mean score was 7.2 (SD=1.9). The highest score was 11 out of 14 for Parke County and Union County; the next highest score was 10 for four counties (Brown, DeKalb, Elkhart and Warren). The lowest score was two for Delaware County followed by three for Crawford County and Lawrence County. The sum score results suggest that most counties scored in the midrange, and there were very few counties that were positive deviants across measures generally.
Table 4 shows selected basic demographic characteristics of the top counties drawn from US Census data; note that table 4 figures are population averages while the figures in table 2 are county averages that weigh each county equally regardless of population. There are no obvious patterns among these variables that distinguish top performers.
Selected demographic characteristics of the state and of top outperforming counties
Table 5 summarises the residuals and county ranks across models for Parke and Delaware Counties to show scores for selected counties with the most extreme positive and negative performance. Although Parke County and Union County received the top score across measures, they were not the highest scoring positive deviants on any of the seven individual measures. That distinction belonged to the following counties: Wayne (obesity); Brown (fair/poor health); Howard (low birth weight); Starke (diabetes); Ohio (premature mortality); Lawrence (colorectal cancer incidence) and Warren (circulatory disease mortality) (results not shown).
Observed, predicted and residual values for two extreme counties, Parke and Delaware
Discussion
The analyses did not support the hypothesis that there would be strong, generalised non-traditional indicators that drive outcomes across the selected measures at the county level in Indiana. In retrospect, this may not be surprising given the variability in disease aetiology from one outcome to another. County performance that was unusually high was for the most part outcome specific. That performance was often outcome specific suggests that efforts to learn and disseminate best practices should also be outcome specific. Nevertheless, there were a few counties that seemed to be doing particularly well (Parke, Union) across most measures. A focus on teen birth rate as a general risk indicator is also potentially useful.
Some of the findings in table 3 seem counterintuitive or unexpected. Smoking rates, for example, measured at the level of the county, were not related to premature mortality or cancer incidence when other covariates were considered. Rates of health uninsurance were identified in two models in directions opposite to what one might suppose. This is a limitation of measures at the county level,but also should be interpreted with respect to other variables considered simultaneously; smoking at the county level, for example, may partially overlap with other risks such as education or poverty rates.
The appearance of teen birth rates as a significant independent variable in most models was also unexpected; this finding should not be interpreted as a direct causal link between teen birth rates and selected outcomes, but likely indicates that teen birth rates act as a proxy to other unmeasured risk conditions that have general health consequences. It may prove useful to investigate the conditions that promote lower teen birth rate outcomes and the extent to which successful interventions to reduce teen birth rates may or may not result in improved health conditions more generally. Teen birth rates have been in decline in the USA.20 Studies of teen birth rates suggest national and state-level forces that contribute to higher or lower rates,21 22 but studies of county or subcounty influences are less well developed.
Limitations of the study include the cross-sectional data, and the fact that some years for examining relationships between independent and dependent variables are not ideally ordered in time. Although the intent was to examine collective outcomes, the county-level, ecological data prohibit causal inference about individual behaviours in relation to independent variables. The study is also limited by the selected set of dependent and independent measures and is limited to one state over one time. The counterintuitive findings regarding smoking rates may reflect data limitations as well: these are self-reported data over a 7-year period which may contain inaccuracies, and the rates for some counties had wide CIs which limits the ability to distinguish differences between counties. Finally, counties were used as the unit of analysis due to data availability; they are a somewhat arbitrary geographic unit and may fail to represent important subcounty variation from community to community, although the presence of county-level local health departments that exist in Indiana and many other states may provide a means in subsequent investigations for understanding health department impacts and for possible leveraging through county health department interventions.
It is important to keep in mind that the use of residuals to identify positive deviants identify counties that are performing outside of expectations given a set of traditional risk indicators. These are not necessarily the same counties that have the top observed values on the dependent variables. To cite one example, Monroe County had one of the lowest diabetes rates in the state at 8.5%, but it was predicted to have a rate of 8.46% and so it is not a positive deviant example, only a county performing as expected given the assessed risk indicators.
We suggest moving forward on the basis that outlier performance is not random but is based at least to some extent on unobserved forces that determine health outcomes. Important next steps include efforts to identify and understand the forces operating in these counties that are driving the outcomes. Qualitative studies to examine these forces may be especially useful,23 and Canavan et al 24 provide an example of how positive deviant counties on adult obesity were identified, and qualitative interviews subsequently conducted to understand ‘themes and strategies’ that may drive the positive results. The approach employed in this study provides a technique to identify where to look and indicates that subsequent investigations in many cases will be outcome specific.
That being said, Parke County offers a good choice for focusing on a single county where performance was often better than expected. Among the state’s 92 counties, this county ranked in the top 13 or better on 5 of the 7 measures. Parke County is a rural county in western Indiana near the Illinois border. It is known as the ‘covered bridge capital of the world’ and is a popular sightseeing place for visitors from Indianapolis, Chicago and other places. Selected Parke County demographic figures may be found in table 4. This county achieved frequent positive results despite relatively poor scores on education, labour force participation and poverty. Targeted follow-up qualitative studies to explore what may be happening here to promote positive health outcomes could be useful.
The methodological approach that we have described here is similar to other recently reported efforts.11 25 Rust et al 26 used a different method to measure differences over time in county trends in colorectal cancer mortality to identify counties with reductions in race-related disparities. It may similarly be useful to attempt to replicate our findings with additional data points over time to investigate consistency of positive deviant counties. The findings in the current study suggest novel follow-up steps for local and state public health professionals to pursue. The typical evaluation of local public health indicators undertaken by state level officials involves direct identification of places where an outcome of interest is unfavourable, followed by efforts to improve that outcome. We do not suggest to replace these improvement efforts, but rather that state authorities can use the positive deviance approach as an additional method to identify role model counties where public health practices might be studied and perhaps replicated. In our results, this suggests that Parke or Union County might be investigated to understand positive performance across measures, that Starke County might be investigated to understand how it addresses diabetes or that Ohio County can be investigated to understand what makes it stand out with regard to lower than expected premature mortality. This does not guarantee that powerful new insights will be identified in these counties, but the possibility is there to generalise positive benefits to other places. Similarly, county health departments can try to understand those cases where their performance is particularly strong, or less than ideal given adjustments for traditional risk indicators, to improve areas of weakness or to tout accomplishments in areas where others may also learn and benefit.
References
Footnotes
Contributors MH led the design, analysis, interpretation and writing. LG-R and BH contributed to design, writing, interpretation, literature reviews and analysis. All other authors contributed to study conceptual design, writing and interpretation of findings.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data available.