Article Text

Download PDFPDF

Randomised controlled trial of alternative messages to increase enrolment in a healthy food programme among individuals with diabetes
  1. A Gopalan1,2,
  2. J Paramanund3,
  3. P A Shaw4,5,
  4. D Patel3,
  5. J Friedman5,6,
  6. C Brophy7,
  7. A M Buttenheim5,8,
  8. A B Troxel5,9,
  9. D A Asch1,5,6,10,
  10. K G Volpp1,5,6,10
  1. 1Corporal Michael J. Cresencz VA Medical Center, Philadelphia, Pennsylvania, USA
  2. 2Division of Research, Kaiser Permanente Northern California, Oakland, California, USA
  3. 3Discovery Vitality, Johannesburg, South Africa
  4. 4Department of Biostatistics and Epidemiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  5. 5LDI Center for Health Incentives and Behavioral Economics, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  6. 6Departments of Medicine and Medical Ethics and Health Policy, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  7. 7Vitality USA, New York, New York, USA
  8. 8Department of Community and Family Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
  9. 9Department of Population Health, NYU School of Medicine, New York, New York, USA
  10. 10Department of Health Care Management, Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  1. Correspondence to Dr A Gopalan; Anjali.Gopalan{at}kp.org

Abstract

Objectives We compared the effectiveness of diabetes-focused messaging strategies at increasing enrolment in a healthy food programme among adults with diabetes.

Methods Vitality is a multifaceted wellness benefit available to members of Discovery Health, a South Africa-based health insurer. One of the largest Vitality programmes is HealthyFood (HF), an incentive-based programme designed to encourage healthier diets by providing up to 25% cashback on healthy food purchases. We randomised adults with type 2 diabetes to 1 of 5 arms: (1) control, (2) a diabetes-specific message, (3) a message with a recommendation of HF written from the perspective of a HF member with diabetes, (4) a message containing a physician's recommendation of HF, or (5) the diabetes-specific message from arm 2 paired with an ‘enhanced active choice’(EAC). In an EAC, readers are asked to make an immediate choice (in this case, to enrol or not enrol); the pros and cons associated with the preferred and non-preferred options are highlighted. HF enrolment was assessed 1 month following the first emailed message.

Results We randomised 3906 members. After excluding those who enrolled in HF or departed from the Vitality programme before the first intervention email, 3665 (94%) were included in a modified intent-to-treat analysis. All 4 experimental arms had significantly higher HF enrolment rates compared with control (p<0.0001 for all comparisons). When comparing experimental arms, the diabetes-specific message with the EAC had a significantly higher enrolment rate (12.6%) than the diabetes-specific message alone (7.6%, p=0.0016).

Conclusions Messages focused on diabetes were effective at increasing enrolment in a healthy food programme. The addition of a framed active choice to a message significantly raised enrolment rates in this population. These findings suggest that simple, low-cost interventions can enhance enrolment in health promoting programmes and also be pragmatically tested within those programmes.

Trial registration number NCT02462057.

  • DIABETES & ENDOCRINOLOGY
  • health promotion
  • messaging
  • active choice
  • NUTRITION & DIETETICS

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • In this randomised controlled trial, we found that diabetes-specific messaging strategies were effective at increasing enrolment in a healthy food programme among adults with diabetes.

  • The incorporation of a behavioural economics-based technique called ‘enhanced active choice’ that prompted an immediate decision was the most effective at increasing programme enrolment.

  • These findings speak to the potential of simple, low-cost interventions to promote engagement in programmes designed to encourage healthier behaviours in high-risk, high-cost populations.

  • Few demographic details were available on randomised participants, limiting conclusions regarding the generalisability of the findings to other populations.

  • While large differences in programme enrolment were observed, this does not necessarily translate into programme usage, diet and health outcomes. Still, enrolment is a critical first step.

Introduction

Considerable evidence demonstrates reduced cardiovascular complication risk in adults with type 2 diabetes who consume a healthier diet.1–4 Maintaining a healthy diet, however, is a considerable challenge for many. One barrier may be the cost of healthy foods.5 Financial savings can promote healthier food purchases.6–8 Randomised interventions have demonstrated that participants who receive monetary discounts on healthy food items purchase greater quantities of fruits and vegetables compared with those who receive no discounts or who only receive nutritional education.7 ,8

The HealthyFood (HF) programme offered by Discovery Health's Vitality wellness programme offers cashback rewards for healthy food purchases. Discovery Health is the largest commercial health insurer in South Africa, serving ∼2.6 million of the 8 million South Africans with private health insurance (16% of the population is privately insured).9 Available to all Discovery Health members is the Vitality wellness programme, an incentivised health promotion programme; membership is voluntary and costs only a small amount per year.10 Included with Vitality are benefits ranging from gym subsidies to discounted Weight Watchers memberships. HF, one of the largest Vitality initiatives, is a three-tiered incentive programme designed to encourage a healthier diet by offering monthly cashback payments on healthy food purchases (examples of eligible foods are included in an online supplementary appendix). On initial HF activation, members are eligible for 10% cashback monthly. By completing an online health risk assessment and an in-person health screening, members can increase their monthly cashback amount to 25%. While this benefit is available at no additional cost to all Vitality members, immaterial of age or health status, there is particular interest in increasing current engagement in HF among individuals with high-risk, diet-sensitive health conditions such as diabetes. Currently, less than half of Vitality's ∼31 000 South African members with type 2 diabetes are enrolled in the HF programme.

Tackling barriers to HF enrolment is a necessary first step to increasing programme engagement and, hopefully, improving diets. Improved messaging about HF to increase its salience for individuals with diabetes could be a low-cost way to increase HF programme enrolment. Past work demonstrates the importance of message content and framing on promoting subsequent health behaviours, ranging from organ donor registration to vaccine adherence.11–13 Targeted and tailored messages, for example, those designed for and sent to individuals with a certain condition, are more effective at shifting behaviour than more generic messages.11 The effectiveness of messages can also vary by whether a message is gain-framed or loss-framed (framed to emphasise the potential gains or losses relating to performing or not performing the targeted health behaviour).14 ,15 While some messaging studies targeting low-risk behaviours such as dietary changes or exercise suggest that gain-framed messages may be more effective than loss-framed messages,14 when financial losses are a highlighted consequence of not engaging in the targeted behaviour, the reverse pattern has been observed.16

These types of message framing strategies may also prompt more immediate action. Given the financial benefits of enrolling in HF, some members may intend to enrol but postpone the task assuming the process is overly time-consuming or complex. To combat this present bias (the natural tendency to overweight the upfront ‘costs’ of something compared with the future or long-term benefits),17 we tested a behavioural economics-based approach that asked participants to make an immediate ‘active choice’. This choice was further ‘enhanced’ by both gain-framing and loss-framing that highlighted the relative benefit of the preferred option (HF enrolment) and the losses of the non-preferred option (not enrolling).18 Past work using ‘enhanced active choice’ has shown success in increasing health-related behaviours ranging from influenza vaccination to automated pharmacy refill enrolment.18

In this study, we compared the effectiveness of diabetes-focused messaging strategies in increasing HF enrolment among Vitality members with type 2 diabetes. We hypothesised that messages that are more personalised and relatable, as well as those that prompt immediate action, would increase the rate of enrolment.

Methods

Study design

Eligible study participants were identified by the Vitality team. No formal consent process was required given the existing language in the Vitality membership agreement. The study statistician generated a randomisation list that was sent to Vitality who then linked it with the eligible member database according to the study ID. Using a simple randomisation scheme, participants were assigned to one of five study arms with equal chance. Automated email messages were generated and sent according to arm assignment. The analytic team had no contact with the study participants. Since this study addressed alternative messages by study arm, participants were not blinded to the assigned intervention.

Study population

Eligible participants lived in South Africa, were Vitality members aged 18 years or older with a diagnosis of type 2 diabetes, were not yet enrolled in HF, and were registered on the Vitality website (reflecting internet access and an available email address). Vitality members with type 2 diabetes were identified based on billing codes for diabetes along with any pharmacy codes for oral hypoglycaemic medications (not prescribed to patients with type 1 diabetes).

Study outcomes

The primary outcome was HF enrolment at 1 month, collected using Vitality internal, electronic tracking systems. An intended secondary outcome was participants' interaction with the messages, specifically undelivered emails, unread emails, clicks to the embedded link to the HF enrolment page, time spent on the Vitality website, and initiation of the enrolment process. Unfortunately, technical issues within the electronic data collection system prevented these data from being captured.

Member involvement

Vitality members were not involved in the research design or in the selection of outcome measures.

Study intervention

Eligible members were randomised to one of the five study arms with equal chance: (1) control arm (no message), (2) a diabetes-specific message, (3) a message with a recommendation to participate in HF written from the perspective of a Vitality member with diabetes, (4) a message with a recommendation to participate in HF from a physician with diabetes expertise, or (5) the diabetes-specific message from arm 2 paired with an ‘enhanced active choice’. All tested messages were written by the study team, delivered via email, and contained common elements: a personalised subject line, a description of the HF benefit, mention of two potential health benefits for individuals with diabetes (better sugar control and weight management), and a link to initiate enrolment.

The diabetes-specific message contained only the elements described above. The diabetes-specific message with an ‘enhanced active choice’ included the following choices, which were designed to make more salient the advantages/disadvantages of enrolling/not enrolling: ‘Yes! I want to activate the HealthyFood benefit and get up to 25% cash back on the healthy food I buy.’ or ‘No, I'd prefer not to activate and continue paying full price for my healthy food purchases.’ The ‘Yes’ checkbox took participants directly to the HF enrolment site. The ‘No’ box linked to an internal website informing participants that they could still enrol at a later time. The diabetes-specific messages with and without the ‘enhanced active choice’ used in the study are included as online supplementary figures.

The intervention occurred in June and July 2015. We sent three email messages (an initial message plus two reminders) to participants in the experimental arms. All messages were separated by at least 2 days. Before the second and third messages, participant data were refreshed and only participants who had not signed up for HF were sent reminders.

Statistical analysis

There were 5467 individuals determined to be initially eligible in January 2015 (figure 1). After excluding participants due to enrolment in HF prior to the intervention and departures from the Vitality programme, we estimated that at least 3500 individuals would still meet eligibility criteria at the time of randomisation and study launch in June 2015. The initial sample was identified several months before the launch to allow study participants ample time to have learnt about HF from other sources (eg, Vitality website and marketing communications) and enrol if interested. The primary end point of interest was a binary indicator of enrolment; pairwise hypothesis tests of enrolment rates were planned across the five arms, for a total of 10 possible comparisons. The anticipated sample size of 3500 provided 80% power to detect a 3% pairwise difference between the proportions of participants who enrolled in HF with significance testing conducted at the Bonferroni-corrected significance level of 0.005 (0.05/10) to account for the 10 pairwise between-arm comparisons and pessimistically allowing for up to 10% further exclusions. The baseline monthly enrolment rate was estimated at ∼1%/month. We compared the proportion enrolled between arms using a Fisher's exact test. All data analyses were performed using R software (V.3.2.1; R Development Core Team, Vienna, Austria).

Figure 1

Participant enrolment, allocation, follow-up and analysis. HF, HealthyFood.

Results

Figure 1 shows the CONSORT diagram for the study (the completed CONSORT checklist is included as an online supplementary material document). There were 3906 randomised participants, and 3665 in the analysis cohort of current members not enrolled in HF at the time of intervention launch. Age and gender were similar between the arms (table 1).

Table 1

Member characteristics*

Figure 2 reports enrolment rates across arms. All interventions were superior to control at the Bonferroni-corrected significance level (p<0.0001 for all comparisons). The ‘enhanced active choice’ arm revealed the largest difference compared with control (12.6% vs 0.9%, p<0.0001). Those in the ‘enhanced active choice’ arm had a higher rate of enrolment than both those receiving the diabetes-specific message alone (12.6% vs 7.6%, p=0.0016) and those receiving the message with the physician's recommendation (12.6% vs 6.8%, p=0.0003). Compared with those who received the message with the physician's recommendation of HF, those who received the message written from the perspective of another member with diabetes had higher enrolment rates (6.8% vs 9.9%, p=0.0386), but this difference was not significant at the Bonferroni-corrected level. None of the other pairwise comparisons revealed statistically significant differences in enrolment rates.

Figure 2

Enrolment in HealthyFood programme by study arm. Note: Vertical error bars depict 95% Clopper and Pearson confidence intervals.

Discussion

In this randomised controlled trial of adults with diabetes, we found that four diabetes-specific messaging strategies were more effective at increasing enrolment in a healthy food benefit than current practice.

The ‘enhanced active choice’ arm had the highest rate of HF enrolment. This simple, no-cost messaging approach could be used more widely to help people take action to address their underlying risks. ‘Enhanced active choice’ is well suited to conditions where people must make an affirmative choice (because defaults are seen as too presumptuous), yet most people would see clear advantages of a particular path if those were highlighted. In the context of enrolment into an automatic pharmacy refill programme, for example, default enrolment might be seen as too aggressive, because credit cards would be charged on prescription refills and some people would find that too invasive. However, encouraging participants to actively select automatic referrals is a middle ground.18 Moreover, encouraging an immediate choice (eg, by preventing people online from proceeding to the next page without accepting or declining) prevents potential procrastination. Note that we stopped short of actually requiring participants to make a decision; in many contexts, such as in signing up for benefits, it would be relatively easy to do that, but here we took the less paternalistic approach of simply encouraging participants to make a decision and highlighting some of the relevant advantages and disadvantages.

While an enrolment rate of 12.6% (the highest observed rate in the ‘enhanced active choice’ arm) may seem to some a small step towards achieving 100% HF enrolment, the results must be viewed in the context of past Vitality HF marketing campaigns and the cost of the tested interventions. Past Vitality HF marketing campaigns have resulted in enrolment rates of only 1–3%, well below the rates seen in all of the intervention arms. So while an ‘enhanced active choice’ messaging strategy is unlikely to result in 100% enrolment among members with diabetes, it could be a first resource-conserving step if 12.6% of the currently unenrolled population enrolled in HF without prompting from a paper mailer or a personal phone call. Given the ‘light touch’ nature of the tested interventions, we focused only on differences in programme enrolment. Still, HF enrolment is a potential first step towards dietary change; past work (analyses of member surveys and grocery scanner data) has demonstrated that HF enrollees make positive changes in their food choices, increasing healthy choices and decreasing unhealthy ones.19 ,20 It is important that future studies explore the downstream effects of HF enrolment, specifically programme usage, dietary changes and health outcomes.

The study design had several limitations. First, the generalisability of the study findings to other contexts was limited by the current uniqueness of Vitality and the HF programme, as well as the sparse demographic information available. We had limited information on member characteristics. For example, table 1 presents the age and gender of the primary Vitality members, but we did not collect any information about who received the study emails or who regularly does the household grocery shopping. Second, the use of a non-active control did not allow for direct comparisons between the tested diabetes-specific messages and less targeted messages. Third, we were not able to assess message opening or partial enrolment. Fourth, this study was limited to those who had already established an online account with Vitality, who may already be more motivated to participate and are easier to reach electronically. Vitality members without established accounts might benefit even more from such interventions but are harder to reach.

This study also has strengths. The design of this study reveals how real-time operational systems can become laboratories for health behaviour change; this study was conducted pragmatically, in the same setting in which it would be later implemented. This design lends the findings a high degree of external validity with regard to the ability to successfully incorporate these types of framed messaging strategies into Vitality's health promotion outreach efforts for similar populations.

While many interventions to improve health are operationally intensive and costly, some, like those tested here, are not. The results of this trial demonstrate that targeted, framed messages can help nudge individuals with diabetes to enrol in a healthy food programme. This step could be the first one towards healthier food choices, an essential contributor to ideal diabetes management and reduced cardiovascular risk.

Acknowledgments

The authors acknowledge Elle Alexander for her assistance with initial study design and conception.

References

View Abstract

Footnotes

  • Contributors All the listed authors have met the requirements for authorship. AG, the lead author, was responsible for overseeing study conception and design, communication between team members, data analysis and interpretation, manuscript construction and manuscript revision. JP, DP and CB, who are all affiliated with Vitality, were responsible for day-to-day study operations (eg, sending of the email messages and abstracting enrolment data from internal Vitality tracking systems to send to the Penn team). Given their affiliations with Vitality, the study's funder, JP, DP and CB were not involved with data analysis and interpretation and only provided general feedback on the manuscript (ie, they had no influence on how findings were presented and interpreted). PAS, the study's lead biostatistician, oversaw all statistical planning, data transfer from the Vitality team, data analysis and interpretation, and provided critical feedback on the manuscript. JF and AMB contributed to study conception and design, result interpretation, and provided detailed feedback on the manuscript. ABT and DAA contributed content expertise in the areas of biostatistics and behavioural economics, respectively, and both were actively involved in manuscript preparation. KGV served as the principal investigator on the study. He contributed his significant expertise in behavioural economics and randomised interventions to study conception and design, data interpretation and manuscript construction. KGV is the guarantor of this manuscript.

  • Funding The study was funded by an unconditional award from Vitality USA.

  • Disclaimer The study topic, research question and study design were at the discretion of the lead author and not the funder. Though several Vitality USA and Discovery Vitality employees were involved in helping to operationalise the study, these individuals were not involved in data analysis or interpretation and only provided general feedback on the manuscript (ie, had no control over how findings were presented and interpreted).

  • Competing interests PAS, ABT and KGV have received research funding from the Vitality Institute. JP and DP are employees of Discovery Vitality, and CB is an employee of Vitality USA. Given these relationships, these three individuals were not involved in data analysis but provided only operational support and expertise. DAA and KGV are both principals at the behavioural economics consulting firm, VAL Health. KGV also has received consulting income from CVS Caremark and research funding from Humana, CVS Caremark, Discovery (South Africa), Hawaii Medical Services Association and Merck. ABT serves on the scientific advisory board of VAL.

  • Ethics approval University of Pennsylvania IRB and the University of Witwatersrand Ethics Committee.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.