Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions

https://doi.org/10.1016/j.amepre.2016.06.015Get rights and content

This paper is one in a series developed through a process of expert consensus to provide an overview of questions of current importance in research into engagement with digital behavior change interventions, identifying guidance based on research to date and priority topics for future research. The first part of this paper critically reflects on current approaches to conceptualizing and measuring engagement. Next, issues relevant to promoting effective engagement are discussed, including how best to tailor to individual needs and combine digital and human support. A key conclusion with regard to conceptualizing engagement is that it is important to understand the relationship between engagement with the digital intervention and the desired behavior change. This paper argues that it may be more valuable to establish and promote “effective engagement,” rather than simply more engagement, with “effective engagement” defined empirically as sufficient engagement with the intervention to achieve intended outcomes. Appraisal of the value and limitations of methods of assessing different aspects of engagement highlights the need to identify valid and efficient combinations of measures to develop and test multidimensional models of engagement. The final section of the paper reflects on how interventions can be designed to fit the user and their specific needs and context. Despite many unresolved questions posed by novel and rapidly changing technologies, there is widespread consensus that successful intervention design demands a user-centered and iterative approach to development, using mixed methods and in-depth qualitative research to progressively refine the intervention to meet user requirements.

Introduction

Engagement with health interventions is a precondition for effectiveness; this is a particular concern for digital behavior change interventions (DBCIs), that is, interventions that employ digital technologies such as the Internet, telephones, and mobile and environmental sensors.1 Maintaining engagement can be especially difficult when DBCIs are used without human support, typically leading to high levels of dropout and “non-usage attrition,”2, 3 whereby participants do not sustain engagement with the intervention technologies. This paper discusses current approaches to conceptualizing and measuring engagement, and considers key issues relevant to promoting effective engagement.

This paper is one in a series developed through a process of expert consensus to provide an overview of questions of current importance in research into engagement with DBCIs, and to identify outstanding conceptual and methodologic issues.1 An international steering committee invited established and emerging experts to form a writing group to contribute to this process. The scope, focus, and conclusions were formulated initially by the committee and writing group, and then further discussed and modified with input from 42 experts contributing to a multidisciplinary international workshop. As such, the paper is necessarily selective and does not exhaustively review the relevant literature or propose particular models or solutions, but provides a critical reflection on the state of the art. The insights gained from this process are summarized in the concluding table as guidance based on research to date and priority topics for future research.

Some of the insights into engagement that emerged are specific to DBCIs, which have features that are not shared with other forms of intervention delivery—in particular, the potential to automatically record and respond to how the user is engaging with the intervention. However, many of the challenges confronting DBCI use are shared with other types of intervention—for example, the need for users to engage with the behavior change. Consequently, the unique potential of DBCIs to record engagement and behavior in detail over time is likely to generate important new insights that have relevance to engagement with other behavior change interventions.

Section snippets

Conceptualizing Engagement

The term engagement has been used in different ways in engagement research, making it challenging to synthesize the models and measures that have been proposed. Some researchers focus principally on engagement with digital technology, drawing on disciplines such as human–computer interaction, psychology, communication, marketing, and game-based learning.4 In this approach, engagement is typically studied in terms of intervention usability and usage, and factors that influence these. For

Promoting Effective Engagement

This section first introduces techniques for promoting effective engagement, identifying substantive gaps in knowledge and directions for future investigation, and then considers two key topics in engagement research: tailoring to individual needs (including the needs of those with lower levels of literacy and computer literacy) and combining DBCIs with human support.

Conclusions

Significant progress has been made in recent years in understanding the nature of and requirements for engagement, and particularly in recognizing the importance of carrying out in-depth mixed methods research into how people engage with DBCIs. Table 2 summarizes key guidance points emerging from research to date and highlights areas for further work. Future research would benefit from defining engagement more consistently and appropriately, appreciating that more engagement does not

Acknowledgments

This 2016 theme issue of the American Journal of Preventive Medicine is supported by funding from the NIH Office of Behavioral and Social Sciences Research (OBSSR) to support the dissemination of research on digital health interventions, methods, and implications for preventive medicine.

This paper is one of the outputs of two workshops, one supported by the Medical Research Council (MRC)/National Institute for Health Research (NIHR) Methodology Research Program (PI Susan Michie), the OBSSR

References (67)

  • L.G. Morrison et al.

    What design features are used in effective e-health interventions? A review using techniques from critical interpretive synthesis

    Telemed J E Health

    (2012)
  • D.C. Mohr et al.

    The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth Interventions

    J Med Internet Res

    (2014)
  • B. Fogg

    A behavior model for persuasive design

    Proceedings of the 4th International Conference on Persuasive Technology

    (2009)
  • H. Oinas-Kukkonen et al.

    Persuasive system design: key issues, process model, and system features

    Commun Assoc Inf Syst

    (2009)
  • L.M. Ritterband et al.

    A behavior change model for Internet interventions

    Ann Behav Med

    (2009)
  • R. Crutzen

    The behavioral intervention technology model and intervention mapping: the best of both worlds

    J Med Internet Res

    (2014)
  • B. Cugelman et al.

    Online interventions for social marketing health behavior change campaigns: a meta-analysis of psychological architectures and adherence factors

    J Med Internet Res

    (2011)
  • S.M. Kelders et al.

    Persuasive system design does matter: a systematic review of adherence to web-based interventions

    J Med Internet Res

    (2012)
  • J.R. Schubart et al.

    Chronic health conditions and Internet behavioral interventions: a review of factors to enhance user engagement

    Comput Inform Nurs

    (2011)
  • E.B. Hekler et al.

    Developing and refining models and theories suitable for digital health interventions

    Am J Prev Med

    (2016)
  • T.L. Webb et al.

    Using the Internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy

    J Med Internet Res

    (2010)
  • P.S. Roshanov et al.

    Features of effective computerized clinical decision support systems: meta-regression of 162 randomized trials

    BMJ

    (2013)
  • A. Sherrington et al.

    Systematic review and meta-analysis of Internet-delivered interventions providing personalized feedback for weight loss in overweight and obese adults

    Obes Rev

    (2016)
  • C.A. Maher et al.

    Are health behavior change interventions that use online social networks effective? A systematic review

    J Med Internet Res

    (2014)
  • S.A. Munson et al.

    Effects of public commitments and accountability in a technology-supported physical activity intervention

    Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

    (2015)
  • B.G. Danaher et al.

    Methodological issues in research on web-based behavioral interventions

    Ann Behav Med

    (2009)
  • V.J. Strecher et al.

    The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial

    J Med Internet Res

    (2008)
  • J.E. Van Gemert-Pijnen et al.

    Understanding the usage of content in a mental health intervention for depression: an analysis of log data

    J Med Internet Res

    (2014)
  • H. Schneider et al.

    Understanding the mechanics of persuasive system design: a mixed-method theory-driven analysis of freeletics

    Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

    (2016)
  • Laurie J, Blandford A. Making time for mindfulness. Int J Med Inform. In press. Online March 2, 2016....
  • A.L. Graham et al.

    Use of an online smoking cessation community promotes abstinence: results of propensity score weighting

    Health Psychol

    (2015)
  • A. Blandford

    Semi-structured qualitative studies

  • C.R. Lefebvre et al.

    The assessment of user engagement with eHealth content: the eHealth engagement scale

    J Comput Commun

    (2010)
  • Cited by (574)

    View all citing articles on Scopus

    This article is part of a theme section titled Digital Health: Leveraging New Technologies to Develop, Deploy, and Evaluate Behavior Change Interventions.

    View full text