Article Text
Abstract
Introduction In response to the burden of chronic disease among older adults, different chronic disease self-management tools have been created to optimise disease management. However, these seldom consider all aspects of disease management are not usually developed specifically for seniors or created for sustained use and are primarily focused on a single disease. We created an eHealth self-management application called ‘KeepWell’ that supports seniors with complex care needs in their homes. It incorporates the care for two or more chronic conditions from among the most prevalent high-burden chronic diseases.
Methods and analysis We will evaluate the effectiveness, cost and uptake of KeepWell in a 6-month, pragmatic, hybrid effectiveness–implementation randomised controlled trial. Older adults age ≥65 years with one or more chronic conditions who are English speaking are able to consent and have access to a computer or tablet device, internet and an email address will be eligible. All consenting participants will be randomly assigned to KeepWell or control. The allocation sequence will be determined using a random number generator.
Primary outcome is perceived self-efficacy at 6 months. Secondary outcomes include quality of life, health background/status, lifestyle (nutrition, physical activity, caffeine, alcohol, smoking and bladder health), social engagement and connections, eHealth literacy; all collected via a Health Risk Questionnaire embedded within KeepWell (intervention) or a survey platform (control). Implementation outcomes will include reach, effectiveness, adoption, fidelity, implementation cost and sustainability.
Ethics and dissemination Ethics approval has been received from the North York General Hospital Research and Ethics Board. The study is funded by the Canadian Institutes of Health Research and the Ontario Ministry of Health. We will work with our team to develop a dissemination strategy which will include publications, presentations, plain language summaries and an end-of-grant meeting.
Trial registration number NCT04437238.
- geriatric medicine
- protocols & guidelines
- change management
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
We are using a hybrid implementation–effectiveness randomised control design to evaluate the KeepWell application, which will help identify important intervention–implementation interactions needed to optimise its applicability and uptake by older adults.
The KeepWell application is innovative as it provides evidence-based, customised lifestyle advice for any combination of the 10 most common high-burden chronic conditions affecting older adults.
A team of patient partners and other stakeholders including clinicians and researchers codesigned the KeepWell tool, which will increase its relevance and use by older adults.
Limitations of our study are the inclusion of only English-speaking older adults with technology and internet access, which may limit the generalisability of our findings.
Introduction
The burden of chronic disease (long-term health condition that requires ongoing management for many years or even decades) is a global phenomenon, particularly among seniors1 who are the largest growing proportion of the population. In Canada, seniors (age ≥65 years) in 2019 represented 17.5% of the total population2 with projections that one in four Canadians will be older adults by 2031.3 Ageing is an expensive process, as 10% of seniors who have the most complex health needs account for 60% of the total annual healthcare spending in many Canadian provinces.4 As the disease burden grows in the global population, the associated healthcare costs will become unsustainable. Therefore, we need to adapt our current models of care to accommodate this shifting demand. Additionally, the impact of difficult situations such as the COVID-19 pandemic on healthcare delivery can compound the problem, highlighting the need to find alternative solutions to in-person care. In response, different chronic disease management strategies have been created with a central aim to facilitate ongoing, proactive and preventive support for optimal chronic disease management. Many of these are based on Wagner’s chronic care model, (CCM)5 which suggests that four elements need to be addressed to improve outcomes, including: self-management support across the community; as well as health system considerations focused on the delivery system, decision support and clinical information systems.5 A systematic review of chronic disease management tools identified patient education and self-management are needed for optimised disease control.6 Self-management has been defined as: ‘the intrinsically controlled ability of an active, responsible, informed and autonomous individual to live with the medical, role and emotional consequences of his chronic condition(s) in partnership with his social network and the healthcare provider(s)’.7 In the context of multimorbidity, optimised healthcare delivery also requires a patient-centred approach whereby patient preferences are considered alongside clinician-driven treatment decisions. In fact, clinical practice guidelines on multimorbidity emphasise the importance of this approach.8 A recent review found that top health-related patient preferences of older patients with multimorbidity are health outcome prioritisation and goal setting and self-management.9 In recent years, self-management tools have been acknowledged as an effective way to optimise disease management because persons can ‘function on their own behalf in health promotion, disease prevention and management’.10 11 Self-management tools also have the potential to alleviate time and resource burdens on primary care healthcare professionals (eg, physicians, nurses, dietitians and pharmacists) who most often are left to address all aspects of disease management (ie, risk assessment, diagnosis and treatment). In particular, online self-management tools have potential because they can improve health outcomes effectively at a low cost,6 12–16 are easily scalable and can reach a broader population of older people with chronic diseases.6 In fact, online tools are particularly relevant for supporting older adults with complex care needs in their homes, particularly during difficult circumstances requiring isolation and distancing such as the COVID-19 pandemic.17 In the last decade, the use of technology among older populations has grown significantly and is expected to continue expanding.18–20 Surveys of older adults indicate that they are interested in using the internet to access health information, are using the Internet or email and are accessing social networking sites such as Facebook, YouTube and Twitter.18–22
While self-management tools have shown some success in promoting health, many have shown varying degrees of effectiveness.6 12 Reasons may be that these tools do not consider all aspects of disease management or all elements of the CCM. Additionally, they are not usually developed specifically for seniors or created for sustained use and are primarily focused on a single disease.6 Such a narrow focus, in particular, fails to address the growing number of seniors with multiple chronic conditions, which accounts for more than half of seniors aged 65 years and older who are managing at least two or more chronic conditions such as, diabetes, dementia, heart failure and depression.12 13 As our population ages, an increase in multiple chronic conditions translates to increased risk of functional limitations and possible admission to acute or long-term care facilities.6 12 The projected health outcomes of seniors, therefore, continue to remain poor, and the quality and efficiency of care suboptimal, with only about 55% of patients receiving the recommended care.5 To respond to these challenges, we created an eHealth self-management application called ‘KeepWell’ that supports seniors with complex care needs in their homes. KeepWell is a patient-centred (ie, driven by patients), self-management tool that incorporates the care for two or more chronic conditions from among the top 10 high-burden chronic diseases (ie, highly prevalent and associated with significant morbidity and mortality) of older adults in Canada. KeepWell was built on a strong evidentiary base including a systematic review alongside a realist review,23 24 which, respectively, investigated the effectiveness of tools addressing multiple chronic conditions,23 and their underlying mechanisms and context.24 Findings of these reviews and a codesign process involving input from our team of researchers and clinicians, a patient working group of 10 older adults and our technology partner (Quality of Care (QoC) Health) informed the design of the KeepWell responsive web application. Once the functional prototype of KeepWell was created, we conducted a usability and pilot evaluation with 20 older adults to optimise its use by older adults.25
The objective of our study is to evaluate the effectiveness, cost and uptake of KeepWell in a pragmatic, hybrid effectiveness–implementation randomised controlled trial (RCT).
Methods and analysis
Study design
We will evaluate the effectiveness and uptake of the KeepWell application in a 6-month, pragmatic, hybrid effectiveness–implementation RCT26 for optimising and sustaining the self-management of older adults with multiple chronic diseases in the community. We will use the type 2 design, which facilitates the simultaneous investigation of the effectiveness of an intervention while rigorously testing the implementation strategy.26 The implementation evaluation process will be guided by the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM)27 and Proctor et al’s28 frameworks. The results will be reported using the The Consolidated Standards of Reporting Trials (CONSORT)-EHEALTH Checklist29 and the Template for Intervention Description and Replication Checklist.30
Theoretical basis of our work
We used the Knowledge-to-Action (KTA) model to guide our methods.31 Our team has experience applying the KTA framework in creating technology-based interventions.32 33 We have also adapted an integrated knowledge translation (IKT) strategy whereby our stakeholder team members (many of whom are also authors on this paper) helped create the KeepWell tool across the various stages of its development.23–25 For example, the full IKT team met three to four times per year (in-person or via teleconference) with more frequent interactions with stakeholders at strategic timepoints in the development of KeepWell. For example, we engaged clinicians more frequently during the development of the evidence-based lifestyle recommendations, health services and KT researchers to help inform study design, and patient partners, who were engaged more frequently during the active development and pilot testing stages of the process.
Patient population and eligibility criteria
Older adults will be identified with support from: (i) the retired teachers of Ontario (RTO); (ii) the University of Toronto Primary Care Research Network (UTOPIAN) and (iii) our partnering clinicians (geriatricians and family physicians) and their affiliated sites: North York General Hospital (NYGH), St. Michael’s Hospital of Unity Health Toronto, Sunnybrook Health Sciences Centre and St. Peter’s Hospital. All these recruitment sources have a roster of older adults with multiple chronic conditions via their membership (eg, RTO) or affiliated primary care and geriatric clinics (UTOPIAN and partnering clinicians). Study eligibility criteria are: (i) age ≥65 years; (ii) have one or more of the following chronic conditions: diabetes, heart failure, cardiovascular disease, dementia, chronic kidney disease, osteoporosis, osteoarthritis, rheumatoid arthritis, Chronic Obstructive Pulmonary Disease (COPD), depression, urinary incontinence, stroke; (iii) English speaking; (iv) have access to a computer or tablet device; (v) high-speed internet access; (vi) have an email address and (vii) able to consent. Consent-giving capacity will be assessed using the validated, 10-item, University of California Brief Assessment of Capacity to Consent Tool.34
Recruitment
We have created a recruitment poster, which includes a phone number and email address dedicated to this research project as well as a website with information about eligibility criteria and the consent process (online supplemental appendix A). This poster will be distributed according to the following strategies: (i) via an email listserv from RTO with a membership of more than 80 000 older adults across Canada; (ii) directly to older adults by our family physician and geriatrician partners during an in-person, phone or virtual patient visit (eg, using a web-conferencing application) or through their clinic staff and (iii) via advertisements on social media sites (eg, Facebook and Twitter) or online classified advertising services (eg, Kijiji and Craigslist). Potential participants will self-refer after reviewing the poster or a full-length study information page from the NYGH website by contacting the research coordinator via email or phone. This will trigger an enrolment phone call with the potential participant and the study coordinator involving the assessment of their study eligibility, consenting ability, as well as verbal consent (online supplemental appendix B). Non-consenting respondents will be asked to provide a reason for their decision. Recruitment will be performed on a rolling basis starting in December 2020.
Supplemental material
Supplemental material
Randomisation and blinding
All consenting participants will be randomly assigned to a unique identification number and KeepWell password linked to a particular randomisation sequence (intervention or control) during the enrolment phone call using a 1:1 ratio. The allocation sequence will be determined using a random number generator by the study coordinator; participants will be the unit of randomisation. At the conclusion of the enrolment phone call by two study coordinators, consenting participants will receive an email with a link to KeepWell (intervention condition) or to a link to an online survey (via SurveyMonkey) to complete a health risk assessment questionnaire (control condition). The research coordinator will have the master list of the allocation sequence and logins. Allocation will, therefore, be concealed because this list will not be shared with the research team. To protect against sources of bias, investigators, outcome assessors and data analysts will be blinded to the randomisation sequence. Blinding of older adults will not be possible given that the intervention is a standalone, web-based application and the control condition is usual care (no access to KeepWell).
Intervention and control groups
Intervention: Participants allocated to the intervention group will be given access to KeepWell, which is a fully functional, standalone, user-responsive, eHealth application aimed at supporting the self-management of older adults with multimorbidity (www.keepwell.care). Table 1 highlights the details of the KeepWell application features and function. KeepWell can be used on computers and tablet devices (eg, iPad and Android tablet) and has innovative features that most other chronic disease solutions do not have (see table 1): (i) a multidisease focus (it can generate lifestyle advice for any combination of the top 11 most common chronic conditions affecting older adults (eg, diabetes, heart disease, osteoporosis, depression and dementia); (ii) an animated, talking avatar health coach that walks users through a health prioritisation and goal setting exercise. This is important as most self-management tools are designed to fit patients’ condition rather than their health priorities, which does not address their specific needs.35–37 Establishing patient goals, values and priorities not only ensures that their views and needs are considered to enhance the self-management process but they also simplify the burden of multimorbidity care38; (iii) a Health Risk Questionnaire (HRQ) covering three risk dimensions: health (chronic diseases), lifestyle (physical activity, diet, smoking, alcohol, caffeine and bladder health) and social and emotional well-being (social isolation and loneliness); (iv) an evidence-based Action plan with lifestyle advice customised to the user’s identified health risks as well as their personal health goals and priorities and (v) other eHealth self-management tactics that have been shown to improve health outcomes (ie, interactive lifestyle trackers39 40 and a journaling feature).41 KeepWell also has an extensive resources library, which has links to additional high-quality health and lifestyle information across topics of interest to older adults (ie, social, mental and emotional health, sexual health, physical health and disease-specific information). Control: Participants allocated to the control condition will receive care as usual but will be asked to complete the HRQ at baseline, 3-month and 6-month follow-up via an online survey to collect outcomes data. The control group will receive full access to KeepWell at the conclusion of the study. To maximise adherence to protocols, both groups will receive automated reminder emails.
Development of the KeepWell application
The KeepWell application was informed by: (i) knowledge syntheses: a systematic review to investigate the effectiveness of complex multimorbidity interventions for older adults23; and a realist review to unpack their underlying mechanisms24; (ii) evidence-based clinical practice guidelines across 11 high-burden chronic conditions (eg, diabetes, heart disease, dementia and COPD) and (iii) an iterative codesign process.25 The codesign process involved engaging a working group of 10 older adults with one or more chronic conditions and a multisectoral team of experts in multimorbidity, eHealth, informatics, human factors engineering and health services/KT research to be involved at all stages of KeepWell’s design, content and functionality. The older adult working group were recruited from the NYGH Patient and Family Advisory Council (Toronto, Ontario) and the St. Michael’s hospital volunteer organisation (Toronto, Ontario) between 2016 and 2017. The KeepWell prototype design and functionality evolved through a series of discussion groups with the patient working group to explore end-user needs (chronic disease management), to determine the ‘look and feel’ (design, features, functionality and flow) and to review and make key decisions about its content, language and flow. Our clinician partners (geriatricians, family physicians, dietitian and physical activity researcher) helped create the lifestyle recommendations using clinical practice guidelines and focus group discussions 2017–2018. Our e-Health technology partner (QoC Health) used results of a requirements analysis (ie, technical and functional specifications) to develop the software to iteratively programme alpha and beta versions of KeepWell (between 2017 and 2019). The prototype was pilot tested in a usability study between 2018 and 2019 with 20 older adults to ensure that it meets the principles of good interaction42–45 and user-centred design.46 This involved observation of participants as they interacted with the KeepWell prototype, and iteratively addressing errors (after two to three participants) to address errors and to ensure optimised functioning, navigation, content and flow of the tool for older adults.25
Outcomes
Table 2 provides the detailed description of all the outcomes organised according to the RE-AIM and Proctor et al’s frameworks of implementation evaluation.27 28
Primary outcomes wereperceived self-efficacy for managing identified chronic diseases or risks measured at 6-month follow-up using a validated 6-item, self-efficacy scale47 48 which is embedded within the HRQ of the KeepWell application. We selected this as our primary outcome because increasing self-efficacy is a prerequisite for behaviour change, which, through improved self-management may influence health and healthcare use.49 All participants will complete this outcome assessment via the HRQ of KeepWell at baseline, 3-month and 6-month follow-up.
Secondary outcomes were (i) self-efficacy at 3-month follow-up; (ii) quality of life50; (iii) health background/status (self-reported chronic diseases and risks) collected via the HRQ of KeepWell; (iv) lifestyle (self-reported caffeine and alcohol intake, physical activity,51 nutrition,52 smoking and bladder health) collected via the HRQ of KeepWell; (v) social engagement and connections53; (vi) eHealth literacy54; (vi) acceptability and (vii) appropriateness (measured via survey to intervention participants and interviews with a subsample at the conclusion of the trial).
Implementation outcomes were (i) reach (participant rate, representativeness and demographic characteristics); (ii) effectiveness (as described above for primary and secondary outcomes as described above); (iii) adoption (proportion of participants who complete KeepWell tasks such as the HRQ, priority and goal setting; and use KeepWell features such as the wellness vision, lifestyle tracker, progress, menu, journal and resources); (iv) fidelity (rate of process objectives achieved); (v) implementation cost (cost description analysis to assess the total cost of implementing the KeepWell overall and by stage (eg, one-time costs vs ongoing costs such as for web hosting, study personnel time) and (vi) maintenance/sustainability (use of KeepWell over time at baseline, 3-month and 6-month follow-up; as well as 6 months after trial completion).
Sample size calculation
In their Cochrane review of lay-led self-management interventions, Foster et al found 10 studies that looked at self-efficacy and these interventions showed a small, statistically significant improvement (standardised mean difference −0.30, 95% CI: −0.41 to −0.19).55 56 Using these estimates to calculate our sample size, targeting a power of 0.80 and assuming a dropout rate of 25%, we estimate that 220 older adults are needed per group for a total of 440 participants. In a previous interrupted time series study, an osteoporosis self-management tool housed in a touch-screen laptop computer was implemented across three primary care practices for 12 months, with a total of 350 patients who completed the risk assessment questionnaire,33 so our proposed sample size of 440 patients is feasible, given our patient organisation, hospital and primary care partnerships.
Data collection and analysis
All participant data from the KeepWell web-based application will be downloaded and stored on a secure cloud-based server of QoC Health, which adheres to Health Insurance Portability and Accountability Act (HIPAA) and Personal Health Information Protection Act (PHIPA) security standards; data will be accessible via Amazon Web Services. Data will be collected at baseline, 3-month and 6-month follow-up with an interim analysis planned at the midpoint of the trial (3-month follow-up). We will provide descriptive statistics, where we will summarise binary and categorical outcomes using frequency and percentages. Means and SD or median and IQRs will be used to summarise continuous outcomes. We will use the χ2 or Fisher’s exact test to compare binary outcomes and independent two sample t-tests for continuous outcomes. For the primary outcome, a general linear model will be fit to investigate differences between groups in self-efficacy at 6 months. We will adjust for potential confounders (including baseline self-efficacy) and perform subgroup analyses (patient chronic conditions, risk factors, age group (65–74, 75–84, 85+ years), sex and gender). We will perform visual investigation (eg, through scatter plot displays) and analytical outcomes along with logistic regression analyses to determine whether unique patient characteristics predict thresholds of use for different KeepWell components. To examine the change in self-efficacy over time (secondary outcome) between groups (incorporating self-efficacy scores at baseline, 3 and 6 months), we will use a linear mixed-effects model.57 58
For the cost description analysis, we will estimate the cost to implement and deliver KeepWell from the public healthcare payer perspective, including an exploration resource costs required (eg, online data collection/analysis, web system testing/hosting). The KeepWell platform collects user data for these measures, so we will be able to track them longitudinally to observe how the solution impacts on outcomes. The findings from the cost description analysis will represent the cost of KeepWell to the healthcare system. All clinical outcomes will be measured at baseline, 3-month and 6-month follow-up and assessed according to intention to treat. All statistical analyses will be carried out using the R statistical software.59
Patient and public involvement
Our patient co-design team consisting of nine older adults were involved in the development of the KeepWell tool. They were also part of our larger stakeholder team (ie, our IKT team) consisting of researchers and clinicians to design and plan our trial and to prepare this protocol. We discussed the objectives and plans for the KeepWell tool development as well as its evaluation via quarterly virtual meetings, phone calls and email. The patient codesign team will continue to be involved in the conduct of the trial including data analysis and interpretation of our results at 3-month and 6-month follow-up. They will also take an active role in helping to develop optimised strategies to disseminate our results to patients and the public at the conclusion of the study.
Ethics and dissemination
Ethics: Ethical approval has been received from the NYGH Research and Ethics Board (REB) (#20-0007). Any protocol modifications will be reported to the NYGH REB. To ensure data confidentiality, all participant data will be coded using a unique identification number, and all trial results will be presented in aggregate form only and stored securely on the NYGH research server. The final trial data set will be accessible to the principal investigator and the data assessor.
Dissemination: We will use a wide range of passive and active end-of-grant KT approaches to disseminate our findings. This will include publications and presentations of our trial results to researchers and clinicians, creating plain language infographics for older adults, the public and community organisations. We will also work with our team to develop more active strategies for disseminating of our findings such as an end-of-grant meeting to discuss results, implications and next steps. In all these strategies, we will ensure that the messages will be clear, simple and tailored to the needs of each audience group, whether these are individuals (physicians, patients, caregivers, policy-makers and researchers) or organisations (eg, the RTO, hospitals), including how they prefer to receive this information.
Acknowledgments
We acknowledge and thank all individuals who contributed their time to participate in the development of the KeepWell tool. In particular, we thank our older adult codesign team who enthusiastically dedicated their time to develop the KeepWell tool and the planning of its evaluation.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @marythynes
Contributors MK and SES conceived the study. All authors contributed to the design of the study including the development of the KeepWell tool. JSH and EM provided statistical expertise. MK drafted the manuscript, and all authors read, contributed to and approved the final manuscript.
Funding This work is supported by a Canadian Institutes of Health Research (grant number 143566) and an Ontario Ministry of Health and Long-Term Care Health Systems Research Fund (grant number 06688). MK is funded by a Canadian Institutes of Health Research New Investigator Award. JHL is funded by the University of Calgary Brenda Strafford Foundation (BSF) Chair in Geriatric Medicine. SES is funded by a Tier 1 Canada Research Chair in Knowledge Translation.
Competing interests None declared.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; peer reviewed for ethical and funding approval prior to submission.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.