Objective To evaluate the feasibility of a phase 3 randomised controlled trial (RCT) of a website (Living Well with Asthma) to support self-management.
Design and setting Phase 2, parallel group, RCT, participants recruited from 20 general practices across Glasgow, UK. Randomisation through automated voice response, after baseline data collection, to website access for minimum 12 weeks or usual care.
Participants Adults (age≥16 years) with physician diagnosed, symptomatic asthma (Asthma Control Questionnaire (ACQ) score ≥1). People with unstable asthma or other lung disease were excluded.
Intervention ‘Living Well with Asthma’ is a desktop/laptop compatible interactive website designed with input from asthma/ behaviour change specialists, and adults with asthma. It aims to support optimal medication management, promote use of action plans, encourage attendance at asthma reviews and increase physical activity.
Outcome measures Primary outcomes were recruitment/retention, website use, ACQ and mini-Asthma Quality of Life Questionnaire (AQLQ). Secondary outcomes included patient activation, prescribing, adherence, spirometry, lung inflammation and health service contacts after 12 weeks. Blinding postrandomisation was not possible.
Results Recruitment target met. 51 participants randomised (25 intervention group). Age range 16–78 years; 75% female; 28% from most deprived quintile. 45/51 (88%; 20 intervention group) followed up. 19 (76% of the intervention group) used the website, for a mean of 18 min (range 0–49). 17 went beyond the 2 ‘core’ modules. Median number of logins was 1 (IQR 1–2, range 0–7). No significant difference in the prespecified primary efficacy measures of ACQ scores (−0.36; 95% CI −0.96 to 0.23; p=0.225), and mini-AQLQ scores (0.38; −0.13 to 0.89; p=0.136). No adverse events.
Conclusions Recruitment and retention confirmed feasibility; trends to improved outcomes suggest use of Living Well with Asthma may improve self-management in adults with asthma and merits further development followed by investigation in a phase 3 trial.
Trial registration number ISRCTN78556552; Results.
- PRIMARY CARE
- behaviour change
- complex intervention
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
A recent UK review of asthma deaths showed many could have been avoided if medication management and other self-management strategies had been better, so finding optimum approaches to support self-management of asthma is critical and digital interventions show promise.
The ‘Living Well with Asthma’ website was iteratively designed with input from experts in asthma, self-management support, behaviour change and adults with asthma themselves; it aims to support optimal medication management, promote use of action plans, encourage attendance at asthma reviews and increase physical activity.
We conducted a phase 2 parallel group, randomised controlled trial; randomisation was through automated voice response, after baseline data collection but blinding of the researchers or participants at outcome, measurement was not possible.
Our low response rate is a concern; however, we have described our population in detail (unlike previous reports of digital interventions for asthma self-management), and our baseline characteristics demonstrate that patients were recruited from a range of socioeconomic backgrounds.
Asthma is a common condition affecting over 300 million people worldwide, with increasing global prevalence.1 While there are newer pharmacological treatments for individuals with severe asthma,2–5 improvements in outcomes for the majority with mild-to-moderate asthma have stalled.6 A recent UK review of asthma deaths showed potentially avoidable factors in the majority, particularly relating to self-management and adherence to treatment.7
Despite clear evidence that self-management education, asthma action plan use and regular professional review improve outcomes,8 translation into everyday practice has proven difficult,6 and most patients still lack an action plan and sufficient understanding to self-manage effectively. Poor adherence to regular preventative medication (primarily with inhaled corticosteroids, ICS) is a particular problem. Using digital interventions to promote self-management behaviours shows promise, but uncertainty persists as to the most effective formulation of the intervention and the target population.9
In this phase 2, pilot randomised controlled trial (RCT), we evaluated the feasibility and effectiveness of using a low-intensity online intervention aimed at promoting effective self-management (especially adherence to ICS) in adults with mild-to-moderate asthma, compared with usual care. We developed the intervention (‘Living Well with Asthma’) incorporating evidence from the literature and relevant theory. Several phases of user testing in alignment with the ‘person-based approach’ to developing digital behaviour change interventions were undertaken.10 Following the Medical Research Council (MRC) guidance on developing and evaluating complex interventions,11 our objective was to determine the feasibility of conducting a phase 3 RCT, and obtained initial estimates of effects on outcomes.
Our trial protocol is described in detail elsewhere.12 A brief summary is provided here.
Settings and participants
We recruited from 20 general practices in Glasgow, UK, between 23/09/2013 and 21/02/2014, using clinical databases to identify potential participants who were invited by mail to participate and complete the Asthma Control Questionnaire (ACQ). We recruited adults aged 16 years or older, with a physician diagnosis of asthma and ACQ score ≥1, who provided written informed consent. For full inclusion and exclusion criteria see box 1. Our search strategy is shown in the online supplementary data file.
Inclusion and exclusion criteria
Written informed consent
Age 16 years or older
Diagnosis of asthma by a health professional, and duration of asthma symptoms >1 year
Asthma Control Questionnaire score (ACQ; six-questions version) ≥1 suggesting poorly controlled asthma
Ability to access the internet via desktop or laptop (tablets and smartphones not sufficient)
Unstable asthma as defined as the presence of one or more of the following events in the 4 weeks prior to randomisation:
Asthma-related hospital admission
Emergency department attendance for asthma
‘Out of hours’ visit of patients to the general practitioner (GP) for asthma
GP visit to patient at home for asthma
Presence of active lung disease other than asthma
Mental impairment or language difficulties that make informed consent impossible
Frequent asthma exacerbations with >4 courses of oral prednisolone in the 12 months prior to randomisation
Study design overview and intervention description
We conducted a non-blinded pilot RCT of access to the ‘Living Well with Asthma’ website versus usual care for 51 participants. Participants were assessed in their own homes at baseline and at 12 weeks or as soon as possible after this date.
The intervention development is described elsewhere,13 but in summary aimed to (1) provide understanding of current level of asthma control and how to improve it, specifically by optimising use of prescribed medication; (2) challenge attitudes and concerns around medications; (3) learn how to get the most out of their annual asthma review; (4) prompt provision and use of a personal asthma action plan from a health professional and (5) send timely reminders for influenza vaccination and reordering refill inhaler prescriptions. The website did not advise medication changes, but suggested contacting a health professional if inadequate control was identified, with clear advice for seeking help in an emergency. The website is interactive, aiming to engage the user in recognising that their asthma is uncontrolled, and illustrate the benefits via case vignettes (based on real life examples) of taking their medications as prescribed. The website is tailored based on their current use of preventer inhalers (never been prescribed; prescribed but do not really use; use regularly). There is a ‘4-week challenge’ that users can sign up to, where they commit to taking their preventer regularly for 4 weeks, are guided through establishing their personal barriers to regular use (see screenshot in online supplementary data file for further illustration) and developing potential solutions to these barriers.
The intervention group was given website login details and a computer link, and advised to use the website as much or as little as they wished (total time to visit all pages once ∼90 min). We developed the website using an open source software package called LifeGuide.14 ,15
Randomisation and blinding
Randomisation occurred after baseline data collection, using a third party interactive voice response system (IVRS) ensuring allocation concealment. The randomisation schedule was generated in advance of the study by the Robertson Centre for Biostatistics, in a 1:1 ratio, using the method of randomised permuted blocks of length 4, without stratification. Access to the randomisation schedule was restricted to those within the Centre with responsibility for provision of the IVRS. The comparison group was offered access to the intervention after the follow-up visit.
The primary end points were: recruitment and retention rates at follow-up, website use, and changes from baseline for ACQ16 and mini-Asthma Quality of Life Questionnaire (AQLQ) scores.17 The ACQ and mini-AQLQ have a minimal clinically important difference (MCID) of 0.5.18 This pilot study was not powered to detect a difference in these two clinical outcomes; they were included in order to assess feasibility and inform sample size calculations for a future full-scale RCT.
We evaluated a range of secondary outcomes in order to assess their feasibility for use in a future full-scale RCT.
Individual domains of the mini-AQLQ were reported. These comprise of symptoms, activity limitation, emotional function and environmental stimuli. Knowledge, skills and confidence to manage health was measured via the Patient Activation Measure (PAM).19 Self-reported adherence was assessed by both enquiring what proportion of prescribed ICS were actually taken, and via the Morisky Medication Adherence Scale (MMAS).20 Airway inflammation is measured by fraction exhaled nitric oxide (FeNO).21 Lung function was assessed via prebronchodilator spirometry, including forced expiratory volume in 1 s (FEV1); FEV1 percentage predicted; and FEV1/forced vital capacity. Lung function (spirometry) was performed to the American Thoracic Society (ATS) standards,21 ,22 where possible, and the proportion of tests not meeting these standards recorded. As well as the asthma-specific mini-AQLQ, generic quality of life was measured using the EuroQol (EQ)-5D.23 We collected changes to medication use, recorded numbers of health service contacts and severe exacerbations were noted by recording the number of oral prednisolone courses. These data were self-reported. Those in the intervention group received the problematic experience of therapies scale (PETS) to facilitate understandings of barriers to using the website, and following its advice.
Continuous data are summarised as mean and SD or range, or as median and IQR, and categorical data as counts and percentages. Linear regression was used to estimate differences in continuous outcomes between groups at follow-up, adjusting for baseline scores. Estimated between-group differences are reported with a 95% CI and p value. For continuous outcomes that were not normally distributed, changes from baseline were compared between groups using Wilcoxon rank-sum tests. Categorical variables were compared between groups using Fisher's exact test. All analyses were carried out using SPSS Statistics V.22 and Microsoft Office Excel. The primary analysis was intention-to-treat and involved all patients who were randomly assigned, except with spirometry where only those meeting ATS/European Respiratory Society (ERS) eligibility criteria will be analysed.22
The groups were largely well matched. Participants were aged between 16 and 78 years, and 75% were female (table 1).
Recruitment and retention)
Recruitment target of 50 participants was met (figure 1). Participating practices were mostly urban, and spread across deprivation categories. Response rate to the postal invitation was 4.6%, lower than anticipated, and only 27% of those screened were subsequently randomised, with the majority failing due to ACQ<1 (75%). Those randomised were younger (45.5 vs 51.5 years) and more likely to be female (75% vs 50%) than screen failures, but with similar socioeconomic deprivation. The attrition rate (not completing follow-up) was 12%: 20% in the intervention group, 4% in the comparison group (Fisher's test p=0.10).
Nineteen of the 25 participants in the intervention group logged in at least once (76%) with 17 going beyond the initial ‘core’ section. The subsequent section was tailored depending on which of three options was chosen: (1) I have never been prescribed a preventer inhaler (n=1); (2) I have been prescribed an inhaler but do not really use it (n=6); or (3) I have a preventer and usually use it as prescribed (n=10). The mean number of logins was 1.8 (range 0–7), median 1, (IQR 1–2), and the average time spent on the website during the study period was 18 min (range 0–48.9). More detail is shown in online supplementary figure A.
Beyond the core ‘introduction’ and ‘my asthma’ sections, the most popular sections were ‘take the 4-week challenge’ (n=13), and ‘common concerns and queries’ (n=11). Further usage data are shown in online supplementary table B. The majority (95%) of participants acknowledged that asthma was impacting on their life (online online supplementary table C).
Our planned analysis was for the seven-question version of the ACQ, which includes spirometry, for which there was considerable missing data (n=23; table 1). There was no significant difference in the intervention group compared with the control group (−0.42 (95% CI −0.95 to 0.11), p=0.121). We also analysed the equally valid six-question version (without spirometry)24 which was available for all (n=45), and demonstrated a similar result and it is this result which is presented in table 2.
Fifty-five per cent of the intervention group and 48% of the comparison group achieved the MCID of an improvement of at least 0.5 points (p=0.767).
There was no significant difference in mini-AQLQ scores in the intervention group compared with the control group (table 2). Fifty per cent of the intervention group and 36% in the comparison group achieved the MCID of improvement of at least 0.5 points (p=0.379).
The rationale for including a range of secondary outcomes was to assess their feasibility for inclusion in any future full-scale RCT. All outcomes were acceptable to participants and feasible to measure and analyse, apart from spirometry.
Mini-AQLQ domain scores
The ‘activity limitation’ domain of the mini-AQLQ showed a statistically significant improvement in scores in favour of the intervention group (table 3). The remaining individual domains of the mini-AQLQ showed numerical improvement in the intervention group, which were not statistically significant.
Other patient-centred outcomes
There was a significant improvement in PAM scores (tables 3 and 4) in the intervention group compared with the control group, indicating that intervention patients were more highly activated in relation to managing their own health.
There was no significant difference in mean MMAS scores in the intervention group (table 3) compared with the control group. However, more participants in the intervention group achieved the MCID≥2 compared with usual care (30% vs 4%, p=0.034), although the intervention group did have lower baseline scores.
The change in EQ-5D health utility score showed no significant between-group difference (table 4), with median change in score of 0 in both groups.
Physiological and inflammatory outcomes
FeNO levels (indicating airways eosinophilic inflammation) showed no significant between-group difference (table 4).
Medication changes and health service contacts
The median weekly number of puffs of reliever inhaler used in the intervention group reduced from 11 to 5, but remained unchanged in the control group at 4 puffs per week at baseline and at follow-up (p=0.022) (table 4). Although this between-group change in bronchodilator use was statistically significant, the groups were imbalanced at baseline. There was no significant between-group difference in the percentage of recommended ICS doses self-reportedly taken, nor the equivalent beclometasone doses prescribed. There were no significant between-group differences in health service contacts or prednisolone courses prescribed.
Further feasibility outcomes
The PETS results are shown in online supplementary table A, illustrating barriers to using the website. The biggest barriers relate to time and opportunity, rather than content.
No serious adverse events were recorded.
The main source of missing data was from the spirometry results where 23 participants had results not suitable for analysis, due to not meeting ATS criteria. All questionnaires were completed sufficiently well to allow calculation of scores, with only one response missing from each of the mini-AQLQ, PAM and MMAS all from different participants.
Sample size for a fully powered subsequent study
Using baseline-adjusted calculations of the change in ACQ score above assuming a SD of 1.0, a sample size of 134 would be required to detect a between-group change of ≥0.5 (MCID) in ACQ with 90% power at 0.05 significance. Assuming a similar attrition rate of 12%, the total sample size required would be 154.
This phase 2 pilot RCT of the Living well with Asthma resource demonstrates that this website merits further development, and that subsequent progression to a full-scale phase 3 RCT is feasible. Recruitment targets were achieved, and attrition rates were comparable to rates of other published digital interventions.9 We had no upper age limit, unlike similar asthma digital intervention studies. This is important as our recent metareview only found one study that included participants over 50 years of age, and descriptions of participants’ characteristics were limited, with socioeconomic status ignored.9 This information is important to understand the ‘reach’ of the intervention.
In terms of primary efficacy outcomes, there were no significant between-group differences in terms of ACQ and mini-AQLQ, although it is important to note that this pilot trial was not powered to show such differences. However, there are some interesting findings in analysis, as both the ACQ and mini-AQLQ demonstrate encouraging and consistent trends in favour of the intervention group, with one subdomain of the AQLQ (activity limitation) reaching the MCID and statistical significance. It is worth noting that for both primary efficacy outcomes, a proportion of those in the comparison group demonstrated an improvement in MCID scores as well as the intervention group. This is often the case in unblinded complex intervention trials, and validates our approach of making this a pilot RCT, and not just a feasibility study. In terms of website use, 76% of individuals logging in is comparable with other behaviour change websites,25 ,26 and it is encouraging that an average of only 18 min usage resulted in consistently positive trends across almost all outcomes. Asthma-specific research indicates that users like to spend 5–8 min per online session.27 Our exploration of usage patterns suggests that some users missed sections that they could potentially have benefited from. These two facts combined lead us to conclude that it would be preferable to provide the core modules initially and then ‘release’ further sections weekly or fortnightly, a strategy that has been used successfully for a weight loss intervention also developed using LifeGuide software.26 Qualitative process evaluation interviews of those in the intervention group have been completed and will be reported separately. Findings from this qualitative work will inform the further development of this resource, prior to evaluation in a full-scale trial.
We assessed the feasibility of collecting a range of secondary outcomes in any future RCT, and in doing so demonstrated a significant improvement in the PAM, which indicates that those in the intervention group had improved knowledge, confidence and skills to manage their asthma. Significant between-group differences in the numbers of patients showing a MCID improvement in adherence and reliever use should be interpreted with caution due to baseline between-group imbalances. The feasibility of researchers undertaking spirometry in the participants’ own homes using a portable handheld device was found to be low, as reported in other studies.28 Potential solutions include more intensive training of research staff; use of a device providing test-by-test acceptability information or undertaking trial visits in a dedicated clinical research facility by staff experienced in spirometry. However, this latter solution could have a negative effect on recruitment, as 21% of our study visits were undertaken in the evening and weekend, which facilitated recruitment of a population who can rarely make it into such RCTs (full-time employed). There is a balance between precision of measurements versus encouraging a more representative sample. Whether spirometry is required at all in a study aimed at people with mild-to-moderate asthma is not clear, and there is precedence in the literature for not including these outcome measures in similar primary care-based trials or for using simpler to perform lung function measures such as peak expiratory flow rate.29 ,30
Lack of time and opportunity were the biggest barriers to using the website and providing the contents on a smartphone app or tablet would be worth investigating. During the introduction questions at the start of the website, 95% of users agreed to statements which showed that asthma was negatively impacting on their lives. However, at the end of the trial, 42% of users doubted the personal relevance of the website, anecdotally reporting that the website would be more useful for people with symptomatic asthma. To be in the trial in the first place, all users were symptomatic (as defined by ACQ score), so challenging this mismatch between users’ perceptions and the reality would be warranted in future versions of a mobile friendly digital intervention.
Strengths and limitations
Blinding to group allocation during analysis was not possible due to the different numbers in each group being known by the researcher undertaking the analysis. As with many digital interventions, the ‘reach’ is a potential issue and our low response rate is a concern, even taking into account our very broad recruitment strategy. Similar trials have described similar recruitment difficulties.31 However, given how common asthma is, improvements in even a small proportion of patients could lead to significant benefit overall, particularly with an intervention such as that trialled here which is entirely internet based and once developed is very economical to make available to large numbers of people. Therefore, what seems like a low reach can still improve outcomes for a large number of people. We have described our population in detail, and our baseline characteristics demonstrate that patients were recruited from a range of socioeconomic backgrounds. Those excluded due to not having internet access were older than those who were excluded for other reasons (data not shown), but this is becoming less of an issue with year-on-year increases in the number of households with internet access (84% in 2014, UK).32
Comparable studies in the literature
Our recently published metareview suggests digital interactive interventions to support asthma self-management show promise, but there is no clear picture about the ‘active ingredients’ of the interventions.9 In the development of this intervention, we have described its contents fully including an analysis of behaviour change techniques used,13 allowing more meaningful future comparisons. When focusing on interventions aimed at those with mild-to-moderate asthma, most have included considerable health professional input as well as self-monitoring work on the part of the participants, and have not shown clinical improvements.33 This evaluation of Living Well with Asthma adds to the literature on digital asthma self-management suggesting that an intervention not including regular user self-monitoring or costly health professional input may have positive results.
We have shown that evaluating the Living Well with Asthma intervention was feasible and resulted in encouraging trends in clinical outcomes. Further qualitative work to understand usage patterns with intervention group participants have been completed and will inform a future version of the resource. To overcome the ‘practical barriers’ to using the intervention, future versions need to be mobile and tablet compatible, and will require further user testing. Following this development work on the resource, these findings suggest that a large-scale phase 3 RCT is merited, with some exploration of recruitment strategies and minor modification to outcome measurement methods. Low-intensity digital interventions that are easier to deliver at scale may be a more successful strategy, particularly in those with mild-to-moderate asthma.
The authors thank the Chief Scientist Office who funded this project (ref CAF 11/08). The NIOX MINI Airway Inflammation Monitor and mouthpieces were provided by Aerocrine Ltd. A preliminary version of these findings was presented at the Annual Meeting of the North American Primary Care Research Group (NAPCRG), November 2014, New York City, USA. Dr Marilyn McGee-Lennon and Andrew Ramsay are acknowledged for their contribution to developing the intervention evaluated.
Twitter Follow Deborah Morrison at @dmorrison4
Contributors DM, FSM and SW led planning and development of the intervention with support from NCT, RC, LY and MT. DM, FSM, SW and AM planned the evaluation, with support from NCT, RC, KA, LY and MT. DM and KS were responsible for recruitment, and DM, KS and KA undertook data collection. DM led data analysis and interpretation with support from FSM, SW, AM, NCT, MT, RC, KS and LY. DM drafted the manuscript with initial support from FSM, SW and AM and additional input from MT, LY, NCT, RC, KS and KA. All authors critically reviewed the manuscript, contributing important intellectual content, and approved the final manuscript.
Funding This work was funded by the Chief Scientist Office, Scottish Government, grant number CAF 11/08.
Competing interests This project (developing and evaluating the Living well with Asthma resource) was funded through a clinical academic fellowship awarded to DM by the Chief Scientist Office, Scottish Government http://www.cso.scot.nhs.uk/ (ref CAF 11/08). MT declares neither he nor any member of his close family has any shares in pharmaceutical companies. In the past 3 years he has received speaker's honoraria for speaking at sponsored meetings or satellite symposia at conferences from the following companies marketing respiratory and allergy products: Aerocrine, Astra Zeneca, Boehringer Inglehiem, Novartis, GSK, Teva. He has received honoraria for attending advisory panels with; Aerocrine, Almirall, Astra Zeneca, BI, Chiesi, GSK, MSD, Novartis. He has received sponsorship to attend international scientific meetings from: GSK, Astra Zeneca, Mundipharma. He has received funding for research projects from: GSK, Almirall.
Ethics approval This study was approved by the West of Scotland Research Ethics Committee (ref 13/WOS/0004).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.