You are here

  • Home
  • Archive
  • Volume 3, Issue 12
  • Mobile phone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials

Article Text

Article menu

Download PDFPDF

XML
HIV/AIDS
Research
Mobile phone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials
  1. Lawrence Mbuagbaw1,2,3,
  2. Mia L van der Kop4,5,
  3. Richard T Lester4,6,7,
  4. Harsha Thirumurthy8,
  5. Cristian Pop-Eleches9,
  6. Chenglin Ye1,2,
  7. Marek Smieja1,10,
  8. Lisa Dolovich1,10,11,12,
  9. Edward J Mills13,
  10. Lehana Thabane1,2,12,14,15
  1. 1Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario, Canada
  2. 2Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, Hamilton, Ontario, Canada
  3. 3Centre for Development of Best Practices in Health, Yaounde Central Hospital, Yaounde, Cameroon
  4. 4Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
  5. 5Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
  6. 6British Columbia Centre for Disease Control, British Columbia, Canada
  7. 7Department of Medical Microbiology, University of Manitoba/University of Nairobi, Nairobi, Kenya
  8. 8Department of Health Policy and Management, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  9. 9School of International and Public Affairs, Columbia University, New York, New York, USA
  10. 10St. Joseph's Healthcare Hamilton, Ontario, Canada
  11. 11Department of Family Medicine, McMaster University, McMaster Innovation Park, Hamilton, Ontario, Canada
  12. 12Centre for Evaluation of Medicine, St Joseph's Healthcare, Hamilton, Ontario, Canada
  13. 13Faculty of Health Sciences, University of Ottawa, Ottawa, Ontario, Canada
  14. 14Departments of Paediatrics and Anaesthesia, McMaster University, Hamilton, Ontario, Canada
  15. 15Population Health Research Institute, Hamilton Health Sciences, Hamilton, Ontario, Canada
  1. Correspondence to Dr Lawrence Mbuagbaw; mbuagblc{at}mcmaster.ca

Abstract

Objectives Our objectives were to analyse the effects of text messaging versus usual care in improving adherence to antiretroviral therapy (ART) in people living with HIV using individual patient data meta-analysis. Adjusted, sensitivity and subgroup analyses were conducted.

Setting 3 randomised controlled trials conducted between 2010 and 2012 in rural and urban centres in Cameroon and Kenya (two studies) were used.

Participants A total of 1166 participants were included in this analysis (Cameroon=200; Kenya=428 and 538).

Primary and secondary outcomes The primary outcome was adherence to ART >95%. The secondary outcomes were mortality, losses to follow-up, transfers and withdrawals.

Results Text messaging improved adherence to ART (OR 1.38; 95% CIs 1.08 to 1.78; p=0.012), even after adjustment for baseline covariates (OR 1.46; 95% CI 1.13 to 1.88; p=0.004). Primary education (compared with no formal education) was associated with a greater intervention effect on adherence (OR 1.65; 95% CI 1.10 to 2.48; p=0.016) and also showed a significant subgroup effect (p=0.039). In sensitivity analysis, our findings were robust to a modified threshold of adherence, multiple imputation for missing data and aggregate level data pooling, but not to fixed-effects meta-analyses using generalised estimation equations. There was a significant subgroup effect for long weekly (p=0.037), short weekly text messages (p=0.014) and interactive messaging (p=0.010). Text messaging did not significantly affect any of the secondary outcomes.

Conclusions Text messaging has a significant effect on adherence to ART, and this effect is influenced by level of education, gender, timing (weekly vs daily) and interactivity. We recommend the use of interactive weekly text messaging to improve adherence to ART, which is most effective in those with at least a primary level of education.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/

https://doi.org/10.1136/bmjopen-2013-003950

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • We employed robust analytical strategies that incorporate the within-study and between-study differences.

    • The interventions use text-messaging communication in different ways (content, frequency and interactivity).

    • The studies included were conducted in sub-Saharan Africa where HIV infection is most prevalent.

    Introduction

    Adherence to prescribed medication is a key principle of medical care.1 This is especially true with HIV infection, where poor adherence to antiretroviral therapy (ART) can lead to drug resistance, AIDS and subsequent morbidity and mortality.2 ,3 Other consequences of suboptimal adherence include increased transmissibility of the virus and greater health system costs associated with more frequent and longer hospital stays.3 ,4 With more that 30 million people living with HIV worldwide, of which close to half are already on ART,5 there is a need to ensure that ART is taken consistently.

    The widespread use of mobile phones, including in resource-limited settings, has led to numerous studies investigating how they can be used to improve healthcare delivery. Many mobile health interventions have been based on text messaging, an inexpensive way to enhance communication between patients and healthcare personnel.6 ,7 Evidence from two Kenyan trials suggests that mobile phone text messaging can improve adherence to ART, reduce viral load and reduce treatment interruptions8 ,9; however, a third trial in Cameroon did not show significant improvement on adherence.10 These trials suggest that a number of factors, such as age, gender, level of education, duration on treatment and specific characteristics of the text messages such as interactivity, timing and content can influence an intervention's efficacy. Differences in effectiveness between and within studies can best be investigated using individual patient data (IPD) meta-analysis. This meta-analysis synthesises the three trials using mobile phone interventions for ART adherence and examines their effectiveness in important subgroups.11

    Objectives

    The objectives of this IPD meta-analysis are to

    1. Summarise the evidence from three trials on the use of mobile phone text messaging compared with usual care to improve adherence to ART in people;

    2. Analyse the effect of the intervention in subgroups defined by age, gender, level of education, duration on ART and type of message;

    3. Examine the use of multiple statistical methods and their effects on outcomes.

    Methods

    The methods have been documented in a published protocol.12 In brief, we conducted an IPD meta-analysis of three randomised controlled trials (RCTs) investigating the use of text messaging to improve adherence to ART. The first of these was the WelTel Kenya1 RCT that was a multisite two-arm trial of weekly interactive text messaging versus usual care conducted in Kenya.8 The second trial was a single site five-arm trial conducted in Kenya that compared short daily, short weekly, long daily and long weekly one-way text messages to usual care in a five-arm trial in Kenya.9 The two Kenyan trials ran for 12 months. The third trial was the Cameroon Mobile Phone SMS (CAMPS) trial, which was a single site two-arm trial of weekly motivational text messaging versus usual care to improve adherence to ART over 6 months.10 The first two trials showed significant improvement in adherence to ART while the latter did not. These were the only trials identified by the Adherence Trialists Collaboration and a PubMed search for RCTs of text messaging for ART adherence.

    Data management

    Only anonymised data were collected and used for this study. Data from all three trials were recoded and merged in a safe and secure computer system with backup. After merging, data were compared with the published manuscripts to ensure accuracy. Only variables available in all three data sets were used. Similar variables were pooled together. Categorical variables were modified to create new uniform categories across all studies. For example, categories such as ‘lower primary’, ‘upper primary’ and ‘completed primary’ were merged into ‘primary education’. A new data set was created with the following baseline covariates: age (years), gender (male/female), level of education (none, primary, secondary or higher) and duration on ART (months). These covariates were used for the subgroup analysis. The intervention was defined as text messaging versus no text messaging. For the subgroup analysis, text messaging was further divided into short daily,9 long daily,9 short weekly8 ,9 and long weekly messages9 ,10, motivational9 ,10 versus non-motivational8 and interactive,8 ,10 versus non-interactive.9 Motivational messages were considered as those with words of encouragement. The primary outcome was adherence greater than 95% as measured by the authors. In other words, irrespective of how adherence was measured participants whose level of adherence was rated above 95% were considered to have achieved the primary outcome. Two of these trials used self-reported adherence,8 ,10 while the third used medication event monitoring system (MEMS) caps.9 The secondary outcomes were mortality, and the number of participants lost to follow-up, transferred out or withdrawn.

    Statistical methods

    Baseline data for all included participants were summarised as mean (SD) or median (first and third quartiles, Q1, Q3) for continuous variables and number (%) for categorical variables. The primary outcome was adherence to ART (defined as adherence above 95%). We used IPD random-effects meta-analysis to determine the effects of text messaging on the primary outcome. In this model, each study was considered as a random effect. ORs and 95% CIs are reported. The level of statistical significance was set at α=0.05. This primary analytical method was repeated for the secondary outcomes.

    In an adjusted analysis, we investigated the effects of baseline covariates (age, gender, level of education and duration on ART) on the primary outcome. They were inserted in the model as fixed effects.

    We also conducted four sensitivity analyses: (1) we changed the method of analysis (using generalised estimation equations (GEE)) for exploratory purposes; (2) we changed the threshold for adherence (>90%), as the recent literature suggests that viral load suppression can be achieved at lower levels of adherence13 ,14; (3) we used multiple imputation techniques to deal with missing data; and (4) we calculated pooled estimates of effect (aggregate data meta-analysis). We present heterogeneity statistics and forest plots for the aggregate data meta-analysis.

    In addition, we looked at the effects of text messaging in different subgroups defined by age, gender, level of education, duration on ART, type of message (short daily, long daily, short weekly and long weekly), content of message (motivational vs non-motivational) and interactivity (two-way vs one-way). The p values of the interaction terms are reported. Data were analysed using Statistical Analysis Software (SAS) V.9.2 (SAS Institute, Cary, North Carolina, USA, 2009).

    Results

    Baseline characteristics

    The three trials included 1166 participants. Approximately two-thirds (67.0%) were female, and almost half (47.5%) had above a primary level of education. The median age was 36 years (range=66), and the mean duration on ART was 5.8 months (SD=15.63). The details of the baseline characteristics are reported in table 1.

    View this table:
    Table 1

    Baseline characteristics of participants in the three text-messaging adherence trials

    Primary analysis

    In this random effects meta-analysis SMS text messaging significantly improved adherence to ART above 95% (OR 1.38, 95% CI 1.08 to 1.78, p=0.012; see figure 1).

    Figure 1
    Figure 1

    Forest plot for primary, adjusted, sensitivity and subgroup analysis of text messaging to improve adherence to ART. ART levels of education are compared with no formal education; types of text messages are compared with control; 3.3% missing data for primary outcome. ART, antiretroviral therapy; GEE, generalised estimation equations; MI, multiple imputation; RE, random-effects.

    Adjusted analysis

    In the adjusted analysis, female versus male gender (OR 1.38, 95% CI 1.05 to 1.82; p=0.022) and primary education compared with no formal education (OR 1.65, 95% CI 1.10 to 2.48; p=0.016) were significant predictors of adherence >95%. Age and duration on ART were not significantly associated with better adherence (see figure 1).

    Sensitivity analysis

    Text messaging did not significantly improve adherence to ART in the sensitivity analysis using GEE (OR 1.11, 95% CI 0.88 to 1.41; p=0.373). The intraclass correlation coefficient for the primary outcome was 0.18, suggesting considerable differences between the studies. When we considered a threshold of 90% for adherence (OR 1.51, 95% CI 1.07 to 2.13; p=0.018), used multiple imputation techniques (we created five data sets of plausible values that were merged into one for analysis) to replace missing data (OR 1.34, 95% CI 1.05 to 1.72; p=0.021) or conducted a random-effects aggregate data meta-analysis (OR 1.35, 95% CI 1.05 to 1.73, p=0.020, τ2=0; I2=0%) text messaging had a positive effect on adherence to ART. These results are displayed in figure 1.

    Subgroup analyses

    In the subgroup analyses primary education (p=0.039), long weekly (p=0.037), short weekly text messages (p=0.014) and interactive messages (p=0.010) had significant positive interactions with text messaging. Age, gender, duration on ART and motivational content showed no subgroup effects. These results are summarised in figure 1.

    Secondary outcomes

    Text messaging did not significantly reduce mortality or losses to follow-up. Transfers and withdrawals were also not significantly affected by text messaging (see table 2).

    View this table:
    Table 2

    Summary of results for secondary outcomes

    Discussion

    This IPD meta-analysis of three trials found that text messaging had a positive effect on adherence to ART. This effect is stronger in women and in those with a primary education. Weekly and interactive messages are also more effective. Our findings confirm the efficacy of text messaging in improving adherence to ART but demonstrate that this effect may be nuanced and work for some patients more so than others. While there is widespread support for text messaging, our analysis suggests guidelines should be specific about what design text messaging interventions should be implemented.15 ,16

    Three issues stand out in this analysis. First, primary education stood out in the adjusted and subgroup analysis as an important factor influencing the effect of text messaging on ART. Understandably, education is related to literacy and consequently the ability to read text messages. It would seem, however, that beyond primary education, there are no further benefits to be gained, as can be seen in the subgroup analysis, where there was no interaction with secondary education. The potential marginalisation of people with limited literacy with regard to text messaging has been described in other studies.11 ,17 ,18 Second, the subgroups that received weekly messages were more likely to achieve adherence above 95%. This may be because daily messages are intrusive, cause user fatigue and therefore rendered ineffective. However, these analyses should be treated with caution, as the data for daily messages came from only one of the trials.9 Further research is necessary to understand the role of timing on the efficacy of text messaging.

    Third, text messaging did not have a significant effect when we used GEE. A GEE approach estimates population averaged effects, and the estimate of SE is very variable when there are few clusters.19 In this IPD analysis with only three clusters, GEE may not be the appropriate parameter estimator.

    In addition, motivational content seemed to provide no additional value, and may not be necessary in many cases. On the other hand, interactivity boosted the intervention effect and should be encouraged. Still, we advise caution with this interpretation as the effect of interactivity may be a between-study difference. Data for interactivity came from all the participants in the two trials.8 ,10

    This study is not without limitations, notably the fact that the three studies included in this review were conducted in Africa and therefore these findings may not be applicable to other settings. However, this is also strength as adherence enhancing interventions are particularly relevant to Africa, the heart of the HIV pandemic. Combining widely variable text messaging interventions in this meta-analysis may also limit the interpretation of our findings. The generalisability of our findings may also be affected by the differences in the way adherence was measured in the included studies and the average duration on ART (about 6 months); however, our primary choice of analytical method was meant to account for these differences between studies. Even though we did not conduct a systematic search for other RCTs of text messaging to improve adherence to ART, we reached out to the Adherence Trialists Collaboration to identify other trials and none were identified. Other such RCTs, if any, can be included in subsequent iterations of these analyses. Only one of the studies used viral load as a measure of adherence. It is possible our results would be different had we had access to viral load data.

    The strengths of this analysis include the use of IPD, an analysis of whether text messages are more effective in patients with certain characteristics, the use of robust statistical techniques to account for within-study and between-study differences, and our focus on Africa where our research is most needed.

    Conclusion

    Test messaging has a significant effect on adherence to ART. We recommend the use of interactive weekly text messaging to boost adherence to ART, especially in clients with at least a primary level of education. Further research endeavours should investigate the cost-effectiveness of text-messaging interventions and approaches to scaling up.

    References

    1. ↵
      1. Osterberg L,
      2. Blaschke T
      . Adherence to medication. N Engl J Med 2005;353:487–97.
      OpenUrlCrossRefPubMedWeb of Science
    2. ↵
      WHO. Adherence to long-term therapies: evidence for action. Secondary adherence to long-term therapies: evidence for action 2003. http://www.who.int/chp/knowledge/publications/adherence_report/en/
    3. ↵
      1. Paterson DL,
      2. Swindells S,
      3. Mohr J,
      4. et al
      . Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med 2000;133:21–30.
      OpenUrlPubMedWeb of Science
    4. ↵
      1. Knobel H,
      2. Codina C,
      3. Miro JM,
      4. et al
      . [The recommendations of GESIDA/SEFH/PNS for improving adherence to antiretroviral treatment. AIDS Study Group of the Spanish Society of Hospital Pharmacy and the National Plan on AIDS of the Minister of Health and Consumers]. Enferm Infecc Microbiol Clin 2000;18:27–39.
      OpenUrlPubMed
    5. ↵
      UNAIDS. Report on the Global AIDS Epidemic. Secondary Report on the Global AIDS Epidemic 2010. http://www.unaids.org/globalreport/global_report.htm
    6. ↵
      1. Mukund Bahadur KC,
      2. Murray PJ
      . Cell phone short messaging service (SMS) for HIV/AIDS in South Africa: a literature review. Stud Health Technol Inform 2010;160(Pt 1):530–4.
      OpenUrlPubMed
    7. ↵
      1. Mbuagbaw L,
      2. Thabane L,
      3. Ongolo-Zogo P
      . Opening communication channels with people living with HIV using mobile phone text messaging: insights from the CAMPS trial. BMC Res Notes 2013;6:131.
      OpenUrlPubMed
    8. ↵
      1. Lester RT,
      2. Ritvo P,
      3. Mills EJ,
      4. et al
      . Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet 2010;376:1838–45.
      OpenUrlCrossRefPubMedWeb of Science
    9. ↵
      1. Pop-Eleches C,
      2. Thirumurthy H,
      3. Habyarimana JP,
      4. et al
      . Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 2011;25:825–34.
      OpenUrlCrossRefPubMedWeb of Science
    10. ↵
      1. Mbuagbaw L,
      2. Thabane L,
      3. Ongolo-Zogo P,
      4. et al
      . The Cameroon Mobile Phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS ONE 2012;7:e46909.
      OpenUrlPubMed
    11. ↵
      1. Cole-Lewis H,
      2. Kershaw T
      . Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010;32:56–69.
      OpenUrlAbstract/FREE Full Text
    12. ↵
      1. Mbuagbaw L,
      2. van der Kop ML,
      3. Lester RT,
      4. et al
      . Mobile phone text messages for improving adherence to antiretroviral therapy (ART): a protocol for an individual patient data meta-analysis of randomised trials. BMJ Open 2013;3:e002954.
      OpenUrlAbstract/FREE Full Text
    13. ↵
      1. Bangsberg DR
      . Less Than 95% adherence to nonnucleoside reverse-transcriptase inhibitor therapy can lead to viral suppression. Clin Infect Dis 2006;43:939–41.
      OpenUrlAbstract/FREE Full Text
    14. ↵
      1. Apisarnthanarak A,
      2. Mundy LM
      . Long-term outcomes of HIV-infected patients with <95% rates of adherence to nonnucleoside reverse-transcriptase inhibitors. Clin Infect Dis 2010;51:115–17.
      OpenUrlFREE Full Text
    15. ↵
      1. Horvath T,
      2. Azman H,
      3. Kennedy GE,
      4. et al
      . Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev 2012;3:CD009756.
      OpenUrlPubMed
    16. ↵
      1. Thompson MA,
      2. Aberg JA,
      3. Hoy JF,
      4. et al
      . Antiretroviral treatment of adult HIV infection: 2012 recommendations of the International Antiviral Society-USA panel. JAMA 2012;308:387–402.
      OpenUrlCrossRefPubMedWeb of Science
    17. ↵
      1. Siedner MJ,
      2. Haberer JE,
      3. Bwana MB,
      4. et al
      . High acceptability for cell phone text messages to improve communication of laboratory results with HIV-infected patients in rural Uganda: a cross-sectional survey study. BMC Med Inform Decis Mak 2012;12:56.
      OpenUrlPubMed
    18. ↵
      1. Person AK,
      2. Blain ML,
      3. Jiang H,
      4. et al
      . Text messaging for enhancement of testing and treatment for tuberculosis, human immunodeficiency virus, and syphilis: a survey of attitudes toward cellular phones and healthcare. Telemed J E Health 2011;17:189–95.
      OpenUrlPubMed
    19. ↵
      1. Ma J,
      2. Thabane L,
      3. Kaczorowski J,
      4. et al
      . Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: the Community Hypertension Assessment Trial (CHAT). BMC Med Res Methodol 2009;9:37.
      OpenUrlPubMed

    Footnotes

    • Contributors All the authors participated in planning and conducting the study, and approved the final version. LM and LT conceived of the idea. LM wrote the first draft of this manuscript. MLvdK, RTL, HT, CP-E, MS, LD, EJM and CY revised several versions of the manuscript. CY conducted the statistical analysis.

    • Competing interests RTL is the founder of WelTel, a non-profit organisation designed to scale-up evidence-based mHealth interventions. MLV is supported by a Canadian Institutes of Health Research Doctoral Award—Doctoral Foreign Study Award (October 2012), offered in partnership with the CIHR Strategy for Patient-Oriented Research and the CIHR HIV/AIDS Research Initiative. RTL is supported in part by an mHealth grant from Grand Challenges Canada.

    • Ethics approval This is a secondary analysis of data.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement No additional data are available.