Skip to main content
Log in

A Proposal for Quality Standards for Measuring Medication Adherence in Research

  • Substantive Review
  • Published:
AIDS and Behavior Aims and scope Submit manuscript

Abstract

A decade after widespread recognition that adherence to medication regimens is key to antiretroviral effectiveness, considerable controversy remains regarding a “gold standard” for adherence measurement. Each adherence measurement approach has strengths and weaknesses and each rests on specific assumptions. The range of assumptions regarding adherence measurement and the diversity with which each approach is implemented strongly suggest that the evaluation of a particular measure outside of the context in which it was used (e.g. the study’s operational protocol) may result in undeserved confidence or lack of confidence in study results. The purpose of this paper is to propose a set of best practices across commonly used measurement methods. Recommendations regarding what information should be included in published reports regarding how adherence was measured are provided to promote improvement in the quality of measurement of medication adherence in research.

Resumen

Una década después del reconocimiento generalizado que la adherencia a los regímenes de medicación es fundamental para la efectividad del tratamiento antirretroviral (ARV), se mantiene una gran controversia con respecto al “patrón oro” para la calculación de adherencia. Cada método de calculación de adherencia tiene fortalezas y debilidades y cada uno se basa en suposiciones específicas. La variedad de suposiciones sobre la calculación de adherencia y la diversidad con la cual cada método es implementado, encarecidamente sugiere que la evaluación de un método en particular fuera del contexto del cual se utiliza (por ejemplo el protocolo operativo del estudio) puede resultar en confianza inmerecida o falta de confianza en los resultados del estudio. El propósito de este manuscrito es proponer una serie de las mejores prácticas de métodos de calculación comúnmente utilizados. Las recomendaciones respecto a la información que se debe incluir en los informes publicados acerca de cómo la adherencia fue calculada, son proporcionados para promover mejoría en la calidad de la calculación de adherencia al régimen de medicación en estudios de investigación.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Katzenstein DA, Lyons C, Molaghan JP, Ungvarski P, Wolfe GS, Williams A. HIV therapeutics: confronting adherence. J Assoc Nurses AIDS Care. 1997;8(Suppl):46–58.

    Article  PubMed  Google Scholar 

  2. Williams A, Friedland G. Adherence, compliance, and HAART. AIDS Clin Care. 1997;9(7):51–4. 8.

    PubMed  CAS  Google Scholar 

  3. Wainberg MA, Friedland G. Public health implications of antiretroviral therapy and HIV drug resistance. J Am Med Assoc. 1998;279(24):1977–83.

    Article  CAS  Google Scholar 

  4. Haubrich RH, Little SJ, Currier JS, Forthal DN, Kemper CA, Beall GN, et al. The value of patient-reported adherence to antiretroviral therapy in predicting virologic and immunologic response. AIDS. 1999;13(9):1099–107.

    Article  PubMed  CAS  Google Scholar 

  5. Chesney MA, Ickovics J, Hecht FM, Sikipa G, Rabkin J. Adherence: a necessity for successful HIV combination therapy. AIDS. 1999;13 Suppl A:S271–8.

    Google Scholar 

  6. Friedland GH, Williams A. Attaining higher goals in HIV treatment: the central importance of adherence. AIDS. 1999;13(Suppl 1):S61–72.

    PubMed  Google Scholar 

  7. Charania MR. CDC review and dissemination of evidence-based HIV treatment adherence interventions. 5th international conference on HIV treatment adherence, Miami 2010.

  8. Research Synthesis Group CDC. http://www.cdc.gov/hiv/topics/research/prs/ma-chapter.htm. Accessed 26 Feb 2012.

  9. Acri T, TenHave TR, Chapman JC, Bogner HR, Gross R. Lack of association between retrospectively collected pharmacy refill data and electronic drug monitoring of antiretroviral adherence. AIDS Behav. 2010;14(4):748–54.

    Article  PubMed  Google Scholar 

  10. Arnsten JH, Demas PA, Farzadegan H, Grant RW, Gourevitch MN, Chang CJ, et al. Antiretroviral therapy adherence and viral suppression in HIV-infected drug users: comparison of self-report and electronic monitoring. Clin Infect Dis. 2001;33(8):1417–23.

    Article  PubMed  CAS  Google Scholar 

  11. Bangsberg D, Hecht F, Charlebois E, Chesney M, Moss A. Comparing objective measures of adherence to HIV antiretroviral therapy: electronic medication monitors and unannounced pill counts. AIDS Behav. 2001;5(3):275–81.

    Article  Google Scholar 

  12. Fairley CK, Permana A, Read TR. Long-term utility of measuring adherence by self-report compared with pharmacy record in a routine clinic setting. HIV Med. 2005;6(5):366–9.

    Article  PubMed  CAS  Google Scholar 

  13. Hugen PW, Langebeek N, Burger DM, Zomer B, van Leusen R, Schuurman R, et al. Assessment of adherence to HIV protease inhibitors: comparison and combination of various methods, including MEMS (electronic monitoring), patient and nurse report, and therapeutic drug monitoring. J Acquir Immune Defic Synd. 2002;30(3):324–34.

    CAS  Google Scholar 

  14. Liu H, Golin CE, Miller LG, Hays RD, Beck CK, Sanandaji S, et al. A comparison study of multiple measures of adherence to HIV protease inhibitors. Ann Intern Med. 2001;134(10):968–77.

    PubMed  CAS  Google Scholar 

  15. Lima VD, Harrigan R, Murray M, Moore DM, Wood E, Hogg RS, et al. Differential impact of adherence on long-term treatment response among naive HIV-infected individuals. AIDS. 2008;22(17):2371–80.

    Article  PubMed  Google Scholar 

  16. Mannheimer S, Friedland G, Matts J, Child C, Chesney M. The consistency of adherence to antiretroviral therapy predicts biologic outcomes for human immunodeficiency virus-infected persons in clinical trials. Clin Infect Dis. 2002;34(8):1115–21.

    Article  PubMed  Google Scholar 

  17. Paterson DL, Swindells S, Mohr J, Brester M, Vergis EN, Squier C, et al. Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med. 2000;133(1):21–30.

    PubMed  CAS  Google Scholar 

  18. Grossberg R, Zhang Y, Gross R. A time-to-prescription-refill measure of antiretroviral adherence predicted changes in viral load in HIV. J Clin Epidemiol. 2004;57(10):1107–10.

    Article  PubMed  Google Scholar 

  19. Knobel H, Guelar A, Carmona A, Espona M, Gonzalez A, Lopez-Colomes JL, et al. Virologic outcome and predictors of virologic failure of highly active antiretroviral therapy containing protease inhibitors. AIDS Patient Care STDS. 2001;15(4):193–9.

    Article  PubMed  CAS  Google Scholar 

  20. Nieuwkerk PT, Oort FJ. Self-reported adherence to antiretroviral therapy for HIV-1 infection and virologic treatment response: a meta-analysis. J Acquir Immune Defic Synd. 2005;38(4):445–8.

    Article  Google Scholar 

  21. de Garcia Olalla P, Knobel H, Carmona A, Guelar A, Lopez-Colomes JL, Cayla JA. Impact of adherence and highly active antiretroviral therapy on survival in HIV-infected patients. J Acquir Immune Defic Synd. 2002;30(1):105–10.

    Google Scholar 

  22. Harrigan PR, Hogg RS, Dong WW, Yip B, Wynhoven B, Woodward J, et al. Predictors of HIV drug-resistance mutations in a large antiretroviral-naive cohort initiating triple antiretroviral therapy. J Infect Dis. 2005;191(3):339–47.

    Article  PubMed  CAS  Google Scholar 

  23. King MS, Brun SC, Kempf DJ. Relationship between adherence and the development of resistance in antiretroviral-naive, HIV-1-infected patients receiving lopinavir/ritonavir or nelfinavir. J Infect Dis. 2005;191(12):2046–52.

    Article  PubMed  CAS  Google Scholar 

  24. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, Zwickl B, et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. AIDS Care. 2000;12(3):255–66.

    Article  PubMed  CAS  Google Scholar 

  25. Giordano TP, Guzman D, Clark R, Charlebois ED, Bangsberg DR. Measuring adherence to antiretroviral therapy in a diverse population using a visual analogue scale. HIV Clin Trials. 2004;5(2):74–9.

    Article  PubMed  Google Scholar 

  26. Maneesriwongul WL, Tulathong S, Fennie KP, Williams AB. Adherence to antiretroviral medication among HIV-positive patients in Thailand. J Acquir Immune Defic Synd. 2006;43(Suppl 1):S119–22.

    Google Scholar 

  27. Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, Mugyenyi P, et al. Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Synd. 2004;36(5):1100–2.

    Article  CAS  Google Scholar 

  28. Glass TR, De Geest S, Weber R, Vernazza PL, Rickenbach M, Furrer H, et al. Correlates of self-reported nonadherence to antiretroviral therapy in HIV-infected patients: the Swiss HIV Cohort Study. J Acquir Immune Defic Synd. 2006;41(3):385–92.

    Article  Google Scholar 

  29. Mannheimer S, Thackeray L, Huppler Hullsiek K, Chesney M, Gardner EM, Wu AW. A randomized comparison of two instruments for measuring self-reported antiretroviral adherence. AIDS Care. 2008;20(2):161–9.

    Article  PubMed  CAS  Google Scholar 

  30. Lu M, Safren SA, Skolnik PR, Rogers WH, Coady W, Hardy H, et al. Optimal recall period and response task for self-reported HIV medication adherence. AIDS Behav. 2008;12(1):86–94.

    Article  PubMed  Google Scholar 

  31. Simoni JM, Kurth AE, Pearson CR, Pantalone DW, Merrill JO, Frick PA. Self-report measures of antiretroviral therapy adherence: a review with recommendations for HIV research and clinical management. AIDS Behav. 2006;10(3):227–45.

    Article  PubMed  Google Scholar 

  32. Kerr T, Hogg RS, Yip B, Tyndall MW, Montaner J, Wood E. Validity of self-reported adherence among injection drug users. J Int Assoc Physicians AIDS Care. 2008;7(4):157–9.

    Article  Google Scholar 

  33. Wilson IB, Carter AE, Berg KM. Improving the self-report of HIV antiretroviral medication adherence: is the glass half full or half empty? Curr HIV AIDS Rep. 2009;6(4):177–86.

    Article  Google Scholar 

  34. Deschamps AE, De Geest S, Vandamme AM, Bobbaers H, Peetermans WE, Van Wijngaerden E. Diagnostic value of different adherence measures using electronic monitoring and virologic failure as reference standards. AIDS Patient Care STDS. 2008;22(9):735–43.

    Article  PubMed  Google Scholar 

  35. Liu H, Miller LG, Hays RD, Wagner G, Golin CE, Hu W, et al. A practical method to calibrate self-reported adherence to antiretroviral therapy. J Acquir Immune Defic Synd. 2006;43(Suppl 1):S104–12.

    Google Scholar 

  36. Halkitis PN, Kutnick AH, Slater S. The social realities of adherence to protease inhibitor regimens: substance use, health care and psychological states. J Health Psychol. 2005;10(4):545–58.

    Article  PubMed  Google Scholar 

  37. Pearson CR, Simoni JM, Hoff P, Kurth AE, Martin DP. Assessing antiretroviral adherence via electronic drug monitoring and self-report: an examination of key methodological issues. AIDS Behav. 2007;11(2):161–73.

    Article  PubMed  Google Scholar 

  38. Walsh JC, Mandalia S, Gazzard BG. Responses to a 1 month self-report on adherence to antiretroviral therapy are consistent with electronic data and virological treatment outcome. AIDS. 2002;16(2):269–77.

    Article  PubMed  Google Scholar 

  39. Nieuwkerk PT, de Boer-van der Kolk IM, Prins JM, Locadia M, Sprangers MA. Self-reported adherence is more predictive of virological treatment response among patients with a lower tendency towards socially desirable responding. Antivir Ther. 2010;15(6):913–6.

    Article  PubMed  CAS  Google Scholar 

  40. Berg KM, Arnsten JH. Practical and conceptual challenges in measuring antiretroviral adherence. J Acquir Immune Defic Synd. 2006;43(Suppl 1):S79–87.

    Google Scholar 

  41. Chesney MA. The elusive gold standard. Future perspectives for HIV adherence assessment and intervention. J Acquir Immune Defic Synd. 2006;43(Suppl 1):S149–55.

    Google Scholar 

  42. Riekert KA, Rand CS. Electronic monitoring of medication adherence: when is high-tech best? J Clin Psychol Med Settings. 2002;9(1):25–34.

    Article  Google Scholar 

  43. Zeller A, Ramseier E, Teagtmeyer A, Battegay E. Patients’ self-reported adherence to cardiovascular medication using electronic monitors as comparators. Hypertens Res. 2008;31(11):2037–43.

    Article  PubMed  Google Scholar 

  44. Acosta FJ, Bosch E, Sarmiento G, Juanes N, Caballero-Hidalgo A, Mayans T. Evaluation of noncompliance in schizophrenia patients using electronic monitoring (MEMS®) and its relationship to sociodemographic, clinical and psychopathological variables. Schizophr Res. 2009;107(2–3):213–7.

    Article  PubMed  Google Scholar 

  45. Ailinger RL, Black PL, Lima-Garcia N. Use of electronic monitoring in clinical nursing research. Clin Nurs Res. 2008;17(2):89–97.

    Article  PubMed  Google Scholar 

  46. Vriesendorp R, Cohen A, Kristanto P, Vrijens B, Rakesh P, Anand B, et al. Adherence to HAART therapy measured by electronic monitoring in newly diagnosed HIV patients in Botswana. Eur J Clin Pharmacol. 2007;63(12):1115–21.

    Article  PubMed  Google Scholar 

  47. Holstad MM, Foster V, Diiorio C, McCarty F, Teplinskiy I. An examination of the psychometric properties of the Antiretroviral General Adherence Scale (AGAS) in two samples of HIV-infected individuals. J Assoc Nurses AIDS Care. 2010;21(2):162–72.

    Article  PubMed  Google Scholar 

  48. Dunbar-Jacob J, Erlen JA, Schlenk EA, Ryan CM, Sereika SM, Doswell WM. Adherence in chronic disease. Annu Rev Nurs Res. 2000;18:48–90.

    PubMed  CAS  Google Scholar 

  49. Haberer JE, Kahane J, Kigozi I, Emenyonu N, Hunt P, Martin J, et al. Real-time adherence monitoring for HIV antiretroviral therapy. AIDS Behav. 2010;14(6):1340–6.

    Article  PubMed  Google Scholar 

  50. Gill CJ, Sabin LL, Hamer DH, Keyi X, Jianbo Z, Li T, et al. Importance of dose timing to achieving undetectable viral loads. AIDS Behav. 2010;14(4):785–93.

    Article  PubMed  Google Scholar 

  51. Contardo C, Black AC, Beauvais J, Dieckhaus K, Rosen MI. Relationship of prospective memory to neuropsychological function and antiretroviral adherence. Arch Clin Neuropsychol. 2009;24(6):547–54.

    Article  PubMed  Google Scholar 

  52. Ettenhofer ML, Foley J, Castellon SA, Hinkin CH. Reciprocal prediction of medication adherence and neurocognition in HIV/AIDS. Neurology. 2010;74(15):1217–22.

    Article  PubMed  Google Scholar 

  53. Woods SP, Dawson MS, Weber E, Gibson S, Grant I, Atkinson JH. Timing is everything: antiretroviral nonadherence is associated with impairment in time-based prospective memory. J Int Neuropsychol Soc. 2009;15(1):42–52.

    Article  PubMed  CAS  Google Scholar 

  54. Knafl GJ, Bova CA, Fennie KP, O’Malley JP, Dieckhaus KD, Williams AB. An analysis of electronically monitored adherence to antiretroviral medications. AIDS Behav. 2010;14(4):755–68.

    Article  PubMed  Google Scholar 

  55. Knafl GJ, Delucchi KL, Bova CA, Fennie KP, Ding K, Williams AB. A systematic approach for analyzing electronically monitored adherence data. In: Ekwalll B, Cronquist M, editors. Micro electro mechanical systems: Hauppage: Nova Science Publishers, Inc.; 2010.

  56. Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB. Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav. 2005;9(1):103–10.

    Article  PubMed  Google Scholar 

  57. Fennie KP, Bova CA, Williams AB. Adjusting and censoring electronic monitoring device data. Implications for study outcomes. J Acquir Immune Defic Synd. 2006;43(Suppl 1):S88–95.

    Google Scholar 

  58. Denhaerynck K, Schafer-Keller P, Young J, Steiger J, Bock A, De Geest S. Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients. BMC Med Res Methodol. 2008;8:5.

    Article  PubMed  Google Scholar 

  59. Deschamps AE, Van Wijngaerden E, Denhaerynck K, De Geest S, Vandamme AM. Use of electronic monitoring induces a 40-day intervention effect in HIV patients. J Acquir Immune Defic Synd. 2006;43(2):247–8.

    Google Scholar 

  60. Jasti S, Siega-Riz AM, Cogswell ME, Hartzema AB. Correction for errors in measuring adherence to prenatal multivitamin/mineral supplement use among low-income women. J Nutr. 2006;136:479–83.

    PubMed  CAS  Google Scholar 

  61. Llabre MM, Weaver KE, Duran RE, Antoni MH, McPherson-Baker S, Schneiderman N. A measurement model of medication adherence to highly active antiretroviral therapy and its relation to viral load in HIV-positive adults. AIDS Patient Care STDs. 2006;20(10):701–11.

    Article  PubMed  Google Scholar 

  62. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986;1(8476):307–10.

    Article  CAS  Google Scholar 

  63. Dahri K, Shalansky SJ, Jang L, Jung L, Ignaszewski AP, Clark C. Accuracy of a provincial prescription database for assessing medication adherence in heart failure patients. Ann Pharmacother. 2008;42(3):361–7.

    Article  PubMed  Google Scholar 

  64. Knafl GJ, Fennie KP, Bova C, Dieckhaus K, Williams AB. Electronic monitoring device event modelling on an individual-subject basis using adaptive Poisson regression. Stat Med. 2004;23(5):783–801.

    Article  PubMed  Google Scholar 

  65. Kastrissios H, Suarez JR, Katzenstein D, Girard P, Sheiner LB, Blaschke TF. Characterizing patterns of drug-taking behavior with a multiple drug regimen in an AIDS clinical trial. AIDS. 1998;12(17):2295–303.

    Article  PubMed  CAS  Google Scholar 

  66. Moss AR, Hahn JA, Perry S, Charlebois ED, Guzman D, Clark RA, et al. Adherence to highly active antiretroviral therapy in the homeless population in San Francisco: a prospective study. Clin Infect Dis. 2004;39(8):1190–8.

    Article  PubMed  Google Scholar 

  67. Kalichman SC, Amaral CM, Stearns H, White D, Flanagan J, Pope H, et al. Adherence to antiretroviral therapy assessed by unannounced pill counts conducted by telephone. J Gen Intern Med. 2007;22(7):1003–6.

    Article  PubMed  Google Scholar 

  68. Bisson GP, Rowh A, Weinstein R, Gaolathe T, Frank I, Gross R. Antiretroviral failure despite high levels of adherence: discordant adherence-response relationship in Botswana. J Acquri Immune Defic Synd. 2008;49(1):107–10.

    Article  Google Scholar 

  69. Weidle PJ, Wamai N, Solberg P, Liechty C, Sendagala S, Were W, et al. Adherence to antiretroviral therapy in a home-based AIDS care programme in rural Uganda. Lancet. 2006;368(9547):1587–94.

    Article  PubMed  Google Scholar 

  70. San Lio MM, Carbini R, Germano P, Guidotti G, Mancinelli S, Magid NA. Evaluating adherence to highly active antiretroviral therapy with use of pill counts and viral load measurement in the drug resources enhancement against AIDS and malnutrition program in Mozambique. Clin Infect Dis. 2008;46(10):1609–16.

    Article  PubMed  Google Scholar 

  71. McNabb J, Ross JW, Abriola K, Turley C, Nightingale CH, Nicolau DP. Adherence to highly active antiretroviral therapy predicts virologic outcome at an inner-city human immunodeficiency virus clinic. Clin Infect Dis. 2001;33(5):700–5.

    Article  PubMed  CAS  Google Scholar 

  72. McMahon JH, Jordan MR, Kelley K, Bertagnolio S, Hong SY, Wanke CA, et al. Pharmacy adherence measures to assess adherence to antiretroviral therapy: review of the literature and implications for treatment monitoring. Clin Infect Dis. 2011;52(4):493–506.

    Article  PubMed  Google Scholar 

  73. Steiner JF, Prochazka AV. The assessment of refill compliance using pharmacy records: methods, validity, and applications. J Clin Epidemiol. 1997;50(1):105–16.

    Article  PubMed  CAS  Google Scholar 

  74. Hess LM, Raeble MA, Conner DA, Malone DC. Measurement of adhrence in pharmacy administrative databases: a proposal for standard definitions and preferred measures. Ann Pharmacother. 2006;40:1280–8.

    Article  PubMed  Google Scholar 

  75. Andrade SE, Kahler KH, Frech F, Chan KA. Methods for evaluation of medication adherence and persistence using automated databases. Pharmacoepidemiol Drug Saf. 2006;15:565–74.

    Article  PubMed  Google Scholar 

  76. Kitahata MM, Reed SD, Dillingham PW, Van Rompaey SE, Young AA, Harrington RD, et al. Pharmacy-based assessment of adherence to HAART predicts virologic and immunologic treatment response and clinical progression to AIDS and death. Int J STD AIDS. 2004;15(12):803–10.

    Article  PubMed  Google Scholar 

  77. de Boer IM, Prins JM, Sprangers MAG, Nieuwkerk PT. Using different calculations of pharmacy refill adherence to predict virological failure among HIV-infected patients. J Acquir Immune Defic Syndr. 2010;55(5):635–40.

    Article  PubMed  Google Scholar 

  78. Bogen. Theory and observation in science. 2009. http://plato.stanford.edu/entries/scienc-theory-observation. Accessed 26 Feb 2012.

  79. Muckler FA, Seven SA. Selecting performance-measures—objective versus subjective measurement. Hum Factors. 1992;34(4):441–55.

    Google Scholar 

  80. Allmark P. Bayes and health care research. Med Health Care Philos. 2004;7(3):321–32.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ann Bartley Williams.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Williams, A.B., Amico, K.R., Bova, C. et al. A Proposal for Quality Standards for Measuring Medication Adherence in Research. AIDS Behav 17, 284–297 (2013). https://doi.org/10.1007/s10461-012-0172-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10461-012-0172-7

Keywords

Navigation