Article Text

Original research
Oral pre-exposure prophylaxis (PrEP) to prevent HIV: a systematic review and meta-analysis of clinical effectiveness, safety, adherence and risk compensation in all populations
  1. Eamon O Murchu1,2,
  2. Liam Marshall1,
  3. Conor Teljeur1,
  4. Patricia Harrington1,
  5. Catherine Hayes3,
  6. Patrick Moran1,2,
  7. Mairin Ryan1,4
  1. 1Health Technology Assessment Directorate, Health Information and Quality Authority, Dublin 7, Ireland
  2. 2Centre for Health Policy and Management, Trinity College Dublin, Dublin 2, Ireland
  3. 3TCD Institute of Population Health, Tallaght, Trinity College Dublin, Dublin 24, Ireland
  4. 4Department of Pharmacology and Therapeutics, Trinity Health Sciences, Trinity College Dublin, Dublin 8, Ireland
  1. Correspondence to Dr Eamon O Murchu; eamonvalmont{at}gmail.com

Abstract

Objective To conduct a systematic review and meta-analysis of randomised controlled trials (RCTs) of the effectiveness and safety of oral pre-exposure prophylaxis (PrEP) to prevent HIV.

Methods Databases (PubMed, Embase and the Cochrane Register of Controlled Trials) were searched up to 5 July 2020. Search terms for ‘HIV’ were combined with terms for ‘PrEP’ or ‘tenofovir/emtricitabine’. RCTs were included that compared oral tenofovir-containing PrEP to placebo, no treatment or alternative medication/dosing schedule. The primary outcome was the rate ratio (RR) of HIV infection using a modified intention-to-treat analysis. Secondary outcomes included safety, adherence and risk compensation. All analyses were stratified a priori by population: men who have sex with men (MSM), serodiscordant couples, heterosexuals and people who inject drugs (PWIDs). The quality of individual studies was assessed using the Cochrane risk-of-bias tool, and the certainty of evidence was assessed using GRADE.

Results Of 2803 unique records, 15 RCTs met our inclusion criteria. Over 25 000 participants were included, encompassing 38 289 person-years of follow-up data. PrEP was found to be effective in MSM (RR 0.25, 95% CI 0.1 to 0.61; absolute rate difference (RD) −0.03, 95% CI −0.01 to −0.05), serodiscordant couples (RR 0.25, 95% CI 0.14 to 0.46; RD −0.01, 95% CI −0.01 to −0.02) and PWID (RR 0.51, 95% CI 0.29 to 0.92; RD −0.00, 95% CI −0.00 to −0.01), but not in heterosexuals (RR 0.77, 95% CI 0.46 to 1.29). Efficacy was strongly associated with adherence (p<0.01). PrEP was found to be safe, but unrecognised HIV at enrolment increased the risk of viral drug resistance mutations. Evidence for behaviour change or an increase in sexually transmitted infections was not found.

Conclusions PrEP is safe and effective in MSM, serodiscordant couples and PWIDs. Additional research is needed prior to recommending PrEP in heterosexuals. No RCTs reported effectiveness or safety data for other high-risk groups, such as transgender women and sex workers.

PROSPERO registration number CRD42017065937.

  • epidemiology
  • HIV & AIDS
  • public health
  • infectious diseases

Data availability statement

All data relevant to the study are included in the article or uploaded as supplementary information.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • A systematic review and meta-analysis of randomised controlled trials (RCTs) was conducted of the efficacy and safety of oral pre-exposure prophylaxis (PrEP) to prevent HIV following best practice guidelines (Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and Grading of Recommendations Assessment, Development and Evaluation framework).

  • Observational studies were excluded from this review, and as such, PrEP effectiveness may be lower in real-world settings.

  • Change in sexual behaviour, or ‘risk compensation’, is difficult to ascertain based on RCT evidence alone.

  • Due to substantial variation in adherence across studies, findings should be interpreted with caution.

Introduction

While the incidence of HIV has declined worldwide over the past decade, 1.5 million new HIV infections occurred in 2020,1 highlighting the ongoing need for new and effective HIV prevention initiatives. Pre-exposure prophylaxis (PrEP) is a novel biomedical form of HIV prevention method whereby oral antiretrovirals (most commonly a combination of tenofovir and emtricitabine (FTC)) are taken by individuals at high risk of HIV acquisition to prevent infection. PrEP aims to complement the existing arsenal of HIV prevention strategies, such as the promotion of safer sex practices, treatment as prevention and postexposure prophylaxis after sexual exposure.

In 2014, the WHO recommended offering PrEP to men who have sex with men (MSM),2 based on a 2010 trial that demonstrated the effectiveness in this group.3 Subsequently, in 2015, they broadened the recommendation to include anyone at substantial risk of HIV infection (defined as risk of 3 per 100 person-years in the absence of PrEP),4 based on further evidence of the acceptability and effectiveness in other populations. While the success of early PrEP studies in MSM was replicated in the years that followed,5 6 uncertainty still exists in other key populations. Many initial studies that failed to demonstrate effectiveness were plagued by poor adherence, such as those that enrolled heterosexual women.7 Also, of major concern to public health officials and policy-makers is the potential occurrence of ‘risk compensation’ in PrEP users (an increase in unsafe sexual practices due to the knowledge that PrEP is protective against HIV), which may lead to an increase in sexually transmitted infections (STIs), exacerbating the secular trend of rising STI rates in many countries.

Since the most recent WHO recommendation, a number of new trials in diverse populations have been conducted. We therefore conducted a systematic review and meta-analysis to retrieve the most up-to-date evidence on the effectiveness and safety of oral PrEP compared with placebo, no treatment or alternative oral PrEP medication/dosing schedule in all populations, with a particular emphasis on adherence and risk compensation. This review aimed to inform the decision of the Irish government to implement a PrEP programme and to assist in the development of national clinical practice guidelines on PrEP for HIV prevention.

Methods

A systematic review and meta-analysis of randomised controlled trials (RCTs) was conducted, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.8 The quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation framework.9 This framework is commonly used internationally to aid decisions by policy-makers and ensures a systematic and transparent approach in the development of clinical practice recommendations. This study was registered with PROSPERO (ID: CRD42017065937) and followed an agreed protocol (online supplemental material 1).

Search strategy and selection criteria

Electronic searches were conducted in MEDLINE (PubMed), Embase, the Cochrane Register of Controlled Trials, CRD DARE Database, Morbidity and Mortality Weekly Report (Centers for Disease Control and Prevention) and Eurosurveillance reports. Search terms that related to ‘HIV’ were combined with search terms that related to ‘PrEP’ or ‘tenofovir’, and filters for study design (RCTs) were applied (the full search strategy for PubMed is provided in online supplemental material 2). Databases were searched on 5 July 2020. No restrictions were placed based on the location of the intervention or the date of publication. No language restrictions were used; articles in languages other than English were translated where necessary. Table 1 outlines the inclusion criteria for study selection. Animal studies, studies that did not report primary outcome data (HIV incidence) and abstracts from conference proceedings were excluded.

Table 1

Inclusion criteria for studies

It was decided a priori that all analyses of effectiveness would be stratified by population. The four populations were MSM, serodiscordant heterosexual couples (individuals whose partners are HIV positive and not virally suppressed on antiretroviral medications), heterosexuals and people who inject drugs (PWIDs).

Data collection

Results of the database search were exported to Endnote V.X7. Full-text articles were obtained for all citations identified as potentially eligible. Two reviewers (EOM and LM) independently screened these according to the prespecified inclusion criteria. Two reviewers (EOM and LM) independently performed data extraction and assessed the risk of bias according to the Cochrane risk-of-bias tool.10 An overall assessment of the quality of the evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach that included an assessment of other biases, such as publication bias.9

Statistical analysis

The primary outcome measure was the rate ratio (RR) of HIV infection for each population. The rate of HIV infection represented the number of HIV infections that occurred per person-years of follow-up data, and the RR compares the rate of HIV infection in the PrEP group with control. The rate of HIV infection (per person-years) was favoured over risk of HIV infection as rate incorporates both the number of participants and the duration of follow-up, allowing for comparisons across studies that may vary significantly in terms of study duration. The absolute rate difference (RD) of HIV infection was also estimated for each population; in this case, the RD represented the actual difference in the observed rate of HIV between PrEP and control groups per person-year of follow-up data. Meta-analyses of RRs and RDs were performed in Review Manager V.5.3 using Mantel-Haenszel random effects models.

A modified intention-to-treat analysis was employed (and not per-protocol analysis); therefore, effectiveness was a function of both efficacy of the drug itself and adherence. A modified intention-to-treat analysis was selected instead of a standard intention-to-treat analysis to account for unrecognised HIV infection at enrolment. In the modified intention-to-treat analysis, all patients who were HIV negative at enrolment in the study were included in the analyses, and individuals with an unrecognised HIV infection prior to enrolment were excluded.

Clinical heterogeneity was assessed by the reviewers based on the description of the interventions and comparators in the RCTs. Statistical heterogeneity was examined using the I2 statistic (I2 values above 75% represented considerable heterogeneity, per Cochrane Handbook V.6.2, 2021, chapter 10, section 10.10.2). If there was sufficient clinical homogeneity across studies, results were pooled using a random effects Mantel–Haenszel model.

In the estimation of PrEP effectiveness, subgroups of studies were defined by dosing schedule, comparator and adherence. Analyses were stratified by population and adherence. Adherence was dichotomised for subgroup analyses: if the proportion of participants who were adherent was ≥80%, the study was considered ‘high adherence’ and <80% was considered ‘low adherence’. Commonly used measures of adherence include self-report, pill counts, medication event monitoring systems, structured interviews and plasma drug detection methods. Plasma drug monitoring is considered the gold standard for adherence assessment; plasma drug detection was favoured over self-report/pill count in the determination of adherence as it minimises recall bias. In studies that measured only plasma drug concentration in participants who reported taking the study drug, the proportion of samples with study drug detected was multiplied by the self-reported adherence rate. In studies that measured adherence in a number of ways without undertaking plasma drug monitoring, taking a conservative approach, the lowest estimate of adherence was used for subgroup analysis.

To investigate the relationship between efficacy and adherence, a metaregression analysis was conducted (metaregression was considered the appropriate model as it accounts for trial size in analyses). In this analysis, adherence was a continuous variable, and only studies that confirmed adherence through plasma drug monitoring were included. Analyses were conducted in R V.3.6.2, including the meta R package.

In the assessment of the safety of PrEP, the definitions for adverse events and serious adverse events followed the definitions used in the primary studies. Outcome measures were expressed as both RRs of safety events and RDs between groups. In the assessment of behaviour change, the effect of PrEP on condom use, number of sexual partners, recreational drug use and the rate of new STI diagnoses (as a proxy for condomless sex) were assessed. In the assessment of PrEP-related drug mutations, subgroups included patients with unrecognised acute HIV infection at the time of enrolment and patients who seroconverted during the course of the trial. Where there was a lack of data or agreed definitions for these outcomes, a narrative review was performed.

In the case of pooling data for rare events, there can be issues with the inclusion of studies with zero events in one or both arms.11 A common approach where there are zero events in one arm is to apply a continuity correction whereby all cells in the two by two table for a given study have 0.5 added to avoid division by zero. This approach can lead to bias, particularly for small trials or those with imbalanced arms. Trials with zero events in both arms are typically excluded, leading to a loss of information. Approaches are available to include zero event trials with application of a continuity correction. For this study, if trials with zero events in one or both arms were identified, a sensitivity analysis using a random effects Poisson regression11 and beta-binomial12 models was applied to determine whether the results were sensitive to the presence of trials with zero events in one or both arms. The main analysis excluded trials with zero events in both arms, as has been recommended when a treatment effect is considered likely.13

In the assessment of publication bias, funnel plots were used when there were more than 10 studies available for analysis. Standard approaches to funnel plots and tests for small study bias use the log(OR) or log(RR), which are not independent of their estimated SE creating a bias. Those tests also have the limitation that they omit studies that have zero events in both arms. To overcome these issues, the arcsine test for publication bias was used.14

Patient and public involvement

Patients or the public were not involved in this research.

Results

A total of 2803 unique records were retrieved, resulting in 73 studies for full-text review (figure 1 provides the PRISMA diagram of study selection, and the list of excluded studies, along with reasons, is provided in online supplemental material 3.1). Fifteen RCTs met our inclusion criteria and were included in the assessment of effectiveness and safety. Seven RCTs were placebo-controlled trials that evaluated daily oral PrEP.3 7 15–19 Two studies randomised participants to receive either immediate or delayed PrEP.6 20 Three placebo-controlled trials investigated non-daily PrEP, including intermittent and ‘on-demand’ (also known as event-based) PrEP.5 21 22 Two RCTs did not contain a ‘no PrEP’ arm (placebo or no medication): one compared tenofovir with tenofovir/FTC23 and one compared three different PrEP dosing schedules.24 One study contained three arms: PrEP, placebo and ‘no pill’.25 Four distinct patient populations were assessed. Six RCTs enrolled MSM3 5 6 20 21 25; five enrolled heterosexual participants7 16 17 19 24; three enrolled serodiscordant couples18 22 23; and one enrolled PWIDs.15

Figure 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses diagram of the study selection. Diagram provides details on the selection process of studies for inclusion. Note that the exclusion of 2703 citations at the ‘screening’ stage did not meet our study inclusion/exclusion criteria based on screening of title/abstract. CDC, Centers for Disease Control and Prevention; DISCOVER, study by Mayer et al.;28 FEM-PrEP, study by Van Damme et al.;7 HPTN 067/ADAPT, study by Bekker et al;24 IPERGAY, study by Molina et al.;5 iPrEX, study by Grant et al;3 OLE, open label extension; PrEP, pre-exposure prophylaxis; PROUD, study by McCormack et al.;6 RCT, randomised controlled trial.

Included studies involved 25 051 participants encompassing 38 289 person-years of follow-up data. Of the 15 062 participants that received active drug in the intervention arms of trials, 55% received combination tenofovir/FTC and 45% received single-agent tenofovir. Follow-up periods ranged from 17 weeks to 6.9 years. Four trials were conducted in high-income countries (USA, England, France and Canada); 10 were conducted in low-income or middle-income countries (including 9 trials in sub-Saharan Africa); and one was a multicentre trial conducted across four continents. All studies reported the results of a modified intention-to-treat analysis.

The main characteristics of included studies are provided in table 2.

Table 2

Study characteristics

All included individual RCTs were judged to have a low risk of bias by the Cochrane risk-of-bias tool (risk of bias graph and summary provided in online supplemental material 3.2, figures S1,S2, respectively). Across studies, while publication bias may have been present in earlier, industry-funded studies (with fewer participants), this form of bias was considered less likely in the more recent, larger, publicly funded studies. To investigate publication bias, the arcsine test for funnel plot asymmetry was applied to all 13 trials (as there were too few trials in individual population groups). The p values for the equivalent of the Begg, Egger and Thompson tests were 0.58, 0.14 and 0.13, respectively. As such, it was determined that there was no evidence of funnel plot asymmetry (figure 2).

Figure 2

Funnel plot for publication bias. The funnel plot of all studies (n=13) is presented. There is no evidence of significant small study bias. RR, rate ratio.

Effectiveness

The following sections present the effectiveness of PrEP to prevent HIV acquisition by study population and stratified by adherence, where appropriate. Tables 3 and 4 present the GRADE ‘summary of findings’ assessment of the effectiveness and safety of PrEP (and a forest plot of all studies is provided in online supplemental material 3.3, figure S3).

Figure 3

Meta-analysis: HIV acquisition in MSM, all studies. Forest plot of the meta-analysis of HIV incidence in all MSM trials, PrEP versus placebo or no drug. Subgroups include high (≥80%) adherence and low (<80%) adherence. ‘Events’ refers to new HIV infections and ‘total’ refers to total person-years at risk during the study period. MSM, men who have sex with men; PrEP, pre-exposure prophylaxis; RR, rate ratio.

Table 3

GRADE summary of findings: PrEP effectiveness

Table 4

GRADE summary of findings: safety of PrEP

Effectiveness in MSM

Six studies enrolled MSM.3 5 6 20 21 25 A meta-analysis of all studies resulted in an RR of 0.25 (95% CI 0.1 to 0.61), indicating a 75% reduction in the rate of HIV acquisition (figure 3). The estimated absolute RD was −0.03 (95% CI −0.01 to −0.05), indicating PrEP users had a 3% lower rate of HIV acquisition per person-year of follow-up.

When stratified by adherence (≥80% vs <80%), heterogeneity was eliminated (I2 reduced from 52% to 0%). PrEP was most effective in studies with high adherence (≥80%), as expected, where the rate of HIV acquisition was reduced by 86% (RR 0.14, 95% CI 0.06 to 0.35; RD −0.06, 95% CI −0.04 to −0.09; I2=0%, n=3 studies).5 6 21 Of the three studies with high adherence, one study was small and reported non-significant findings due to few events (Mutua et al21). Of the remaining two studies, one study investigated daily PrEP use (McCormack et al, PROUD trial)6 and the other investigated on-demand PrEP (Molina et al, IPERGAY trial).5 Both studies reported identical efficacy (PROUD: RR 0.14, 95% CI 0.04 to 0.47; IPERGAY: RR 0.14, 95% CI 0.03 to 0.6).

When adherence was under 80%, acquisition rate was reduced by 45% (RR 0.55, 95% CI 0.37 to 0.81; RD −0.01, 95% CI −0.00 to −0.02; I2=0%, n=3 studies).3 20 23 25

Effectiveness in serodiscordant heterosexual couples

In all three studies that enrolled serodiscordant heterosexual couples, the HIV-infected partner was not on antiretroviral therapy (studies were conducted in Kenya and Uganda; HIV-infected participants did not meet the criteria for antiretroviral therapy (ART) initiation at the time of enrolment).18 22 23 Details on the CD4 count (a type of cell that HIV infects) or viral load of the HIV-infected partners were not reported.

Two studies investigated the effect of daily oral PrEP compared with placebo.18 22 A total of 4819 couples were enrolled, and the seronegative individual was male in the majority (>60%) of cases. One trial enrolled few participants (n=24 in the daily PrEP arm), and the duration of the trial was very short (4 months); this study did not contribute to analyses as no seroconversions were reported in either arm of the trial.22 The trial by Baeten et al18 consisted of three arms: tenofovir/FTC (n=1568 participants), tenofovir alone (n=1572 participants) and placebo (n=1568 participants). Tenofovir/FTC resulted in a 75% rate reduction (RR 0.25, 95% CI 0.14 to 0.46; RD −0.01, 95% CI −0.01 to −0.02), and tenofovir alone resulted in a 67% rate reduction (RR 0.33, 95% CI 0.19 to 0.56; RD −0.01, 95% CI −0.01 to −0.02). A continuation of this trial (Baeten et al23) compared tenofovir/FTC with tenofovir alone: there was no significant difference between groups.

Effectiveness in heterosexuals

Of the five studies enrolling heterosexual participants, four were placebo-controlled7 16 17 19 and one compared different drug schedules.24 Four studies enrolled only women,7 17 19 24 and one study enrolled both men and women.16 All studies were conducted in a high-HIV prevalence context (countries in sub-Saharan Africa). A meta-analysis of the four placebo-controlled studies7 16 17 19 did not demonstrate a statistically significant reduction in HIV acquisition (RR 0.77, 95% CI 0.46 to 1.29; I2=66%; online supplemental material 3.3, figure S4). In the only trial with high adherence (Thigpen et al16), a rate reduction of 61% was noted (RR 0.39, 95% CI 0.18 to 0.83; RD −0.02, 95% CI −0.01 to −0.04). This was the only trial to enrol both men and women, and when the results were analysed separately by sex, efficacy was noted only in men, with a rate reduction of 80% (RR 0.2, 95% CI 0.04 to 0.91; online supplemental material 3.4). As expected, in a meta-analysis of trials with low adherence, the result was non-significant (RR 1.03, 95% CI 0.75 to 1.43, I2=21%; online supplemental material 3.3, figure S5).

A final study compared different PrEP regimens (daily PrEP, ‘time-driven’ PrEP and ‘event-driven’ PrEP).24 Fewer infections occurred in the daily PrEP arm; however, there were no significant differences in HIV acquisition comparing either event or time-driven PrEP with daily PrEP.

Effectiveness in PWID

Only one study enrolled PWID.15 Daily oral tenofovir was found to be effective, with a 49% reduction in HIV acquisition (RR 0.51, 95% CI 0.29 to 0.92; RD −0.00, 95% CI −0.00 to −0.01). In this study, HIV transmission may have occurred sexually or parenterally.

Sensitivity analysis

A sensitivity analysis was applied to determine whether the use of continuity correction and the omission of studies with zero events in both arms impacted on the results. First, a meta-analysis of all trials was conducted. Both the Poisson regression and beta-binomial models produced results similar to those of the standard approach (table 5), providing reassurance that the impact of excluding smaller studies with zero events was small. Second, a meta-analysis of studies in the MSM group was undertaken, stratified by adherence, as these analyses included three studies with zero events in one or both arms (table 5). Only the beta-binomial model converged on a stable result. The RR and 95% CI were very similar to the main analysis for the high-adherence group. However, there was greater imprecision in the low-adherence group, and the wider confidence bounds included the possibility of no effect.

Table 5

Sensitivity analysis

Relationship between efficacy and adherence

A metaregression analysis was performed to investigate the relationship between efficacy and adherence, accounting for trial size (figure 4; simple regression line provided in online supplemental material 3.3, figure S6). Adherence was measured in a variety of methods across trials (online supplemental material 3.5). Studies that did not confirm adherence through plasma drug detection rates were excluded from metaregression analyses due to biases associated with other methods such as self-report or pill count.

Figure 4

Fitted metaregression line of the relationship between trial-level PrEP adherence and efficacy. Only trials that reported plasma drug concentration from a representative sample contributed to the analysis, represented as circles (Baeten 201218 (Partners PrEP), Choopanya 201315 (Bangkok Tenofovir Study), Grant 20103 (iPrEx), Mazzarro 201519 (VOICE), McCormack 20156 (PROUD), Molina 20155 (IPERGAY) and Van Damme 20127 (FEM-PrEP)). The solid line represents the fitted regression line and the shaded area represents the 95% CI. The X-axis represents the trial-level adherence as a proportion, and the Y-axis represents the efficacy as rate ratios. PrEP, pre-exposure prophylaxis.

Efficacy (as RRs) and adherence (by proportion with plasma drug detectable) were strongly associated (p<0.001). As the adherent proportion increases from 0.5 to 0.6, the RR decreases by 0.13. Therefore, on average, a 10% decrease in adherence decreases efficacy by 13%.

Safety

Eleven studies reported data on ‘any’ adverse events, including 10 that compared PrEP with placebo3 5 7 15–19 21 22 and 2 that compared tenofovir alone to tenofovir/FTC.19 23 A meta-analysis of placebo-controlled trials demonstrated no significant difference between groups (RR 1.01, 95% CI 0.99 to 1.03; I2=42%; online supplemental material 3.3, figure S7). Comparing tenofovir with tenofovir/FTC, one study noted a small increase in adverse events in the tenofovir/FTC group (RR 1.23, 95% CI 1.03 to 1.33; online supplemental material 3.3, figure S8)19 and another failed to show any difference.23

Of note, several studies reported mild decreases in renal function among PrEP users that returned to normal following discontinuation of PrEP use, while a reduction in creatinine clearance (a measure of renal function) was not observed in others.15 18 Where renal function has been affected, PrEP was associated with mild, non-progressive and reversible reductions in creatinine clearance.3 5 6 15 18 Some trials also found slight decreases in bone mineral density.16 19

All 15 studies reported data in relation to the risk of serious adverse events: 12 were placebo-controlled3 5 7 15–22 25; 1 compared PrEP with no PrEP6; 2 compared tenofovir/FTC with tenofovir19 23; and 1 compared different dosage schedules.24 A meta-analysis of placebo-controlled trials did not find an increased risk (RR 0.91, 95% CI 0.74 to 1.13; I2=67%; online supplemental material 3.3, figure S9).

In the only trial that compared PrEP with no treatment, an increased rate of serious adverse events was noted in the treatment arm (RR 3.42, 95% CI 1.4 to 8.35).6 However, these adverse events were not considered study drug-related. Two studies compared tenofovir with tenofovir/FTC: one found no significant difference between groups23 and another found an increased rate in the tenofovir/FTC group (RR 2.48, 95% CI 1.42 to 4.33).19 Of note, not all studies defined what constituted adverse events (including serious adverse events).

No study found an increased mortality rate associated with PrEP use, and of the deaths that occurred, none were considered to be drug-related (online supplemental material 3.3, figure S10).

Viral drug resistance mutations

Five placebo-controlled trials provided data on HIV mutations among patients who had acute HIV infection at enrolment (unknown to study investigators).3 15 16 18 19 In total, there were 44 seroconversions at enrolment, 25 who received the study drug and 19 who received placebo. There were nine mutations detected, eight among participants receiving the study drug and one in a patient receiving placebo. The RR for any drug mutation was 3.53 (95% CI 1.18 to 10.56, I2=0%; online supplemental material 3.3, figure S11), which represents a RD of 0.57 (95% CI 0.21 to 0.94).

Of the nine resistance mutations at enrolment, seven were for FTC. The RR for FTC mutation was 3.72 (95% CI 1.23 to 11.23, I2=0%), which represents an RD of 0.6 (95% CI 0.23 to 0.97) in those receiving tenofovir/FTC (online supplemental material 3.3, figure S12).3 16 18 19

Among participants who seroconverted postrandomisation, the development of resistant mutations was uncommon. Of 551 seroconverters, only seven resistance mutations were detected: one tenofovir mutation was noted in a tenofovir-only arm (k65n, a rare tenofovir resistance mutation) and six FTC mutations were noted.

Risk compensation

Changes in sexual behaviour, or risk compensation, was measured in a number of ways, including condom use, number of sexual partners, changes in STI rates and recreational drug use. Due to the differences in how sexual behaviour was reported across trials, including differing definitions and at different time points, a meta-analysis was not possible.

Studies consistently showed no between-group difference in condom use or number of sexual partners. Studies showed either no overall change in condom use throughout the duration of the study (n=4 studies) or an increase in condom use (n=4 studies). Most studies showed no change in the number of sexual partners over time (n=6 studies); four studies showed a slight reduction in the number of sexual partners; and one showed an increase (investigators of this study noted the possibility of partner under-reporting at baseline).21 No study reported an increase in STIs or a between-group difference in STI diagnoses. In the only study to enrol intravenous drug users, a reduction in intravenous drug use, needle sharing and number of sexual partners over the course of the study was noted.15 Online supplemental material 3.6 presents full details of behaviour change and STI rates in individual studies.

Discussion

Summary of findings

This systematic review and meta-analysis of 25 051 individuals encompassing 38 289 person-years of follow-up data confirms that oral tenofovir-containing PrEP is both effective and safe. PrEP is particularly effective in MSM, with a rate reduction of 75% across all trials, rising to 86% in trials with high adherence. Only one trial investigated the effectiveness of on-demand PrEP.5 This trial reported a rate reduction of 86%, identical to the only comparable trial among daily PrEP users6 (both trials enrolled a large sample of MSM and achieved high levels of adherence). PrEP is also effective in serodiscordant couples, and no significant difference exists between single-agent tenofovir and combination tenofovir/FTC.

Questions remain regarding PrEP effectiveness in other populations. One study found that PrEP was effective in PWID.15 However, a limitation of this study is that investigators were not sure if transmission was parenteral or sexual. It is unclear if PrEP is effective in heterosexuals. PrEP was effective in preventing heterosexual HIV transmission in one trial where adherence was high (61% reduction),16 but only in male participants. The remaining three heterosexual trials, all conducted in sub-Saharan Africa, enrolled only women and adherence was noted to be very low.7 17 19

Adherence varied greatly across studies, ranging from 25% to 88% by plasma drug monitoring. As expected, efficacy was found to be strongly associated with adherence (p<0.01). On average, a 10% reduction in adherence reduced efficacy by 13%.

PrEP was found to be safe, and there was no difference in adverse event rates comparing single-agent tenofovir with tenofovir/FTC in combination. Some studies noted a transient elevation of creatinine with resolution on discontinuation of the study drug.3 5 6 15 18 While uncommon, viral drug resistance mutations may occur in the presence of an unrecognised HIV infection at enrolment.

Our findings of high effectiveness in MSM have been confirmed by two open-label extensions26 27 that followed the conclusion of four RCTs included in this review.3 5 20 25 One open-label extension found no seroconversions in participants that took a minimum of four pills per week.26

Ongoing studies

Following the conclusion of this review, an additional search was conducted to identify recently published or ongoing RCTs after the date of our database search. PubMed was searched using the same search strategy up to 9 September 2021. No additional PrEP efficacy trials were identified, although two publications were identified that relate to an ongoing non-inferiority RCT that compared two different types of oral tenofovir-containing PrEP: tenofovir alafenamide plus FTC versus tenofovir disoproxil fumarate (TDF) plus FTC28 29 (all studies in this systematic review relate to TDF). Interim results found that the daily tenofovir alafenamide group showed non‐inferior efficacy to the daily TDF group for HIV prevention, and the number of adverse events for both regimens was low. Tenofovir alafenamide had more favourable effects on bone mineral density and biomarkers of renal safety than TDF,28 but there was more weight gain among participants who had received tenofovir alafenamide (median weight gain 1.7 kg vs 0.5 kg, p<0.0001).29

Strengths and limitations

This systematic review assessed the use of PrEP in all potentially eligible populations and provided a GRADE assessment of important outcomes,9 ensuring a systematic and transparent approach in the development of national clinical practice guidelines for the prevention of HIV. Based on the strength of the evidence, this study was used to develop national clinical guidelines on the management of patients on PrEP30 and informed the decision of the Irish government to implement a publicly funded PrEP programme nationally for MSM and serodiscordant couples at increased risk, and for other populations on a case-by-case basis as determined by the treating HIV specialist.31

Despite the strength of the evidence, however, the present study is subject to a number of limitations. First, there was a lack of data on a number of other high-risk groups, such as transgender women (only one study included transgender women, which made up less than 1% of participants3) and sex workers (one study included sex workers, but disaggregated data were not reported17). Second, adherence was notably poor in most studies that enrolled heterosexual women, limiting conclusions in this group. Additionally, as observational studies were excluded from this review, PrEP effectiveness may be lower in real-world settings in all populations if adherence is suboptimal. Third, while PrEP is considered to have an excellent safety profile, the maximum follow-up period was 6.9 years in this review and, therefore, long-term safety was not assessed.

Fourth, while studies in this review did not detect risk compensation, evidence from placebo-controlled trials is often insufficient to determine its presence. It is not possible to reach conclusions on the impact of PrEP on behaviour when participants do not know if they are taking active PrEP or placebo. However, it is possible to evaluate the impact of the support provided to all participants over time (provision of condoms and counselling on safer sex practices). Studies generally demonstrated no change or an improvement in safer sex practices. In the open-label PROUD study (where participants knew they were taking PrEP), there was no difference between the immediate and deferred PrEP groups in the total number of sexual partners in the 3 months prior to the 1-year questionnaire.6 However, a greater proportion of the immediate group reported receptive anal sex without a condom with 10 or more partners compared with the deferred group. Importantly, there was no difference in the frequency of bacterial STIs between groups, the most reliable proxy for changes in sexual behaviour (as it is not self-reported). Fifth, a number of studies in this review had zero events in one or both arms of the study. Standard meta-analytical approaches typically exclude these trials, resulting in a loss of data. A sensitivity analysis using alternative meta-analytical methods to account for these studies generally found similar findings, with the exception of the estimate of effectiveness in the low-adherence MSM group, which was no longer statistically significant.

Finally, the generalisation of studies to other clinical settings should be done with caution. All trials that enrolled heterosexuals were conducted in sub-Saharan Africa, a part of the world with a generalised HIV epidemic and suboptimal antiretroviral coverage. Additionally, the only trial that enrolled PWID was conducted in Bangkok, where needle exchange was unavailable to participants, and investigators could not differentiate sexually from parenterally acquired HIV.

Research in context and implications for practice

HIV infection is of significant public health importance. There were 523 diagnoses of HIV notified in 2018 in Ireland, representing a rate of 11 per 100 000 population, and over half (56%) of all diagnoses were in the MSM group.32 The rate of HIV in Ireland is high compared with other countries in Western Europe, many of which have seen declines in their HIV rates in recent years.1 This highlights the ongoing need for newer, more effective prevention strategies to halt the transmission of HIV.

Our finding of high PrEP effectiveness among MSM concurs with other recent systematic reviews that focused solely on the MSM population.33 34 To our knowledge, this systematic review provides the first GRADE assessment of the totality of evidence across all populations that includes more recent trials with high adherence.5 6 Our GRADE assessment differs significantly from that of Okwundu et al published in 2012.35

Our quantification of the strength of the association between adherence and efficacy through metaregression highlights the clinical importance of medication adherence support and counselling to prospective PrEP users. Additionally, our finding of FTC resistance mutations occurring almost four times more often in those with acute HIV enrolment has implications for PrEP implementation going forward. Assessing if the patient could be in the ‘window period’ (the time between exposure to HIV and the point when HIV testing will give an accurate result) at enrolment is of critical importance to ensure the patient is HIV negative prior to commencing PrEP. This highlights the need for PrEP delivery as part of a monitored programme that incorporates HIV testing and patient counselling on the risk and long-term consequences of resistance if poorly adherent to PrEP.

An additional finding of interest is the lack of significant difference in the effectiveness and safety of single-agent tenofovir compared with combined tenofovir/FTC. This may have implications for clinical practice, as tenofovir may be a suitable alternative for FTC-allergic patients, and in resource-poor settings if cost or procurement of combination tenofovir/FTC is an issue.

Conclusions

In conclusion, high-certainty evidence exists that PrEP is safe and, assuming adequate adherence, effectively prevents HIV in MSM and serodiscordant couples. One study found PrEP to be effective in PWIDs. The uncertainty regarding PrEP effectiveness in heterosexual individuals persists. Clinicians and policy-makers may decide to recommend PrEP to heterosexual individuals on a case-by-case basis, acknowledging adherence-related issues reported in trials. This review emphasises the importance of adherence support to ensure PrEP effectiveness is maintained, as well as the need for frequent HIV testing at enrolment and follow-up to avoid viral drug resistance mutations. Following the conclusion of this study, the Irish government implemented a publicly funded PrEP programme for all individuals at increased risk of HIV acquisition and developed national clinical practice guidelines for the provision of PrEP.

Data availability statement

All data relevant to the study are included in the article or uploaded as supplementary information.

Ethics statements

Patient consent for publication

Ethics approval

This study did not require ethics approval as no human participants were involved.

Acknowledgments

The authors thank the HSE’s Sexual Health and Crisis Pregnancy Programme, the Gay Men’s Health Centre Dublin, HIV Ireland and Act Up Dublin and the Gay Health Network.

References

Supplementary materials

Footnotes

  • Contributors EOM: concept and design, acquisition of data, analysis and interpretation of data, drafting of the manuscript, critical revision of paper for important intellectual content and statistical analysis, overall content guarantor. LM: acquisition of data, analysis and interpretation of data, drafting of the manuscript and critical revision of the paper for important intellectual content. CT: concept and design, analysis and interpretation of data, drafting of the manuscript, critical revision of paper for important intellectual content, statistical analysis and supervision. PH: concept and design, critical revision of paper for important intellectual content, analysis and interpretation of data, drafting of the manuscript and supervision. CH: concept and design, drafting of the manuscript and supervision. PM: concept and design, drafting of the manuscript and supervision. MR: concept and design, critical revision of the paper for important intellectual content, drafting of the manuscript and supervision.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, conduct, reporting or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.