Abstract
Background: When prescribing antibiotics for common indications, clinicians need information about both harms and benefits, information that is currently available only from observational studies. We quantified the common harms of the most frequently prescribed antibiotic, amoxicillin, from randomized placebo-controlled trials.
Methods: For this systematic review, we searched MEDLINE, Embase and the Cochrane Central Register of Controlled Trials, without language restriction, for any randomized, participant-blinded, placebo-controlled trials of amoxicillin or amoxicillin–clavulanic acid for any indication, in any setting. Our main outcome was any reported adverse event.
Results: Of 730 studies identified, we included 45 trials: 27 involving amoxicillin, 17 involving amoxicillin–clavulanic acid and 1 involving both. The indications for antibiotic therapy were variable. The risk of bias was low, although only 25 trials provided data suitable for assessment of harms, which suggested under-reporting. Diarrhea was attributed to amoxicillin only in the form of amoxicillin–clavulanic acid (Peto odds ratio [OR] 3.30, 95% confidence interval [CI] 2.23–4.87). The OR for candidiasis (3 trials) was significantly higher (OR 7.77, 95% CI 2.23–27.11). Rashes, nausea, itching, vomiting and abnormal results on liver function tests were not significantly increased. The results were not altered by sensitivity analyses, nor did funnel plots suggest publication bias. The number of courses of antibiotics needed to harm was 10 (95% CI 6–17) for diarrhea with amoxicillin–clavulanic acid and 27 (95% CI 24–42) for candidiasis with amoxicillin (with or without clavulanic acid).
Interpretation: Diarrhea was caused by use of amoxicillin–clavulanic acid, and candidiasis was caused by both amoxicillin and amoxicillin–clavulanic acid. Harms were poorly reported in most trials, and their true incidence may have been higher than reported. Nevertheless, these rates of common harms associated with amoxicillin therapy may inform decisions by helping clinicians to balance harms against benefits.
Most antibiotics are prescribed by primary care clinicians for common infections, particularly acute respiratory infections.1 However, for most acute respiratory infections, antibiotics provide only marginal benefits, and an inevitable consequence of this injudicious use is the prospect of antibiotic resistance. One way to reduce antibiotic prescribing in primary care is to explain to patients how little these drugs help for many common infections and to apply a process of shared decision-making during the consultation.2
The practice of shared decision-making requires not just an explanation of the paucity of benefits of antibiotics in most primary care situations, but also an explanation of the potential harms. Serious harms are probably sufficiently rare to be discounted by most clinicians and their patients.3 Yet when the decision to use or not use antibiotics relates to a self-remitting illness, for which the benefits are likely to be modest at best, the more common, mild harms of antibiotics become important. Unfortunately, common harms from antibiotics are poorly quantified, and clinicians cannot talk to patients with confidence about their likelihood.
Current understanding of the common harms of antibiotics is derived largely from observational studies. However, estimates of common harms from such studies may be biased, principally because it is difficult to distinguish adverse drug reactions from disease-related symptoms. One approach to addressing this problem is to investigate common harms encountered in randomized controlled trials of antibiotic against placebo. This study design controls for disease-related symptoms, allowing for better quantification of antibiotic-related adverse effects.
The most common antibiotic used in primary care is amoxicillin, either alone or in combination with clavulanic acid. “Common harms” can be defined as those frequent enough to be observable in the patient samples of most randomized trials and occurring during the recording of primary outcomes in such studies (with recognition that some of the adverse effects will occur later).
Accordingly, we systematically reviewed all published placebo-controlled randomized trials of amoxicillin or amoxicillin–clavulanic acid for any indication, with the rationale that the risks of drug-induced harms are independent of the condition being treated.4
Methods
Design and registration
This systematic review with meta-analysis was registered with Prospero on May 11, 2012 (protocol available at www.crd.york.ac.uk/prospero/, registration number CRD42012002281).
Data sources
We searched MEDLINE (1946 to June week 4, 2013), Embase (2010 to July 2013) and the Cochrane Central Register of Controlled Trials (to 2013, issue 7) using the Cochrane highly sensitive search strategy for randomized trials (for the full search strategy, see Appendix 1, available at www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.140848/-/DC1).
Study selection
We considered all randomized, participant-blinded, placebo-controlled trials, in any language, with any population, in which amoxicillin or amoxicillin–clavulanic acid was used to treat any condition. We excluded studies that involved coadministration of any drug other than acetaminophen (paracetamol).
Main outcome
Outcomes of interest were any reported adverse event, including nausea, vomiting, diarrhea, rash, candidiasis, itch and abnormal results on liver function tests.
Data extraction and synthesis
Two authors (M.G. and A.R.) independently screened the titles and abstracts of retrieved studies to identify those that appeared to meet the inclusion criteria. The full texts of these articles were similarly independently assessed for eligibility. Any disagreements were resolved by discussion, and a third author (C.D.M.) arbitrated if necessary. The two reviewers used a standardized form to independently extract data from eligible studies, including event rates (with the intention-to-treat population as the denominator) and estimates of bias. Discrepancies were resolved by discussion, and the same third author arbitrated if necessary. We examined the texts of included trials for reported adverse events and checked registration information at trial registers for all included trials. The two reviewers independently undertook risk-of-bias assessment using Cochrane methods.5 Disagreements were resolved by discussion, and the same third author arbitrated if necessary. We undertook sensitivity analyses based on patient age (adult or child), drug doses and durations of therapy, and we analyzed funnel plots to determine potential publication bias.
Statistical analyses
We used Peto odds ratios (ORs) to analyze the data (because of their paucity5) and calculated 95% confidence intervals (CIs). We planned several subgroup analyses (see protocol at www.crd.york.ac.uk/prospero/). The numbers needed to harm (NNH) were estimated as follows: the OR for each harm was multiplied by the risk of harm with placebo (after converting this value to its odds) to derive the odds of harm in the antibiotic group; these odds were converted back to risks, and the absolute risk difference was then calculated.6
Results
Studies identified
We identified 730 studies (after removal of duplicates), of which 573 were classified as ineligible on the basis of their titles or abstracts. Of the remaining 157 studies, 45 were included in the qualitative analysis and 25 in the quantitative analysis (Figure 1).
Description of studies
The trials were published from 1977 to 2013 (Figure 2). The setting and reason for use of an antibiotic varied (Table 1): primary care (15 [33%]), dental care (9 [20%]), secondary care (i.e., referral; 20 [44%]), treatment (25 [56%]) or prophylaxis (20 [44%]). The median duration of antibiotic therapy was 7 days (range 1 dose to 1 yr). Across all included studies, there were 10 519 participants: 4280 received only amoxicillin, 1005 received amoxicillin–clavulanic acid, and 5234 received placebo (Table 1). Among the 25 trials that reported usable harms data, the mean number of types of harms reported was 2.7 (range 0–10). Most study reports gave minimal information about harm ascertainment. For 12 studies (27%) we could determine whether patients had been asked about specific harms; in 8 studies (18%) patients used a diary to record harms.
Funnel plots for the harms from diarrhea and rash were symmetric (Appendix 2, www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.140848/-/DC1).
Quality of studies
We found a low risk of bias in the reporting of antibiotic harms, although the principal focus of each trial was efficacy (Appendix 3, www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.140848/-/DC1). However, the reporting of such harms was poor: only 25 (56%) of the 45 studies reported harms in sufficient detail to allow meta-analysis of their data. The rate of studies reporting harms did not improve over time (Figure 2). Even studies that reported usable harms data rarely gave detailed information about how they were collected, and studies were sometimes unclear about whether all harms were reported (or, for example, whether they reported only those harms that led to withdrawal of patients from the trial). Nine trials were registered, but registering harms among the secondary outcomes did not guarantee that harms would be reported (Table 1), and registries did not provide any harms data that went unreported in the trials’ primary publications.
Meta-analysis of reported harms
Diarrhea was reported in 17 studies and was not significantly caused by amoxicillin (overall OR 1.14, 95% CI 0.98–1.33), except in the combination form with clavulanic acid (OR 3.30 95% 2.23–4.87) (test for subgroup differences p < 0.001) (Figure 3A). There was high heterogeneity for all studies (I2 = 68.8%), but not for amoxicillin–clavulanic acid alone (I2 = 0%). The NNH for diarrhea was 10 (95% CI 6–17).
Candidiasis, reported in only 3 studies, was significantly caused by amoxicillin (OR 7.77, 95% CI 2.23–27.11,), with low heterogeneity (Figure 3A). The result was not significant for the subgroup of studies involving amoxicillin alone. The NNH for candidiasis was 27 (95% CI 24–42). In addition to explicit candidiasis, one trial reported rates of diaper rash of about 50% among infants treated with amoxicillin–clavulanic acid.10 This rash was likely related to candidiasis as well. Analysis with inclusion of these data yielded the same OR value (data not shown).
Rashes, nausea and vomiting were not reported significantly more frequently with antibiotic than with placebo (Figure 3B). No trials reported itching, and only 1 trial reported abnormal results on liver function tests (which occurred in 2 placebo-treated patients and 1 amoxicillin-treated patient).29
There were large variations in dose and duration of treatment among studies, and we explored this heterogeneity by subgroup analysis. Analyzing studies that used common doses of amoxicillin and those that used high doses, analyzing children and adults separately, and analyzing studies with common duration of therapy (roughly 1–2 wk) and those with long courses of therapy yielded the same summary effect sizes for diarrhea (see Appendix 4, www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.140848/-/DC1). There were too few studies reporting other outcomes to undertake subgroup analyses.
Interpretation
In this meta-analysis of randomized trials, we found statistically significant results for just 2 harms: diarrhea from amoxicillin–clavulanic acid and candidiasis from amoxicillin with or without clavulanic acid.
Reported harms were fewer than we expected from clinical anecdotal experience and observationally derived data, which have primarily reported common harms as rashes (at rates of 5%–8% of those treated and even higher, up to 20%, among those with mononucleosis treated with amoxicillin) and gastrointestinal disturbance. Some standard textbooks do not report candidiasis.52,53 At least 1 case–control study found a relative risk of 7 for thrush after therapy with amoxicillin or amoxicillin–clavulanic acid.54
Our reported rates of diarrhea (about 10% of courses of treatment) were similar to those in observational reports for amoxicillin–clavulanic acid53 and similar to the rates from observational studies of amoxicillin (2%).52 Standard texts52,53 report rash as common with these antibiotics, but we did not find a significant increase. However, the wide 95% CI for the OR means that meta-analysis did not rule out rash as a common harm.
Limitations
The most important limitation of this systematic review derives from the fact that every trial had a primary outcome relating to efficacy rather than harm. Many of the studies failed to report any harms, which led us to suspect that their authors simply did not collect such information or, if they did, failed to publish it. This problem was compounded by the lack of published protocols and registry information for most trials, which prevented analysis of planned measures, thus creating potential for selective reporting. In some of the studies that did report them, harms were probably recorded passively (that is, recording these outcomes only if volunteered by patients, rather than routinely asking all patients about them), which means underestimation of their rates was likely.55 The low number of events also means that we had insufficient power to detect all but the most common harms. Each of these effects would lead to underestimation of harms.
One method of improving the power of a study like ours would be to undertake a network meta-analysis, including not only studies of antibiotic versus placebo, but also antibiotic versus other antibiotics (of which there are many), thereby exploiting differences among different antibiotics in their incidence of harms.
Nevertheless, these are currently the best estimates we can obtain for harms of these commonly prescribed antibiotics.
Well-conducted, relatively large trials of amoxicillin and amoxicillin–clavulanic acid continue to be conducted, and better estimates may therefore be possible in the future, particularly with respect to the relationship between harms and dose, length of treatment and population. However, the availability of usable harms data from future studies will depend on adequate reporting by trial authors. We found that usable harms data were lacking in many of the studies included in our analysis, despite the existence of a CONSORT extension statement designed to encourage better reporting of harms.56,57 In our sample of trials, there was no discernible improvement in the reporting of harms for trials published in the decade since this extension statement was published, compared with trials published before.
Conclusions
Under-reporting of harms in trials remains widespread,58 and until that problem is addressed, under-reporting will flow to systematic reviews59 and other evidence syntheses such as guidelines. An important consequence of under-reporting of harms is misrepresentation of the balance of an intervention’s benefits and harms,59 but shared decision-making requires consideration of both these aspects. This systematic review has provided new information about common harms of amoxicillin and amoxicillin–clavulanic acid that can contribute to better-informed discussions and decisions about the benefit–harm trade-off for these antibiotics. However, it also highlights that the ability of clinicians and patients to make fully informed decisions about using amoxicillin and amoxicillin–clavulanic acid is hampered by poor measurement and reporting.
Acknowledgements
The authors would like to thank Elaine Beller (associate professor of biostatistics at the Centre for Research in Evidence-Based Practice, Bond University, Gold Coast, Australia) for statistical advice and Jeffrey Aronson (reader in clinical pharmacology at Oxford University, Oxford, UK) for feedback and advice on previous versions.
Footnotes
See related commentary, www.cmaj.ca/lookup/doi/10.1503/cmaj.141344. See related video, www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.140848/-/DC1
Competing interests: Malcolm Gillies’s employer, NPS MedicineWise, is an independent nonprofit organization funded by the Australian Government’s Department of Health to promote quality use of medicines. Tammy Hoffmann and Christopher Del Mar report grants from the National Health and Medical Research Council of Australia during the conduct of this study. Christopher Del Mar also reports personal fees from BMJ Books and Elsevier for activities outside the scope of this work. No other competing interests were declared.
This article has been peer reviewed.
Contributors: Malcolm Gillies, Paul Glasziou and Christopher Del Mar undertook the study concept. All authors contributed to its design, the search strategy and the analysis. All authors contributed to writing and reviewing the manuscript, all approved the version submitted for publication, and all agreed to act as guarantors for the work.
Funding: This study was conducted as a project of the Centre for Research Excellence in Minimising Antibiotic Resistance in Acute Respiratory Infections, with funding for the centre provided by the National Health and Medical Research Council (NH MRC) of Australia (grant 1044904). Paul Glasziou is supported by NH MRC Australia Fellowship 527500. Tammy Hoffmann is supported by NH MRC/Primary Health Care Research, Evaluation and Development Career Development Fellowship 1033038. NPS MedicineWise provides salary support for Malcolm Gillies.
Data sharing: The dataset is available on request from the corresponding author at cdelmar{at}bond.edu.au