Objectives The objective of this study was to determine the nature of evidence used to support the withdrawal of marketing authorisations of drug products for safety reasons throughout the European Union (EU) between 2002 and 2011.
Setting Products withdrawn, either by a medicines agency or a marketing authorisation holder, during the period 2002–2011 were identified by conducting detailed searches of the WHO, the European Medicines Agency (EMA) and national medicines agency websites throughout the EU plus Norway, Iceland and Liechtenstein. The scientific evidence used to support the decision was identified from a search within PubMed, the EMA and national medicines agencies websites. Information about spontaneous case reports entered into EudraVigilance and unavailable on the EMA website was received by email from the EMA.
Results 19 drugs were withdrawn from the market, throughout the EU, for safety reasons from 2002 to 2011. Case reports were cited in 95% of withdrawals (18/19) and case–control studies (4/19), cohort studies (4/19), randomised controlled trials (RCTs) (12/19) or meta-analysis (5/19) were cited in 63% of withdrawals (12/19). Cardiovascular events or disorders were the main reason for withdrawal (9/19), followed by hepatic disorders (4/19) and neurological or psychiatric disorders (4/19).
Conclusions This study has shown that the level of evidence used to support drug withdrawal has improved during the past 10 years, with an increased use of case–control studies, cohort studies, RCTs and meta-analyses. This research has demonstrated that such studies have contributed to decision-making in almost two-thirds of cases.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/
Statistics from Altmetric.com
Strengths and limitations of this study
This study adds to the knowledge base regarding the level of evidence used to support decisions to remove drug products from the market.
Results of this research are in line with the findings of other study groups which concluded that there has been a shift in the level of evidence used, for example, results of randomised controlled trials and cohort studies are used to justify a product withdrawal.
English and French websites and publications were only searched.
The international non-proprietary name of each drug was included in the PubMed search strategy but as various drug names exist for the same compound, a potential exists for the exclusion of some publications from contributing evidence.
The decision to remove a drug product from the market is not taken lightly either by the regulatory authority or the marketing authorisation holder. A number of reasons contribute to the withdrawal such as the emergence of new safety evidence and significant drug interactions. Ultimately, the risk-benefit balance is paramount when making such decisions. The regulatory authorities review the evidence, such as spontaneous case reports or results from a randomised controlled trial (RCT) and prepare an opinion on whether the marketing authorisations of medicinal products containing that particular drug should be maintained, changed, suspended or withdrawn. The interpretation of the available safety data by the numerous competent authorities across the European Union (EU) is wide ranging as is the accessibility of information regarding how they reach their conclusion.
In 2005, legislation was introduced to ensure marketing authorisation holders complete a risk management plan (RMP) for their newly licensed product incorporating, where appropriate, post-marketing safety surveillance studies in the general population with regular assessment and appropriate reporting to the CHMP.1 The aim of the RMP is to ensure a more proactive approach to pharmacovigilance by putting in place measures that allow for the early detection and minimisation of risks throughout a medicine’s lifecycle. This should, in theory, result in a reduction in the length of time for drug withdrawal should a safety issue arise. Risk management planning in the EU has been further enhanced by the introduction of new EU legislation for good pharmacovigilance practices which became applicable in July 2012.2
Previous studies looked at the type of evidence used to support the withdrawal of products, for safety reasons, in different individual countries and over varying time periods. Arnaiz et al3 reported on products withdrawn in Spain between 1990 and 1999, Clarke et al4 for products in the USA and the UK from 1999 to 2001 and Olivier and Montastruc5 for medicines in France from 1998 to 2004. They all concluded that case reports were the mainstay of evidence used to support withdrawal decisions for pharmacovigilance reasons; case–control studies, cohort studies and RCTs were used as evidence in less than one-third of decisions. Paludetto et al6 revisited the issue 6 years later, between 2005 and 2011, and reported a shift in the level of evidence used. They determined that, of the 22 active substances withdrawn from the French market within this 6-year time frame, 68% of the decisions used multiple sources of evidence including clinical trials and pharmacoepidemiological studies. The objective of this study was to explore the level of evidence used to support the withdrawal of marketing authorisation of drug products in the time period 2002–2011 in the EU as a whole.
Drug products withdrawn from the EU market for safety or pharmacovigilance reasons, either by a medicines agency or a marketing authorisation holder, during the period 2002–2011 were identified. This was established by carrying out detailed searches on the websites of the WHO, the European Medicines Agency (EMA) and those of national medicines agencies throughout the EU plus Norway, Iceland and Liechtenstein. The WHO Pharmaceutical Newsletter and the EMA press releases provided the most useable information. In addition, pharmaceutical companies were contacted to obtain more information concerning dates of withdrawal in specific countries.
Prescription and over-the-counter products were included if their marketing authorisation was withdrawn or suspended due to any safety reason such as an adverse drug reaction, abuse or misuse. Active ingredients contained in a combination product were also included. Veterinary products, herbal drugs, vaccines, excipients, biological drugs, radiopharmaceuticals products and diagnostic agents were excluded. Drugs were not included if only one particular dose, dosage form or indication was withdrawn.
The scientific evidence leading to the withdrawal decision was identified from a search within PubMed, the EMA website (published documents searched included: ‘Press releases’, ‘Questions and Answers’ and ‘Scientific conclusions’) and national medicines agencies websites. Within the ‘Questions and Answers’ reports and ‘Press releases’, prepared by the EMA, a summary of the reviewed evidence with reference to study type (eg, RCT, animal study) is often included. A request was also submitted to the EMA for information on the number of cases entered into EudraVigilance related to the reason of withdrawal for each drug.
A search strategy was developed in PubMed by first, searching under the International Non-proprietary Name (INN) of the drug. Second, if over 200 publications were found, the INN combined with the MeSH term describing the pharmacovigilance problem was entered. Third, the INN combined with the terms ‘adverse drug reaction’, ‘adverse event’, ‘toxicity’ and ‘poisoning’ was used. Furthermore, articles published up to 1 year after the drug withdrawals were included to account for the potential delay between the end of a study and its publication.
Data were collated from these sources and a comprehensive literature review was conducted. However, a fully systematic review was not carried out due to time and resource constraints. Any evidence cited in these sources was categorised according to study design including animal studies, case reports (including spontaneous case reports, published case reports and case series), case–control studies, cohort studies, RCTs, meta-analyses and other studies (including clinical trials not randomised and/or not controlled and incidence studies). Only studies where statistically significant results were found were included.
Nineteen drugs were withdrawn for pharmacovigilance reasons in the EU from 2002 to 2011 (table 1). The anatomical therapeutic chemical classes of drugs most represented in the nineteen drugs withdrawn are ‘nervous system’ (5/19 analgesics, antidepressants, antipsychotics and hypnotics), ‘musculoskeletal system’ (5/19 non-steroidal anti-inflammatory drugs (NSAIDs) and muscle relaxants) and ‘alimentary tract and metabolism’ (4/19 antidiabetics and antiobesity drugs).
The median time to withdrawal was 23 years with an IQR of 4 and 46 (table 1).
Case reports were cited in 95% of withdrawals (18/19) and case–control studies (4/19), cohorts studies (4/19), RCTs (12/19) and meta-analysis (5/19) were cited in 63% of withdrawals (12/19; table 2).
Cardiovascular events or disorders were the main reason for withdrawal (9/19), followed by hepatic disorders (4/19) and neurological or psychiatric disorders (4/19).
A list of the adverse drug reactions reported in EudraVigilance, correlating to the safety issue given as the reason for withdrawal for each drug product is shown in table 3. No results were returned for ximelagatran/melagatran on querying the database for hepatotoxicity reports which is in line with the EMA assessment which states that an RCT (EXTEND) study7 elucidated this safety concern.8 A high number of reports were recorded for rosiglitazone; 10 834 cases of cardiac disorders associated with its use.
This study has shown that the strength of evidence used to support the withdrawal of products relied on information recorded from spontaneous reporting together with other pharmacoepidemiological and clinical research studies. All decisions to revoke marketing authorisations described in this study utilised spontaneous case reports, except for the withdrawal of ximelagatran.8 Spontaneous case reporting remains central to pharmacovigilance as it allows for the detection of suspected adverse drug reactions and significant safety signals. However, spontaneous reporting should be used in conjunction with other pharmacovigilance methodologies such as observational studies and clinical trials to further evaluate any such safety signals due to the potential for over and under-reporting, confounding, bias and misclassification. The RCT is commonly assumed to be the gold standard for clinical research9 but adverse drug reactions may not become evident until a medicine is used in the larger population, post-authorisation, where patients are more likely to have comorbidities and other risk factors. The outcome of pharmacoepidemiology studies and the conduct of systematic reviews, even with their limitations particularly bias, confounding and misclassification, can provide useful additional evidence on the nature and frequency of adverse drug reactions. As a direct country comparison, Clarke et al4 stated that six products were withdrawn in the UK in between 1999 and 2001, namely grepafloxacin (marketed for 2 years), cisapride (12 years), pumactant (6 years), cerivastatin (4 years), droperidol (30 years) and levacetylmethadol (4 years). The median length of time these drugs remained on the UK market was 5 years (IQR 4–10.5). Droperidol was available for approximately 30 years as it was marketed before the licensing system began in 1971 (personal communication from MHRA (2013)). In contrast, only three products were withdrawn from the UK market between 2009 and 2011; orciprenaline, sibutramine and rosiglitazone marking a 50% reduction in the number of drug products withdrawn over the same time period. The median length of time these products remained on the market was 11 years (IQR 10.5–30). Although the length of time taken to withdraw a drug product appears to have doubled (mainly due to the length of time orciprenaline was available, 49 years) over the 10-year period, the evidence used to aid the decision-making has been heightened. Spontaneous case reporting was used to support the case for withdrawal in five of the six products between 1999 and 2001, while only one RCT was included as evidence.4 In this study, spontaneous case reporting and RCTs were shown to have contributed to all three withdrawn products, which suggests an increase in the level of evidence used to support decisions for drug product withdrawal from the market.
The findings of this study are in line with those of the study conducted by Paludetto et al6 in 2012 who observed a shift in the nature of the safety data used as justification for the withdrawal of products in France in the time periods 1998–2004 and 2005–2011. One explanation the authors gave for this change was the implementation of the European Clinical Trial Directive in 2004 and the subsequent analysis of clinical trial safety data by pharmacovigilance experts. The evolution of pharmacovigilance legislation over the past decade is likely to have contributed to the availability of additional data through the conduct of post-marketing safety surveillance allowing regulators and companies to include such information in the drug products safety portfolio. It is difficult to ascertain whether the introduction of RMPs for newly licensed medicinal products has influenced the length of time a drug with safety concerns remains on the market as only two drug products included in this study were marketed after 2005. Rimonabant and sitaxentan were licensed in 2006 and removed from the market in 2008 and 2010, respectively. At the time of authorisation, information was known about the psychiatric side effects of rimonabant10 and liver toxicity associated with sitaxentan11 and the benefit-risk balance deemed to be favourable. However, in the case of rimonabant, as data became available when used in the real-life clinical setting, the risk of obese and overweight patients developing psychiatric side effects was double that of patients taking placebo.10 The marketing authorisation holder voluntarily removed sitaxentan from the market and cancelled ongoing clinical trials as a result of two cases of fatal liver injury.11 During the time period studied, an additional 12 drugs were withdrawn in some but not all EU countries. In some cases, it was not feasible to establish the reasons for the withdrawal, for example, astemizole has been withdrawn from the UK, France and Spain, but information about its availability in other EU countries is difficult to establish. Another example, the NSAID nimesulide, was withdrawn in Spain, Finland, Belgium and Ireland but is still available in 15 EU member states. The EMA had a favourable opinion of the risk-benefit balance after a review of spontaneous reports of epidemiological studies and other published studies in 2010.12 This was in spite of evidence of an increased risk of hepatotoxicity compared with other NSAIDs, although restrictions are in place to limit the number of liver-related side effects. Ultimately, it would seem that there is a disparity in opinion of risk-benefit within the EU between decision-makers at the EMA and various regulatory authorities.
The main limitation of this study was the impact of various language barriers across the EU. Websites of competent authorities are written in their local language and resource constraints did not allow for translations. Only information from the websites of those competent authorities where English and French are spoken locally or an English or French version is available was utilised. This may also have had a bearing on the studies included as evidence in this research as again only English and French publications were included. After a website search, competent authorities and pharmaceutical companies were contacted in order to obtain further information on drug product withdrawals. The response rate from competent authorities was 70% and from pharmaceutical companies 55%. Again, this may have been due to a language barrier problem, but it may also be due to a lack of available information on drugs withdrawn for several years or an unwillingness to share information. Competent authorities or companies may also not have a complete list of products removed from the market. Over time, the way in which drug products have been licensed in the EU has changed considerably. It is relatively easy to determine how products licensed centrally were withdrawn from the market. However, for drugs that have been licensed for a considerable number of years, in countries that have recently joined the EU, and for those that have multiple drug names, it can be very difficult to obtain conclusive, consistent and clear information. The effect of different drug names may have led to potential exclusions of study evidence from our PubMed search strategy as the INN of each drug was used rather than an exhaustive drug name list. Owing to time constraints, it was not possible to conduct a full investigation into why drug products had been removed from the market in some but not all countries and to find detailed information about the decision-making process.
It would be useful to investigate the impact of the introduction of RMPs in a future study. This could be carried out as an investigation of how results from postmarketing studies, conducted as part of RMPs, aid in the assessment of any safety issues. In theory, the introduction of RMPs should expedite post-marketing drug safety decisions.
This study has shown that the strength of evidence has improved during the past 10 years. Indeed, the results show an increased use of case–control studies, cohort studies, RCTs and meta-analyses as justification for the withdrawal of a marketed product. Previously, only one-third of decisions used evidence from observational studies or clinical trials4 but this study showed that they had contributed to decision-making in almost two-thirds of withdrawals. Spontaneous case reports remain the most significant method of pharmacovigilance.
The Drug Safety Research Unit (DSRU) is a registered independent charity (No.327206) associated with the University of Portsmouth. The companies have no control on the conduct or the publication of its studies. The DSRU has received such funds from the manufacturers of products included in this study.
Contributors RMN, SS and GH were all involved in the conception and design of the study, interpretation of data, drafting and revision of the article and final approval of the version for publication. GH and RMN were responsible for data acquisition.
Funding The DSRU receives unconditional donations from pharmaceutical companies.
Competing interests SS reports personal fees from ICON (Contract research organisation), personal fees from Shire Pharmaceuticals, personal fees from ONO Pharmaceuticals, personal fees from Intermune Pharma, personal fees from IPSEN, outside the submitted work; GH reports personal fees from Axpharma, personal fees from Thea laboratories, outside the submitted work.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.