Article Text

A comparison of adverse event and fracture efficacy data for strontium ranelate in regulatory documents and the publication record
  1. Mark J Bolland,
  2. Andrew Grey
  1. Department of Medicine, University of Auckland, Auckland, New Zealand
  1. Correspondence to Dr Mark Bolland; m.bolland{at}auckland.ac.nz

Abstract

Objective Recently, the European Medicines Agency reported that strontium ranelate increases myocardial infarction risk in postmenopausal women, 8.5 years after it was registered for use in osteoporosis. Unreported serious adverse events in clinical trials for other pharmaceuticals have been described in recent years. We assessed reporting of adverse events and fracture efficacy of strontium.

Methods We compared data on adverse effects (myocardial infarction, venous thromboembolism and pulmonary embolism) and fracture efficacy of strontium in publicly available regulatory documents with data in publications retrieved from searching PubMed.

Results We identified 5 regulatory documents and 9 primary publications of 7 randomised, placebo-controlled trials of strontium that reported relevant data. We identified several areas of concern in these reports: the increased risk of myocardial infarction with strontium was not identified in a pivotal phase 3 clinical trial despite specific regulatory review of cardiovascular events; data on myocardial infarction were not included in any primary publication; increased risks of venous thromboembolism and pulmonary embolism with strontium were not reported in either of the phase 3 clinical trials; data on venous thromboembolism were reported in only 5 of 9 primary publications, data on pulmonary embolism in only 2 of 9 primary publications, and either was discussed in <50% of subsequent review articles. There were differences in participant numbers, fracture cases and venous thromboembolism cases between regulatory documents and primary publications. Based on all available data from primary publications and regulatory documents, the number of fractures prevented by strontium use is similar to the number of extra cases of venous thromboembolism, pulmonary embolism and myocardial infarction caused by strontium use.

Conclusions The risks of strontium use are similar to the benefits. Full disclosure of the clinical trial data and regulatory documents would allow clinicians and their patients to decide whether use of the drug is worthwhile.

  • GERIATRIC MEDICINE
  • STATISTICS & RESEARCH METHODS

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • A detailed review of data on important adverse events and fracture efficacy of strontium ranelate reported in publicly available regulatory documents and published articles.

  • The major limitation is that the European Medicines Agency declined access to the relevant clinical study reports from the phase 3 trials of strontium ranelate.

Introduction

In preclinical studies, strontium ranelate appeared to increase bone formation and bone density, which led to the development of a human clinical trial programme by the pharmaceutical company Servier.1 Figure 1 shows the time course of the phase 3 study programme and related publications, and the regulatory events for strontium. There were two phase 3 studies in postmenopausal women—SOTI, powered to detect a 30% reduction in vertebral fracture, and TROPOS, powered to detect a 25% reduction in non-vertebral fracture.1 A later trial, MALEO, with change in spine bone density as the primary end point, was conducted to seek extension of the treatment indications to men.2 Strontium ranelate was registered for use in postmenopausal osteoporosis in Europe in 2004 on the basis of the two phase 3 trials, and subsequently in more than 70 countries. Sales of strontium in Europe were approximately €200 million in 2010.3 In April 2013, 8.5 years after registration, the European Medicines Agency (EMA) reported that strontium increases the risk of myocardial infarction in postmenopausal women, largely based on data from one of the phase 3 trials.4 The reason for the lengthy delay between the registration of strontium and the reporting of this serious adverse event is not clear. In early 2014, the EMA Pharmacovigilance Risk Assessment Committee (PRAC) recommended that the registration of strontium be suspended.5 ,6 However, the EMA Committee for Medicinal Products for Human Use (CHMP) instead opted to place prescribing restrictions, limiting use of strontium to individuals with severe osteoporosis who are not at high cardiovascular risk.4 ,6 ,7

Figure 1

Timeline of conduct and publication of phase 3 studies of strontium and regulatory events. SOTI was a 5-year, randomised, placebo-controlled trial in 1649 postmenopausal women recruited between September 1996 and May 1998. The primary end point was vertebral fracture with the main statistical analysis at three years. In year 5, women taking strontium were re-randomised to stopping or continuing strontium, and women taking placebo were transferred to strontium.1 ,16 TROPOS was a 5-year, randomised, placebo-controlled trial in 5091 postmenopausal women recruited between September 1996 and September 1998. The primary end point was non-vertebral fracture with the main statistical analysis at 3 years.1 ,17 Subgroups of participants taking strontium in SOTI and TROPOS continued in an open-label extension study for up to 10 year after initial randomisation. MALEO was a 2-year randomised placebo-controlled trial in 261 men with osteoporosis with change in spine bone density as the primary end point and the main analysis at one year.2

In recent years, there have been a number of high profile examples of adverse events being unreported or selectively reported in the primary publications of clinical trials. Such examples include COX-2 inhibitors and myocardial infarction,8 rosiglitazone and myocardial infarction9 and antidepressents and suicide risk.10 These and other examples have led for calls for greater general access to data from clinical trials.11 We searched all publicly available regulatory documents and published articles on strontium to determine whether data on myocardial infarction had been reported and whether there were differences in reporting between the regulatory documents and published articles. In the same documents, we also assessed the reporting of the two other serious adverse events of strontium, venous thromboembolism and pulmonary embolism, and data on antifracture efficacy.

Methods

Regulatory information

We searched the EMA website (most recent search May 2014) for all documents related to strontium and found five with relevant clinical information—a 2005 European Public Assessment Report related to the initial registration,12 a 2012 assessment of adverse effects,13 a 2012 variation assessment considering extending an indication to male osteoporosis,14 a 2013 Periodic Safety Update Report4 and a CHMP scientific conclusion/PRAC Assessment report.6 None of the clinical trial reports from any trial of strontium were available on the EMA website. In November 2013, we requested the clinical study reports for the SOTI and TROPOS studies from the EMA, together with documents relating to a cardiac safety assessment, described in the 2013 Periodic Safety Update Report. Our request for the SOTI and TROPOS reports was declined on the grounds of commercial sensitivity on 30 April 2014.

Strontium publications

We searched PubMed in August 2013 using the terms ‘Strontium ranelate’ and ‘Strontium AND osteoporosis’ for relevant trials, review articles and economic assessments. Of the 699 articles retrieved, there were 9 primary reports of 7 randomised, placebo-controlled trials,2 ,15–22 2 reports of open-label extensions of the phase 3 studies, 16 reports of additional data or post hoc analyses from the phase 3 studies, 6 economic and/or cost-effectiveness assessments and 52 reviews that specifically summarised data on clinical use of strontium (references in online supplementary appendix 1). Both searches were carried out by a single author (MB). Data were extracted from the publications by one author (MB), checked by a second author (AG), and then were pooled using a random-effects model (Comprehensive Meta-Analysis V.2, Biostat, Englewood New Jersey, USA). We compared data reported for each trial and the pooled analyses of these data with the data reported in the regulatory documents, restricting all comparisons to the 2 g daily dose of strontium ranelate recommended for clinical use.

Results

Adverse effects

Concern about risk of myocardial infarction arose in 2011/2012 after Servier applied to extend the indication for strontium to male osteoporosis. In the relevant MALEO trial, there was a higher rate of cardiac events in men randomised to strontium.2 ,14 Initially Servier,14 and later the MALEO investigators,2 suggested that this imbalance was due to a chance increase in cardiac risks at baseline in the strontium group. The regulator asked for further monitoring of cardiac events with strontium use.14 Subsequently, the 2013 Periodic Safety Update Report showed that strontium increased the risk of myocardial infarction in pooled analyses of seven trials in postmenopausal women, with similar imbalances of myocardial infarction or ischaemic heart disease in trials in osteoarthritis and male osteoporosis.4

Table 1 shows the myocardial infarction data from the individual trials. Three of these trials are unpublished (2 trials in osteoporosis and 1 in osteoarthritis). The largest trial, TROPOS, was the greatest contributor to the pooled analysis (at 5 years, 58 vs 30 myocardial infarctions, relative risk 1.9, 95% CI 1.2 to 3.0, P=0.003).4 In contrast to MALEO, there was no imbalance in baseline cardiac risk between treatment groups in TROPOS, but Servier submitted that the increased risk was confined to a subgroup of participants at increased cardiovascular risk.4 This analysis was a post hoc subgroup analysis, but no details were provided about how variables were chosen for the analysis, whether an interaction test was performed for the final analyses, what effect size the analyses had power to detect, or whether the analyses were subjected to independent statistical review. In pooled analyses of the two phase 3 trials, the relative risk of myocardial infarction with strontium at 3 years was 1.3 (39 vs 29, 95% CI 0.8 to 2.0, p=0.12), and at 4 years was 1.5 (51 vs 34, 95% CI 1.0 to 2.3, p=0.07). It was noted that ‘In 2007, at the time of TROPOS study (5 years data) report submission a specific evaluation of coronary artery disorders and heart failure was performed. It was assessed by the CHMP and the FUM (Follow-up measure) was fulfilled with no signals considered to raise further concerns’.4 None of the pertinent documents—the 5 year TROPOS report, the CHMP or FUM evaluations—are available on the EMA website. None of the published papers from the strontium clinical trials programme report data on myocardial infarction.

Table 1

Data on adverse events of strontium in regulatory documents and primary publications

Table 1 also shows data on the effect of strontium on venous thromboembolism and pulmonary embolism, obtained from regulatory documents, primary publications and a Cochrane review.23 In analyses contained in regulatory documents, strontium caused an increased risk of venous thromboembolism and pulmonary embolism in pooled analyses of SOTI and TROPOS at 3 years. The increased risk appeared during the first year of strontium use and was unchanged thereafter.12 However, neither adverse event was reported in the primary publications. Data on venous thromboembolism but not pulmonary embolism were reported in the SOTI 4 year and TROPOS 5 year papers, and in the 2012 regulatory update of adverse events. The effects of strontium on venous thromboembolism and pulmonary embolism were not mentioned in the Discussion section of any of the primary publications on SOTI or TROPOS. Tables 1 and 2 show that the numbers of events for venous thromboembolism in pooled analyses differs substantially between regulatory documents and primary publications, and between different regulatory documents.

Table 2

Differences in data between primary publications and regulatory documents

We reviewed the additional publications identified in our search (see online supplementary appendix for references) for reporting of adverse event data. The open-label extensions of SOTI and TROPOS reported data on venous thromboembolism but not pulmonary embolism or myocardial infarction at both 8 and 10 years. Of the 16 studies reporting additional clinical data or post hoc analyses of SOTI and TROPOS, only 2 reported data on venous thromboembolism, 1 on pulmonary embolism, and none on myocardial infarction—14 reported no data on any of these outcomes. Of the 6 economic analyses (Economic analyses section online supplementary appendix), 4 discussed venous thromboembolism, 2 pulmonary embolism and none myocardial infarction, but only 1 analysis incorporated costs associated with increased venous thromboembolism and pulmonary embolism. Fifty-two reviews of strontium were published between 2003 and 2013; 14 (27%) in journal supplements, 14 (27%) coauthored by one SOTI/TROPOS investigator, and 29 (55%) coauthored by at least one of the authors of a primary publication of a randomised controlled trial of strontium. We reviewed the full-text of 40 English language reviews: 19 discussed venous thromboembolism risk, 8 pulmonary embolism risk (3 of which simply stated that there was no risk in a post hoc analysis of younger women in SOTI), and none myocardial infarction risk.

Fracture efficacy

Table 3 shows data on the effect of strontium on vertebral, hip and non-vertebral fracture, obtained from regulatory documents, primary publications and a Cochrane review.23 The data at the 3 year time point for the two phase 3 trials were mostly identical in the regulatory documents and primary publications except for non-vertebral fractures for both SOTI and TROPOS (table 2). For the primary end point for TROPOS, an unadjusted analysis that was statistically non-significant was reported in the regulatory document, whereas in the primary publication a statistically significant analysis adjusted for age, femoral neck bone mineral density, body mass index and country was reported.17

Table 3

Data on fracture efficacy of strontium in regulatory documents and primary publications

Pooled data from seven phase 2/3 trials in postmenopausal osteoporosis from the 2013 Periodic Safety Update Report and the 2014 CHMP scientific conclusion/PRAC assessment report are shown in table 3 together with data from the five published trials—two trials were unpublished. There are minor differences in the number of participants in the later publications for SOTI and TROPOS compared to the primary papers and regulatory documents (table 2). There are also minor differences in the number of participants and the number of participants with fracture between the 2013 and 2014 regulatory documents (table 2). Efficacy in preventing vertebral fractures was similar in the pooled regulatory analysis and our pooled analysis of published data. For non-vertebral fractures, the two analyses were again similar but some fractures were missing from the analysis in the regulatory documents. There were 920 non-vertebral fractures in the publications of STRATOS, SOTI at 3 years (number not reported at 4 years) and TROPOS at 5 years, compared to 918 and 919, respectively, reported in the regulatory analyses of all 7 trials in postmenopausal women. Numbers of hip fractures were only reported in one publication, although this contributed the majority of fractures to the regulatory analyses.

Discussion

We identified a number of important differences between data in regulatory documents and those in primary publications (table 4). Most concerning is that adverse events were not reported in primary publications: neither of the primary publications of SOTI and TROPOS16 ,17 reported that strontium increased the risk of venous thromboembolism and pulmonary embolism in pooled analyses of these two studies and no primary publication reported data on myocardial infarction. The majority of subsequent publications generated from the strontium clinical trials programme also failed to report data on these adverse events. The other differences are generally favourable for the marketing of strontium for example, the difference between the unadjusted and adjusted analyses for the primary end point in TROPOS at 3 years is clinically unimportant, yet the marketing value of a statistically significant result is likely very important. In addition, there were differences in the numbers of participants in the treatment groups, the number of participants with fracture and venous thromboembolism, and the calculated treatment effects on these events both between different regulatory documents and between regulatory documents and primary publications. There is insufficient publicly available information to explain these differences, although it is possible that differences in statistical analyses arose in response to the journal review process.

Table 4

Concerns about reporting in trials of strontium ranelate

It is possible that changes in reported adverse event data between publications arose because of changes in definitions of adverse events over time. Few details are available regarding how the adverse events were identified or defined in individual trials, and whether adjudication took place for any of these events. All data on myocardial infarctions were self-reported. Our experience of adjudicating self-reported myocardial infarctions in a clinical trial where there was an unexpected imbalance of events was that neither the source of the event (hospital discharge code or self-report), nor the level of adjudication substantially altered the relationship between treatment allocation and cardiovascular events.24

We remain uncertain as to why there was a long delay in reporting the increased risk of myocardial infarction with strontium. The increased risk was present in TROPOS, but insufficient data are publicly available to determine when the elevated risk emerged during that trial. However, there was a statistically significant increase in risk of myocardial infarction by completion of the trial. TROPOS was completed in late 2003, an end-of-study report was reviewed by the regulator in 2007 in which cardiac safety was specifically considered and the primary publication of 5 year data was in 2008, but the increased risk of myocardial infarction was not reported until 2013. The increased risk was detected only after a safety signal was identified in a small trial conducted to permit extension of the indication for use of the drug. We were unable to obtain the clinical study report for TROPOS or the cardiac safety assessment from the EMA. These documents may provide more information as the cause of the delay. The consequence of the delay is a distortion of the risk/benefit profile of strontium in favour of its widespread use. By 2010, annual sales of strontium approached €200 million3 and the drug was approved for use in >70 countries.

Our analysis suggests a lack of independent scrutiny of strontium in the publication record. Most reviews included at least one coauthor of a primary publication of a trial of strontium and nearly 1 in 3 reviews were in journal supplements. Adverse effects were under-reported, with only a minority of reviews discussing venous thromboembolism and only 1 in 8 discussing the increased risk of pulmonary embolism. The scarce data on both fracture efficacy and adverse events in the primary publications also limits independent critical analysis, as authors of review articles may not have been aware of concerns about safety or efficacy, may not have been able to obtain additional data on these end points, and may therefore have been restricted to simply repeating the limited results reported in the primary publications.

Our findings support the calls for greater and more transparent access to data from clinical trials.11 Detailed trial reports that are available to independent investigators may prevent the problems we identified. In particular, it would allow more detailed reporting of primary and secondary end points and adverse events than occurs in primary publications, and would highlight differences in analyses or data between primary publications and trial reports. It would permit independent investigators to scrutinise data on efficacy and adverse events of agents more rigorously, and facilitate the conduct of more accurate economic analyses. Although the EMA has released some clinical trial data,25 we were unable to obtain relevant clinical study reports despite 7 months of correspondence.

Based on the available data from primary publications and regulatory documents (tables 1 and 3), the risks of strontium use are similar to the benefits. While strontium reduces the risk of morphometric vertebral fracture by 25–30% and non-vertebral fracture by 13–16%, it does not prevent hip fractures and increases the risk of venous thromboembolism, pulmonary embolism, and myocardial infarction. In TROPOS at 5 years, there were 47 fewer non-vertebral fractures in the strontium group than in the placebo group, but 28 more myocardial infarctions and 16 more cases of deep venous thrombosis/pulmonary embolism. There are differences of opinion in the EMA regulatory committees about the use of strontium. In January 2014, the PRAC recommended the suspension of registration of strontium because of an unfavourable risk/benefit profile (for every 1000 patient-years of treatment, strontium causes 4 extra cases of serious heart problems, and 4 extra cases of blood clots while preventing 5 non-spinal fractures, 15 spinal fractures and 0.4 hip fractures).5 Subsequently, the CHMP disagreed with these recommendations and permitted strontium to remain registered with restrictive prescribing conditions in place.4 ,7 For both decisions, the views of the committees were divergent, with 15 members of PRAC stating that ‘the balance of benefits and risks remained favourable subject to specialist supervision’, and 10 members of CHMP stating that they ‘find the benefit risk balance for strontium ranelate negative in the proposed indication’.6 We suggest that full disclosure of the strontium clinical trial data and regulatory documents be undertaken to allow clinicians and their patients to decide whether use of the drug is worthwhile.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Contributors MJB and AG designed the research. MJB carried out the literature search, extracted the data, performed the analyses and drafted the paper. AG critically reviewed and improved it. MJB is the guarantor for the article.

  • Funding This study was funded by the Health Research Council (HRC) of New Zealand, grant 12/1110.

  • Competing interests MB is the recipient of a Sir Charles Hercus Health Research Fellowship.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.