Objective To assess the representativeness of the Heart Protection Study (HPS) and the Collaborative Atorvastatin Diabetes Study (CARDS) for incident statin users.
Design A population-based analysis with linked register data.
Population 56 963 patients with diabetes initiating statin use from 2005 to 2008.
Main outcome measures We determined the proportions of real-world patients who fulfilled the eligibility criteria for HPS and CARDS trials and assessed the cardiovascular disease (CVD) event rates, assumed to reflect the background CVD risk, for those eligible and ineligible. We used descriptive statistics to identify the patient characteristics, lipid-lowering interventions and adherence to statin therapy.
Results Of the real-world patients, 57% (N=32 582) fulfilled the eligibility criteria for HPS (DM) and 49% (N=20 499) of those without CVD for CARDS. The patients ineligible for HPS (DM) had a higher cumulative risk for CVD events than those eligible, whereas regarding CARDS the cumulative risks were of similar magnitude. The overall CVD event rates seemed to be comparable to those in the reviewed trials. Both trials were under-representative of women and users of antihypertensive agents and metformin. 27% and 29% of real-world patients had an initial statin dose corresponding to <20 mg of simvastatin. The proportions of patients who were deemed adherent were 57% in the real world and 85% in both trials.
Conclusions Only half of the real-world patients would have qualified for the HPS (DM) and CARDS, limiting their representativeness for clinical practice. Women and users of antihypertensive agents and metformin were under-represented in both trials. These deviations reflect the changes in diabetes treatment over the years and are not expected to modify the average treatment effects of statins on CVD. Prescribing of lower statin doses in clinical practice than used in the trials and lower adherence may, however, attenuate the benefits in the real world.
- randomised controlled trial
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
This is the first study to assess the representativeness of the Heart Protection Study (HPS) and the Collaborative Atorvastatin Diabetes Study (CARDS) for real-world diabetes care.
We assessed various aspects potentially affecting the representativeness of the HPS and CARDS trials: the trial eligibility criteria, the participant characteristics, the statin interventions and adherence to statin therapy.
All trial eligibility criteria could not be assessed by registry data and we may have slightly underestimated or overestimated the proportion of those eligible for the trials.
Our assessment represents a case study in Finland; since the treatment practices vary between countries, similar evaluations of the representativeness of RCTs in other countries are needed.
For persons with diabetes, statins are widely recommended to lower the risk of cardiovascular disease (CVD) events.1–5 The absolute risk of CVD events is higher among people with diabetes than among those without diabetes, and the risk is further increased in the presence of diabetes and prior CVD.6 ,7 The current European guidelines for dyslipidaemia and CVD prevention recommend statin therapy for nearly all patients with type 2 diabetes mellitus, as well as for those without CVD.1–3 Only patients under the age of 40 years, with newly diagnosed type 2 diabetes, and without clinical complications or other CVD risk factors, may be withheld from statin therapy.1 In practice, at least 80% of the patients with diabetes who begin taking a statin seem to have no established CVD.8 ,9
A large meta-analysis of 14 randomised controlled trials (RCTs) including only participants with diabetes showed a relative reduction of 21% for major vascular events (ie, coronary event, coronary revascularisation or stroke) per every 1 mmol/L reduction in low-density lipoprotein (LDL) cholesterol associated with statin therapy.10 This meta-analysis confirmed the benefits of statins in diabetic dyslipidaemia, as suggested by some RCTs. The two landmark trials providing evidence on the efficacy of statins in preventing CVD events in diabetes are the subanalysis of the Heart Protection Study, HPS (DM),11 and the the Collaborative Atorvastatin Diabetes Study (CARDS).12 The HPS (DM) included patients with diabetes, 51% of whom also had occlusive arterial disease.11 In the HPS (DM) trial, simvastatin (40 mg) reduced the rate of major vascular events by 22% during a mean follow-up of 4.8 years. In the CARDS trial, only patients with type 2 diabetes but without CVD were randomised and the trial reported a 37% relative reduction in major vascular events for atorvastatin (10 mg) for a median duration of 3.9 years.12 While the relative risk reductions for CVD events in diabetes associated with statin therapy seem to be broadly the same across various patient subgroups,11 the absolute benefits increase in line with the patients’ background CVD risk.11 ,13 ,14
The HPS (DM) and CARDS trials are commonly cited in clinical guidelines on statin use in diabetes,1 ,3 ,4 yet no studies have assessed their representativeness regarding real-world diabetes care. However, knowledge of their representativeness is essential for understanding the applicability of their findings.15 Previous research on the representativeness of statin trials has typically focused on demographic characteristics such as gender and age.16–19 We wanted to expand the current knowledge and studied various aspects possibly affecting the representativeness of the HPS (DM) and CARDS trials: the trial eligibility criteria, the participant characteristics, the statin interventions and adherence to statin therapy. We used data from a nationwide Finnish health register to characterise real-world patients with diabetes initiating statin use between 2005 and 2008. We divided the patients into those fulfilling and those not fulfilling the eligibility criteria of the HPS (DM) and CARDS trials. Second, to further evaluate the implications of the eligibility criteria on representativeness, we determined the occurrence of CVD events, which was assumed to reflect the background CVD risk, for the eligible and ineligible patients. Finally, we assessed the characteristics, lipid-lowering interventions and adherence to statins among the real-world patients with diabetes.
Source of register data
We used the Diabetes in Finland (FinDM) database to identify patients with diabetes who initiated statin use between 2005 and 2008.20 The database was originally constructed for the monitoring of diabetes epidemiology, diabetes-related complications and diabetes care. It combines nationwide data from administrative health registers managed by the Finnish Social Insurance Institution (SII), the National Institute for Health and Welfare (THL) and Statistics Finland. The register data were linked on an individual basis using personal identification codes. The study group received a pseudonymous data set for its analyses. Persons with diabetes were identified as having been either reimbursed for purchases of drugs used in the treatment of diabetes (Anatomical Therapeutic Chemical code A10) or eligible for special reimbursement for medication costs due to diabetes or having a primary or secondary hospital discharge diagnosis for diabetes.20 The entitlement for special reimbursement is based on predefined criteria, a written certificate by the patient's treating physician and a review process conducted by the SII.
For all patients identified in the FinDM database, the data included information on all reimbursed prescription drug purchases in non-institutional settings (between 1994 and 2011), entitlements for special reimbursements due to severe chronic conditions such as coronary heart disease (CHD) (between 1964 and 2011), all hospitalisations (between 1969 and 2011), day surgical procedures (between 1994 and 2011) and outpatient hospital visits (between 1998 and 2011), with diagnostic information (ICD-8-9-10), admission and discharge dates and dates and causes of death (between 1971 and 2010).
We excluded women with gestational diabetes and persons having a single purchase for an antidiabetic drug or non-specific diabetes-related records only. The onset of diabetes refers to the first registration date of diabetes in any of the aforementioned registers. Accordingly, newly diagnosed diabetes was defined as diabetes registered 6 months or less before statin initiation. The type of diabetes was classified according to the type of antidiabetic medication purchased and the age of onset—patients under 40 years of age at the onset of diabetes with continuous prescription purchases for insulin and without purchases for medications that stimulate insulin secretion were defined as having type 1 diabetes mellitus and those not fulfilling these criteria were classified as having type 2 diabetes.
Permissions to collect data from the FinDM database were obtained from the maintainers of the registers.20 As a part of a larger diabetes research project, our study was approved by the ethics committee of the National Institute for Health and Welfare, Finland.
We identified all statin naïve patients with diabetes who made their first statin purchase (Anatomic Therapeutic Codes C10AA01-C10AA05, C10AA07, C10BA02) between 2005 and 2008. This period was chosen to capture recently treated patients and to attain a follow-up period comparable to those of the HPS and CARDS trials. The first statin purchase refers to no statins dispensed during the preceding 3 years.21 We defined the date of the first statin purchase as the cohort entry date for all individuals. The follow-up time was calculated from the cohort entry date until the first occurrence of the composite end point of a major cardiovascular event or censoring due to non-CVD-related death, permanent institutionalisation or 31 December 2010, whichever was first.
Major cardiovascular events
We chose a composite end point of CVD events as the outcome of interest, including acute myocardial infarction (as a primary or secondary discharge diagnosis of International Classification of Diseases (ICD)-10 I-21, I-22) and/or a coronary revascularisation procedure (procedure codes for coronary artery bypass grafting, angioplasty or stenting), stroke (as a primary or secondary discharge diagnosis of ICD-10, I-60, I-61, I-63) or CVD given as a primary cause of death (ICD-10 codes I-20–I-25, I-46, R96, R98, G45 and I-60–I-69).22 The validity of the Hospital Discharge Register and the Causes of Death Register for capturing CHD events and strokes is good.23–25 The index date for the event was either the hospital admission date or the date of out-of-hospital death.
We extracted patient-level information on demographic characteristics, complications and prescribed medications related to diabetes, and cardiovascular comorbidities (table 1). Data were also extracted to cover the inclusion and exclusion criteria of the HPS11 ,13 and CARDS12 trials, as far as available in the registers (see figure 1A, B and online supplementary appendix table). For comorbidities, we used the corresponding ICD-10 codes captured in the Hospital Discharge Register. When available, additional data from the SII Special Reimbursement Register (including data on CHD, moderate or severe hypertension, chronic heart failure, chronic pulmonary diseases, malignancy, dementia and psychotic disorders) and the Prescription Register (purchases for specific medications used to treat hypertension, chronic pulmonary disorders, malignancies, dementia and psychotic disorders) were used. We collected data on comorbidities and vascular procedures from the 9 years preceding the cohort entry date, as well as data on prescriptions dispensed from the 4 months preceding this date. We further categorised the cohort members according to the presence of established CVD at the time of statin initiation, that is, applicable ICD-10 codes for CHD (ie, myocardial infarction, angina pectoris or unstable angina pectoris), stroke, transient ischaemic attack or peripheral vascular disease, surgical procedure codes for coronary revascularisation, amputation or other peripheral vascular procedure due to atherosclerosis or codes for special reimbursement due to CHD.
We calculated adherence to statin therapy for the cohort members as the truncated medication possession ratio (MPR).26 We assumed a dosage of one statin tablet per day and divided the total number of statin tablets dispensed by the total number of days of follow-up (since cohort entry to event occurrence or censoring). We calculated the MPR for all those followed for event occurrence, as well as separately for those surviving at the end of each year of follow-up. In both cases, we calculated the MPR for the period of interest and defined patients with good adherence to statin use as those with an MPR of ≥80%, a conventional cut-off value.27 ,28
To study dose titration, we calculated the daily statin doses as simvastatin equivalents,29 at statin initiation and at the end of 1 year of follow-up, for patients surviving for 365 days after the initiation and with at least one refill during the latter part of the follow-up year (ie, between 180 and 365 days after initiation).
We calculated the proportions of real-world patients meeting the eligibility criteria applied in the HPS (DM) trial and of those meeting any single criterion for exclusion (figure 1A). For both groups of patients deemed either eligible or ineligible, we estimated the cumulative hazard function for the composite end point using a Nelson-Aalen estimator (figure 2A) in a stratified survival analysis from the date of the first statin purchase until the date of the composite end point or censoring. As the CARDS trial included only patients without established CVD at cohort entry, we determined the denominator accordingly from the subgroup of real-world patients presenting without CVD (figure 1B) and performed similar analyses applying the eligibility criteria of the CARDS trial (figure 2B). We regarded the risk of CVD events during statin therapy as a function of the patient's background CVD risk and the effect of statins in reducing CVD, as performed by Van Staa et al.30 Statin therapy reduced the relative risk of major CVD events by 22% in the HPS (DM) trial11 and by 37% in the CARDS trial.12 If it is assumed that statins had a similar effect on our cohort members, the underlying CVD risks would have been 22–37% higher than those observed in this study.
We used descriptive statistics to determine the patient characteristics and lipid-lowering interventions for all of the cohort members and also separately for those without CVD at statin initiation. We used the SAS release 9.2 program package (SAS Institute, Cary, North Carolina, USA) for all of the statistical analyses.
Trial eligibility criteria and real-world patients
Altogether, 56 963 patients with diabetes initiated statin use between 2005 and 2008 in Finland. Most of them, 73% (N=41 552), had no apparent CVD at cohort entry. Fifty-seven per cent of the patients fulfilled the eligibility criteria of the HPS (DM) trial (figure 1A, see also online supplementary appendix table), and 49% of those with no established CVD fulfilled the criteria for the CARDS trial (figure 1B, see also see online supplementary appendix table). Patients with a recent CVD event were deemed ineligible for both trials.
Among the initiators, a major CVD event occurred for 8714 patients (15%) during a mean follow-up of 3.4 years. There were 2499 acute myocardial infarctions, 3163 strokes, 1856 coronary procedures and 1196 CVD deaths captured as first events in the registers. Altogether, 48 249 patients were censored: 2212 (4%) died of non-CVD-related causes, 942 (2%) were institutionalised and 45 095 (79%) reached the end of the study period (31 December 2010) without a major CVD event. For patients not meeting the eligibility criteria of the HPS (DM) trial, the cumulative risk of a CVD event occurring was two to three times higher compared to those who were eligible, whereas the cumulative risk for a CVD event occurring among the patients eligible or ineligible for the CARDS trial, all without established CVD, was of the same magnitude (figure 2).
Table 1 presents the descriptive characteristics for all of the real-world patients, as well as separately for those without CVD, for comparison with the data from the HPS (DM) and CARDS trials.
The respective data on medication use can be found in table 2.
Compared with the HPS (DM) population, the real-world patients were less often male. The mean age was, however, well balanced, the proportions of those younger than 65 years being about 60%. The proportion of patients with CVD (or CHD) was lower (27% vs 51%), and the mean duration of diabetes was shorter (7.6 vs 9.3 years) among the real-world patients than in the HPS (DM) trial. Compared with the CARDS participants, real-world patients without established CVD were also less often male and were younger. Specifically, within the age bracket 40–75 years, 53% of the real-world patients (N=34 682) were younger than 60 years, the corresponding proportion being 39% in the CARDS trial. The mean duration of diabetes was well balanced between the real-world patients and the CARDS participants. Newly diagnosed diabetes was an exclusion criterion in the CARDS trial, whereas 14% of the real-world patients belonged to that group. Use of antihypertensive medication and metformin was more common, and the use of sulfonylureas less common, among the real-world patients than among participants in both trials.
We give the distributions for statin doses at initiation and during the second half of the first year of follow-up as simvastatin equivalents in table 3.
About one-quarter (27%) of all the real-world patients and 29% of those without CVD had a statin prescribed at a dose corresponding to <20 mg of simvastatin. These proportions did not change appreciably during the 1-year follow-up. Only 1% used fibrates at statin initiation (N=607 for all of the patients and N=406 for those without CVD).
For the real-world patients, the mean MPR was 72% for a mean follow-up of 3.4 years. The proportion of survivors with good adherence to statins (MPR ≥80%) decreased gradually from 63% (32 886/51 905) at the end of the first year of follow-up to 42% (4059/9626) at the end of the fifth year, the average proportion for all five study years being 57%. The corresponding proportions for the original HPS study participants were 89% and 82%, respectively, with an average proportion of 85%. In the CARDS trial, the proportion of participants with good adherence to lipid-lowering interventions was 90% for the first year, 78% for the fourth year (last available) and 85% on average.
Limitations in representativeness for the real-world diabetes care were found when HPS (DM) and CARDS trials were compared with population level data. Approximately half of the real-world statin initiators with diabetes would have qualified for these two landmark randomised controlled trials. The background CVD risk, approximated by the cumulative risk for major CVD events after statin initiation, was either of the same magnitude or remarkably higher among those deemed ineligible in comparison with those eligible for the trials. Women were under-represented in both trials, and concomitant antihypertensive medications and metformin were more commonly used in the real-world setting. Furthermore, almost 30% of the real-world patients were prescribed statin doses that were lower than those used in the trials, and about 40% of the patients did not adhere to their statin therapy.
In RCTs, the legitimate aim of applying often strict eligibility criteria is to obtain a homogeneous trial population with minimum noise. This may, however, limit the representativeness of the RCTs for real-world clinical care.15 ,31–33 Yet, for the limitations in representativeness to have clinical impact, they would have to question the applicability of the trial findings for real-world clinical care. That is, they would have to modify the relative or absolute treatment effects of statins on CVD as they are translated to real-world settings from the trials.15 The proportions of patients deemed eligible in our study were similar to those recently reported in the UK for RCTs on novel oral anticoagulants (48–64%)34 and for the UK Prospective Diabetes Study (32–51%)35 but clearly higher than those for various other RCTs on intensive glucose lowering (4–36%).35 The background risk, reflected in the cumulative risk for CVD events after statin initiation among patients deemed ineligible, was either similar or remarkably higher as compared with those eligible. Correspondingly, the CVD event rate observed in the CARDS trial (about 10% in the placebo arm in 4 years)12 approximates the event rates observed in our study for those without CVD and deemed eligible or ineligible for CARDS. Absolute risk reduction associated with statin therapy in diabetes depends on the background risk for CVD events.11 ,13 ,14 Therefore, it seems reasonable to expect that the absolute risk reduction among all real-world patients with diabetes and without CVD has been of the same magnitude as that observed for patients with diabetes in CARDS. However, the event rate of the real-world patients meeting the eligibility criteria of the HPS (DM) trial was lower than that observed in the trial (about 20% in the placebo arm in 4 years).11 This may be explained by our finding on the larger proportion of real-world patients presenting without CVD at statin initiation. Also, the event rate was clearly higher for the patients deemed ineligible for HPS (DM). This, for comparison, may reflect the trial exclusion of high-risk patients with recent CVD events who are yet likely to benefit from intensive statin therapy.36 Still, the average event rate for all of the initiators, regardless of eligibility, was similar to the rate of major CVD events in the HPS (DM) trial (data not shown).
Both reviewed trials included fewer women and the use of antihypertensive medications and metformin was less common than in clinical practice. In addition, the HPS (DM) trial was under-representative regarding patients without CVD. Overall, the observations reflect a changing scenario of treatment over the years. Most of the placebo controlled statin RCTs, including CARDS and HPS (DM), recruited their participants with diabetes by the year 2001 or earlier.11 ,12 ,37–40 Since then, the diagnostic criteria for diabetes have broadened, and the recommendations for screening, nutrition and self-management have intensified.3–5 ,41 ,42 Statins are initiated in the earlier stages of the disease8 ,9 and the risk of CVD events associated with female gender is acknowledged.16 ,19 ,43 The role of metformin in the front line of therapy has become stronger,44–46 and the use of sulfonylureas has declined.44–46 This trend has been accompanied by improvements in blood pressure control44 ,45 ,47 and a decline in mortality in diabetes.48 The relative treatment effects of statins in CVD prevention in diabetes are constant regardless of gender, age, prior CVD, diabetes duration and the use of antihypertensive treatment.11 Therefore, the aforementioned deviations in patient characteristics and concomitant medications between the real-world clinical care and the reviewed trials are not expected to modify the relative treatment effects. However, the relative and absolute effects of statins vary with the type and dose of the statin intervention.11 ,12 Our findings support the common notion that the cumulative statin doses and adherence to statin therapy in the real world are lower than in the RCTs.27 ,49 ,50 This may attenuate the benefit and highlights the need for more appropriate implementation of evidence-based statin therapies in the real world.
Strengths and limitations
This is the first study to evaluate the representativeness of statin trials for real-world statin initiators with diabetes in terms of eligibility criteria, participant characteristics and medication use. The validity of our data for capturing real-world patients with pharmacologically treated diabetes in clinical practice in Finland is good.51 However, our study has some limitations owing to our reliance on register data. We have missed some patients with diabetes, especially among persons aged 65 years or more, who either had undiagnosed diabetes or who were on diet therapy only and had not received any hospital care.51 We had no data on liver function tests, cholesterol levels or smoking habits, and the actual date of diabetes onset was estimated using the first diabetes-related record in any of the registers. In addition, some complications, such as retinopathy, microalbuminuria and nephropathy, are likely to have been under-ascertained. Furthermore, the validity of our data on capturing clinically determined diabetes subtype has not been studied. Therefore, we were not able to define the eligibility criteria exactly in the same way that the reviewed trials had done, and we may have slightly underestimated or overestimated the proportions of eligible patients. While our dose assumption of one tablet per day is likely to reflect the prescribed statin dose,52 actual statin use could not be verified from the prescription register. Our study population included statin initiators only, and long-term users and non-users were excluded. Additionally, we focused on statin initiations from 2005 to 2008, and therefore our study populations may not reflect the current patients. In order to update the results, we analysed the characteristics of all statin initiators with diabetes in 2010 (N=12 541).We did not observe any appreciable changes in the age profile, proportion of men, proportion of those with medically treated hypertension or the proportion of patients with CVD, nor in the mean duration of diabetes (data not shown). However, the use of metformin was even more common (68%), and the use of other orally administered antidiabetic agents was of the same magnitude as that of sulfonylureas (12% and 13%, respectively). In addition, there was a shift towards higher statin doses: only one-fifth of the patients in 2010 initiated their statin use with a dose corresponding to <20 mg of simvastatin. Finally, diabetes care, including treatment of dyslipidaemia, is constantly evolving53 and our assessment represents a case study in Finland. Although the prevalence of statin use in diabetes in Finland seems to be at an average level,54 the treatment practices vary between countries.55 Thus, similar evaluations of the representativeness of RCTs with respect to the care of patients with diabetes in other countries are needed.
Only half of the real-world patients initiating statin use would have qualified for two landmark trials on statin use in persons with diabetes, the HPS (DM) and CARDS, limiting their representativeness for clinical practice. Women and users of antihypertensive agents and metformin were under-represented in both trials.
These deviations reflect the changes in diabetes treatment over the years and are not expected to modify the average treatment effects of statins on CVD. Prescribing of lower statin doses in clinical practice than those used in the reviewed trials and lower adherence may, however, attenuate the benefits in the real world when compared with the RCTs.
The authors thank the Social Insurance Institution, Finland and Orion Farmos Research Foundation for supporting this study. Georgianna Oja, ELS, is acknowledged for editing the language in this manuscript.
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Files in this Data Supplement:
- Data supplement 1 - Online supplement
Contributors PR designed the study, interpreted the data, drafted the article and is the guarantor of the study. RS designed the study, was involved with the acquisition of the data, designed the statistical analysis, interpreted the data and revised the article. MA designed the study, conducted the data analysis and revised the article. AH-S, RH, IK, TV and MJK designed the study, interpreted the data and revised the article.
Funding This study was funded by a grant from the Social Insurance Institution (SII) (10/26/2007).
Competing interests PR had support from the Social Insurance Institution of Finland and the Orion Farmos Research Foundation for the submitted work. RS, AH-S, TV, IK and RH had support from the Social Insurance Institution of Finland for the submitted work. RH had a financial relationship with the Academy of Finland and Hospital District of Southwest Finland within the previous 3 years. MJK had a financial relationship with the Social Insurance Institution of Finland within the previous 3 years. MA declares no competing interests.
Ethics approval The ethics committee of the National Institute for Health and Welfare, Finland.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Additional data are available by emailing the corresponding author (PR).
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.