You are here

  • Home
  • Archive
  • Volume 7, Issue 3
  • Global cardiovascular risk assessment in the primary prevention of cardiovascular disease in adults: systematic review of systematic reviews

Article Text

Article menu

Download PDFPDF

XML
Cardiovascular medicine
Research
Global cardiovascular risk assessment in the primary prevention of cardiovascular disease in adults: systematic review of systematic reviews
  1. Dylan R J Collins1,
  2. Alice C Tompson1,
  3. Igho J Onakpoya1,
  4. Nia Roberts2,
  5. Alison M Ward1,
  6. Carl J Heneghan1
  1. 1Nuffield Department of Primary Care Health Sciences, Centre for Evidence-Based Medicine, University of Oxford, Oxford, UK
  2. 2Bodleian Health Care Libraries, University of Oxford, Oxford, UK
  1. Correspondence to Dylan R J Collins; dylan.collins{at}phc.ox.ac.uk

Abstract

Objective To identify, critically appraise and summarise existing systematic reviews on the impact of global cardiovascular risk assessment in the primary prevention of cardiovascular disease (CVD) in adults.

Design Systematic review of systematic reviews published between January 2005 and October 2016 in The Cochrane Library, EMBASE, MEDLINE or CINAHL databases, and post hoc analysis of primary trials.

Participants, interventions, outcomes Systematic reviews of interventions involving global cardiovascular risk assessment relative to no formal risk assessment in adults with no history of CVD. The primary outcomes of interest were CVD-related morbidity and mortality and all-cause mortality; secondary outcomes were systolic blood pressure (SBP), cholesterol and smoking.

Results We identified six systematic reviews of variable but generally of low quality (mean Assessing the Methodological Quality of Systematic Reviews 4.2/11, range 0/11 to 7/11). No studies identified by the systematic reviews reported CVD-related morbidity or mortality or all-cause mortality. Meta-analysis of reported randomised controlled trials (RCTs) showed small reductions in SBP (mean difference (MD) −2.22 mm Hg (95% CI −3.49 to −0.95); I2=66%; n=9; GRADE: very low), total cholesterol (MD −0.11 mmol/L (95% CI −0.20 to −0.02); I2=72%; n=5; GRADE: very low), low-density lipoprotein cholesterol (MD −0.15 mmol/L (95% CI −0.26 to −0.05), I2=47%; n=4; GRADE: very low) and smoking cessation (RR 1.62 (95% CI 1.08 to 2.43); I2=17%; n=7; GRADE: low). The median follow-up time of reported RCTs was 12 months (range 2–36 months).

Conclusions The quality of existing systematic reviews was generally poor and there is currently no evidence reported in these reviews that the prospective use of global cardiovascular risk assessment translates to reductions in CVD morbidity or mortality. There are reductions in SBP, cholesterol and smoking but they may not be clinically significant given their small effect size and short duration. Resources need to be directed to conduct high-quality systematic reviews focusing on hard patient outcomes, and likely further primary RCTs.

Trial registration number CRD42015019821.

  • total cardiovascular risk
  • risk score
  • primary prevention
  • cardiovascular risk assessment

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

https://doi.org/10.1136/bmjopen-2016-013650

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Strengths and limitations of this study

    • This systematic review summarises evidence from six systematic reviews on the use of global cardiovascular disease (CVD) risk assessment for the primary prevention of CVD in adults and reports important patient outcomes.

    • The quality of the systematic reviews was assessed using Assessing the Methodological Quality of Systematic Reviews and was generally poor, with inconsistencies in methods, outcomes, quality appraisal and reporting.

    • Owing to the deficiencies in the reviews, we undertook post meta-analyses, which included further analysis of the identified primary studies within the reviews and quality appraisal using GRADE.

    • Our systematic review was strengthened by its broad inclusion criteria, which reduced the chance we missed relevant systematic reviews.

    • The findings of our post hoc meta-analyses should be interpreted with caution given the paucity of evidence and low to very low GRADE scores.

    Introduction

    Cardiovascular disease (CVD) is the leading cause of death worldwide.1 Contrary to popular belief, death and disability from CVD is also a major burden in low-resource settings2 ,3 and despite impressive global reductions in mortality over the last two decades, years-of-life-lost due to CVD is rising in low-income and middle-income countries.4 Prevention is therefore a worldwide priority.

    Global CVD risk assessment (also referred to as absolute risk assessment, total risk assessment or risk scoring) is an integrated approach to prevention that recognises the hazards of multiple risk factors to determine the absolute risk of experiencing a CVD event in a given time period. Almost all CVD guidelines recommend some form of risk scoring as a way to prioritise and plan primary prevention interventions.5–7 This practice is entrenched in most high-income countries,5 ,6 ,8 and endorsed by the WHO for low-income and middle-income countries.7

    Even with an abundance of clinical guidance and effective interventions targeting modifiable risk factors, the majority of patients at risk do not achieve sufficient risk factor control.9–14 In jurisdictions where risk scoring is part of routine clinical practice, this may be due to implementation challenges, such as physician attitudes to and understanding of CVD risk assessment,14–16 challenges communicating risk to patients and patients' understanding of risk17 ,18 or lack of a true effect. Although calibration and discrimination studies of prognostic risk score models are important, trials on the prospective use of risk scores in practice are required to determine their impact on patient outcomes.

    While the development of global cardiovascular risk assessment has been the focus of much research,19–22 there is little certainty about its effectiveness in the prevention of CVD. We conducted a systematic review of systematic reviews to identify, critically appraise and summarise evidence on the impact of global cardiovascular risk assessment in the primary prevention of CVD. We chose to conduct a systematic review of systematic reviews because they can be used to synthesise evidence for a given intervention on a diversity of outcomes, in addition to identifying limitations in the methodology and quality of existing systematic reviews.23

    Methods

    We prospectively registered our protocol on PROSPERO (registration CRD42015019821),24 and deviations from this plan, which were minor, are described in online supplementary S1 appendix 1.

    supplementary S1 appendix 1

    Search strategy

    We searched the Cochrane Library, EMBASE, MEDLINE and CINAHL databases from January 2005 to October 2016 (see online supplementary S2 appendix 2 for detailed search strategies). We searched from 2005 because we felt that more recent systematic reviews were likely to capture the same primary studies as older systematic reviews. No language restrictions were applied. Search strategies used a mix of Medical Subject Heading (MeSH) terms and keywords and were developed with an information specialist. We supplemented this strategy by handsearching the bibliographies of included reviews, forward citation searching on Google Scholar and Web of Science and by contacting experts.

    supplementary S1 appendix 2

    Inclusion criteria

    We included systematic reviews of studies of any design that included adults (18 years of age or older) with no history of CVD (including atrial fibrillation). Reviews were eligible for inclusion if they considered interventions involving global CVD risk assessment relative to no risk assessment, irrespective of who performed the risk assessment, how it was performed and to whom the information was directed. We excluded studies of perioperative CVD risk scores, analogue patients, patients with existing CVD, validation studies and accuracy studies of CVD risk scores.

    The primary outcomes of interest were CVD-related morbidity or mortality and all-cause mortality. We secondarily considered systolic blood pressure (SBP), cholesterol and smoking, because together these cause the majority of premature CVD and have effective interventions to treat them.25 ,26

    Study selection, data extraction and quality assessment

    Study selection, data extraction and quality assessment was done in two phases. We first screened systematic reviews for inclusion, and then screened primary studies reported in the systematic reviews as required.

    Two reviewers screened titles and abstracts for full text review and disagreement was resolved by consensus. We screened full text articles for inclusion using the same method. Two reviewers independently extracted salient characteristics about the included reviews and their description of included studies, including the classification of interventions as either directed toward the patient, provider or the patient and provider. The same reviewers independently assessed methodological quality using the Assessing the Methodological Quality of Systematic Reviews (AMSTAR) checklist.27 We documented the method of quality assessment and extracted the quality of primary studies as reported by the review authors. If a primary study was reported by more than one review, we extracted the quality score from the review with the highest AMSTAR rating.

    We did not initially plan to extract data from primary studies; however, to address poor or insufficient reporting, or to verify intervention classifications, the second phase involved the same two reviewers extracting additional data from the primary studies as needed. We extracted data from primary studies as reported in systematic reviews and tabulated all results by outcome using Microsoft Excel 2010 and Microsoft Word 2010. In the event of a discrepancy, we used the data reported in the primary study rather than the systematic review. When outcomes were reported at multiple time points in a single study, we selected the longest follow-up time with complete data.

    Data synthesis

    We narratively reported systematic reviews and tabulated their salient characteristics, including review, author conclusions and AMSTAR ratings. For our post hoc analysis of primary studies reported by systematic reviews, we used RevMan V.5.3 to construct forest plots and inverse variance-weighted random effects meta-analyses.28 One author entered data into RevMan and these were independently verified by a second author. We only included randomised studies in meta-analyses; other study designs or randomised studies with insufficient data to meta-analyse were reported narratively. For continuous outcomes, we calculated mean differences and for dichotomous outcomes, risk ratios. We performed subgroup analyses by the intended target of the intervention (patient, provider or both). We imputed standard error (SE) when reasonable, using the average SE of studies reporting the same outcome and in the same subgroup, and in such cases a sensitivity analysis was performed. For each outcome meta-analysed, we used the GRADE methodology to rate the quality of evidence using GRADEpro GDT software.29 ,30 This was done by one author and checked by a second; disagreements were resolved by consensus. We used I2 values to estimate statistical heterogeneity.

    Results

    We screened 6877 studies for inclusion, 6727 of which were excluded as irrelevant based on title and abstract (figure 1). Following full-text review of 150 studies, six systematic reviews met the inclusion criteria. We excluded 144 articles, the majority (n=110) due to the study design. The six included systematic reviews together reported 122 unique primary studies, 16 of which were relevant based on our inclusion criteria, including adults with no history of CVD and global CVD risk assessment as an intervention relative to no risk assessment. Of these, none reported CVD-related morbidity or mortality or all-cause mortality, 12 reported SBP, 10 reported cholesterol and 9 reported smoking cessation (figure 1).

    Figure 1
    Figure 1

    Flow diagram of included systematic reviews, primary studies and the outcomes reported.

    Summary of included systematic reviews

    Characteristics of included systematic reviews are summarised in table 1. Reviews were generally broad in scope, published from 2006 to 2015, considered all study designs and collectively searched 11 databases. AMSTAR ratings ranged from 0/11 to 7/11 (mean 4.2/11); we did not exclude any reviews based on quality (see online supplementary S3 appendix 3). The conclusions of reviews were consistently of general uncertainty about the impact of cardiovascular risk assessment on hard patient outcomes.

    View this table:
    Table 1

    Characteristics of included systematic reviews

    supplementary S1 appendix 3

    Brindle et al31 (AMSTAR 4/11) sought to determine the accuracy and impact of CVD risk assessment. To assess impact, they considered randomised controlled trials (RCTs) of healthcare professionals using a CVD risk score to aid in primary prevention, relative to usual care, in populations predominantly free from symptomatic CVD (table 1). Although the authors identified 31 primary studies, the majority of the studies assessed the accuracy of CVD risk assessment and therefore were beyond the scope of our review. The authors concluded that there was little evidence to support the use of risk scores for primary prevention.

    Sheridan and Crespo32 (AMSTAR 4/11) conducted a much more focused review, specifically aimed to assess the benefits and harms of physician knowledge of a global CVD risk score, relative to no formal risk assessment, in adults with no history of CVD. Although the authors only searched MEDLINE, they identified 11 primary studies, most of which were relevant to our review (table 1), and reached similar conclusions as Brindle 2006: ‘surprisingly little evidence that physician knowledge of global CHD risk translates into improved clinical outcomes’.32

    Sheridan et al33 (AMSTAR 7/11) was distinct from Sheridan 2008 in that eligible interventions were targeted at patients rather than physicians. To be eligible, studies (of any design) had to be interventions of global CVD risk information, solely or as part of a complex intervention, directed at adults with no history of CVD to determine the impact of patient-targeted risk information on patient outcomes (table 1). In this review, Sheridan et al searched multiple databases and identified 18 primary studies; most were relevant to our review. They concluded that the effect of risk information on patients may improve proximal outcomes, such as accuracy or risk perception, in those who are high risk but the effect on distal outcomes was not clear.

    Waldron et al34 (AMSTAR 5/11) reviewed studies of any quantitative design that used communication interventions for individualised cardiovascular risk and compared them to a control or usual care and assessed their impact on patient-related outcomes (table 1). Although the authors performed a comprehensive search, only three of the 15 primary studies identified were in actual patients—the rest were of analogue patients and therefore were not relevant to our review. The authors were unable to draw strong conclusions citing the need for better quality trials.

    Van Dieren et al35 (AMSTAR 0/11) conducted a two-part review; the first part sought to identify risk scores that had been developed or validated for people with type two diabetes, and the second part sought to find studies aimed at assessing the impact on patient outcomes when these scores were implemented in practice (table 1). The authors therefore only searched for impact studies on the risk scores that had been identified in the former half of their review. Although the authors identified 45 primary studies, only three studies were identified from the latter half of the review and were relevant to our review. They concluded that ‘the impact of applying these risk scores in clinical practice is almost completely unknown’.35

    Usher-Smith et al36 (AMSTAR 5/11) conducted the most recent and most comprehensive review, although the searches were conducted in 2013. The authors considered randomised or non-randomised studies of interventions consisting of the provision of a CVD risk estimate to patients, or their providers, in patients with no history of CVD (table 1). Searching MEDLINE and PubMED, they identified 17 primary studies, the vast majority of which had previously been reported by one of the aforementioned systematic reviews. However, this review was the first and only review to conduct meta-analyses, which helped draw stronger conclusions about impact. The authors concluded that global risk assessment could improve prescribing and perceived risk, but not smoking, and their meta-analyses showed no significant effect on SBP or pooled total cholesterol and low-density lipoprotein (LDL) cholesterol.

    Effects of interventions

    As the included reviews were of variable, but generally low quality and only one attempted meta-analysis, we conducted a post hoc analysis of the primary studies reported by included systematic reviews that met our inclusion criteria to gain further insight from the reported data. Furthermore, some of the reviews insufficiently described included primary studies. Therefore, in addition to meta-analysis, we tabulated the characteristics of included primary studies, including quality ratings for each study as reported by review authors, which are included in online S4 supplementary appendix 4. The median follow-up of all included primary studies reported by reviews was 12 months, but ranged from 2 to 36 months (see online supplementary S4 appendix 4). Most interventions used Framingham or a Framingham-derived risk score; these interventions and their controls are summarised in detail in online supplementary S4 appendix 4. None of the systematic reviews used GRADE to evaluate the quality of studies, and we therefore included GRADE tables for each outcome and subgroup in online supplementary S5 appendix 5.

    supplementary S1 appendix 4

    supplementary S1 appendix 5

    Primary outcomes

    Mortality

    No reviews included studies reporting CVD-related or all-cause mortality (table 2).

    View this table:
    Table 2

    Meta-analysis of the impact of global cardiovascular risk assessment on cardiovascular disease morbidity, mortality, systolic blood pressure, total cholesterol, low-density lipoprotein cholesterol and smoking cessation

    CVD morbidity

    No reviews included studies reporting CVD-morbidity (table 2).

    Secondary outcomes

    Systolic blood pressure

    Five reviews reported a total of 12 unique primary studies (n=23 346) (see online supplementary S4 appendix 4). Of the 12 primary studies, 3 were cluster RCTs, 8 were RCTs and 1 was an observational follow-up of an RCT. Nine of the controlled trials (n=7537) were reported with sufficient data to meta-analyse, resulting in a mean difference of mean change of SBP of −2.22 mm Hg (95% CI −3.49 to −0.95; I2=66%; GRADE: very low) (figure 2; table 2). Subgroup analyses by studies of interventions targeting the patient (n=3), provider (n=3) or both (n=3), resulted in mean differences of −4.88 mm Hg (95% CI −8.57 to −1.19; I2=0%; GRADE: very low), −1.14 mm Hg (95% CI −2.09 to −0.19; I2=46%; GRADE: low) and −2.77 mm Hg (95% CI −5.91 to 0.37; I2=76%; GRADE: very low), respectively, in the intervention group relative to control (figure 2; table 2). We imputed the SE of Lovibond (1986); excluding this study from the meta-analysis did not significantly change the results of the subgroup analysis or overall estimate: −4.82 mm Hg (95% CI −9.36 to −0.27; I2=0%) and −2.12 mm Hg (95% CI −3.41 to −0.83; I2=68%), respectively.

    Figure 2
    Figure 2

    Forest plot and meta-analysis of the mean difference of mean change in systolic blood pressure (mm Hg) from baseline to follow-up between intervention and control groups.

    Two additional patient-directed studies were identified. The first, an RCT,37 evaluated the impact of health checks which comprised a Framingham-derived risk score and counselling about risk, relative to usual care, in middle-aged adults. The study found a difference in SBP of −2.5 mm Hg (95% CI −3.7 to −1.3) between the intervention and control group after 3 years; however, this was not adjusted to baseline values.33 The second, an observational follow-up of an RCT,38 found no significant difference between patients who received their risk score along with a decision analysis tool, relative to usual care, after 3 years: adjusted difference of SBP between intervention and control at follow-up was 0.94 mm Hg (95% CI −3.2 to 5.1, p value 0.65).

    Finally, one RCT, targeting patients and providers, trained nurses on risk factor measurement and counselling, and provided patients with a CVD risk score and two to six sessions of counselling.39 Compared with usual care after 1 year, unadjusted differences in SBP between intervention and control were −7.3 mm Hg (p value not reported) and −6.2 mm Hg (p value not reported), in men and women, respectively.33

    Cholesterol

    Six reviews reported a total of nine RCTs and one cluster RCT (see online supplementary S4 appendix 4). We considered total cholesterol and LDL cholesterol, and analysed them separately.

    Total cholesterol

    Of the seven trials (n=23 406) reporting total cholesterol, five (n=7813) were reported with sufficient data to meta-analyse, resulting in a mean difference of −0.11 mmol/L (95% CI −0.20, −0.02; I2=72%; GRADE: very low) (figure 3; table 2). Subgroup analyses by studies of interventions targeting the patient (n=2), provider (n=1) or both (n=2), resulted in mean differences of −0.07 mmol/L (95% CI −0.13,−0.02; I2=0%; GRADE: very low), −0.01 mmol/L (95% CI −0.08 to 0.06; GRADE: very low) and −0.26 mmol/L (95% CI −0.38 to −0.15; I2=0%; GRADE: very low) (figure 3; table 2).

    Figure 3
    Figure 3

    Forest plot and meta-analysis of the mean difference of mean change in total cholesterol (mmol/L) from baseline to follow-up between intervention and control group.

    Two additional RCTs were reported, one targeting patients and one targeting patients and providers. The former,37 evaluated the impact of health checks which comprised a Framingham-derived risk score and counselling about risk, relative to usual care, in middle-aged adults. The study found a difference in total cholesterol of −0.18 mmol/L (95% CI −0.26 to −0.12) between the intervention and control group after 3 years; however this was not adjusted to baseline values.33

    The latter,39 targeting patients and providers, trained nurses on risk factor measurement and counselling, and provided patients with a CVD risk score and two to six sessions of counselling.39 Compared with usual care after 1 year, unadjusted differences in total cholesterol between intervention and control were −0.13 mmol/L (p value not reported) and –0.09 mmol/L (p value not reported), in men and women, respectively.33

    LDL cholesterol

    Five trials (n=4940) reported data on LDL cholesterol, four of which (n=4505) when meta-analysed yielded a greater reduction in LDL cholesterol in the intervention group compared with the control group: mean difference of −0.15 mmol/L (95% CI −0.26 to −0.05, I2=47%; GRADE: very low) (figure 4; table 2). Subgroup analyses by studies of interventions targeting the patient (n=3) and the patient and provider (n=1), resulted in mean differences of −0.15 mmol/L (95% CI −0.27 to −0.03; I2=58%; GRADE: very low) and −0.23 mmol/L (95% CI −0.47 to 0.01; GRADE: very low), respectively (figure 4; table 2).

    Figure 4
    Figure 4

    Forest plot and meta-analysis of the mean difference of mean change in LDL cholesterol (mmol/L) from baseline to follow-up between intervention and control group. LDL, low-density lipoprotein.

    One additional RCT targeting patients assessed the impact of mailing personalised CVD risk assessment and encouraging discussion with their primary care physician to usual care.40 The primary outcome was the occurrence of an LDL cholesterol measurement of at least 0.78 mmol/L (30 mg/dL) lower than the baseline measurement during a 9-month follow-up. The trial showed no significant difference between intervention and control, intention-to-treat analysis resulted in an OR of 0.99 (95% CI 0.56 to 1.74, p=0.96).40

    Smoking

    Three reviews reported a total of eight RCTs and one cluster RCT and (n=19 873) (see online supplementary S4 appendix 4). Seven of these trials (n=4131) were reported with sufficient data to meta-analyse, resulting in a risk ratio for quitting smoking of 1.62 (95% CI 1.08 to 2.43; I2=17%; GRADE: low) (figure 5; table 2). Subgroup analyses by studies of interventions targeting the patient (n=4), provider (n=2) or patient and provider (n=1) resulted in risk ratios of 1.53 (95% CI 1.07 to 2.19; I2=0%; GRADE: low), 1.90 (95% CI 0.43 to 8.29; I2=57%; GRADE: very low) and 0.30 (95% CI 0.01 to 7.07; GRADE: moderate), respectively (figure 5; table 2).

    Figure 5
    Figure 5

    Forest plot and meta-analysis of the risk ratio of quitting smoking from baseline to follow-up between intervention and control group.

    Two additional RCTs were reported by included reviews, one targeted patients and one targeted patients and providers. Of the former, one RCT targeting patients assessed the impact of mailing personalised CVD risk assessment and encouraging discussion with their primary care physician to usual care.40 As a secondary outcome, the trial sought to record the number of smokers who quit after nine months, but failed to provide the actual data stating, ‘non-smoking (among smokers) was rare and did not vary by group’.40

    The other, an RCT targeting patients and providers, trained nurses on risk factor measurement and counselling, and provided patients with a CVD risk score and two to six sessions of counselling.39 Compared with usual care after one year, unadjusted differences in smoking prevalence between intervention and control were −4.1% (p value not reported) and −2.9% (p value not reported), in men and women, respectively.33

    Discussion

    To the best of our knowledge, this is the first systematic review of systematic reviews on the impact of global cardiovascular risk assessment in the primary prevention of CVD. Reviews on this topic vary in the databases searched, search strategies used and the specific populations and interventions of interest, and their quality was generally poor (mean AMSTAR 4.2/11, range 0/11 to 7/11). However, they have consistently reported uncertainty about the effectiveness of global CVD risk assessment. Our results show that to date, no reviews or their included primary studies have reported CVD-related morbidity or mortality or all-cause mortality. Post hoc analysis of data reported by included reviews illustrated very low-quality evidence for small reductions in SBP, total cholesterol, LDL cholesterol and low-quality evidence for small increases in smoking cessation.

    We conducted a post hoc analysis of data reported by included systematic reviews to compensate for the poor evidence synthesis of some of the included reviews and to reduce research waste. Several of the included reviews highlighted a need for better quality trials on this topic, and our quality appraisal using GRADE corroborates these conclusions. Our post hoc analysis illustrated that all effect estimates were of low GRADE or very low GRADE quality. Our meta-analyses of data reported by systematic reviews, although not the primary aim of our systematic review, advances our knowledge on the impact of total cardiovascular risk assessment beyond what was reported by individual systematic reviews. Given the disparate and poor quality of data reporting and quality appraisal of the included systematic reviews, we felt it was responsible to perform better quality evidence synthesis and quality appraisal.

    Our meta-analysis of SBP added five additional RCTs compared with the previously reported meta-analysis36 and revealed for the first time a statistically significant small reduction in SBP. We also report for the first time statistically significant, but small, reductions in total cholesterol, LDL cholesterol and smoking. These results might be explained by improvements in the prescription of cholesterol-lowering and blood pressure-lowering treatment,36 and increasing accuracy of patient risk perception.33 ,36

    Reductions in SBP, LDL cholesterol and smoking tended to be greatest when cardiovascular risk information was directed at patients. The delineation between patient-directed and provider-directed interventions is not well resolved, since patients may discuss risk information with their provider and vice versa. This phenomenon may contaminate the subgroup analysis. A previous review33 concluded that greater effects were seen in patients with increased baseline CVD risk; adjusting for baseline CVD risk in our analyses did not explain the observed trend toward patient-directed interventions.

    Observed reductions in blood pressure, cholesterol and smoking could lead to reductions in overall risk and eventual reduction in CVD events. For this to be true, such changes must be sustained long term to have a meaningful impact on event rates in individual patients. However, the median follow-up of all eligible studies reported by included systematic reviews was only 12 months. Therefore, we can have little confidence from the systematic review literature in the prospective use of CVD risk scores translating into long-term clinical benefits.

    There seems to be a widespread acceptance, including among several guidelines, of total cardiovascular risk assessment despite no systematic review evidence for its effectiveness on long-term patient outcomes: neither the National Institute of Health and Care Excellence (NICE)8 or WHO41 currently acknowledge this evidence gap. However, the 2013 American College of Cardiology (ACC)/American Heart Association (AHA) Guideline on the Assessment of Cardiovascular risk acknowledges that ‘none of the risk assessment tools…have been formally evaluated in randomised controlled trials… with clinical events as outcomes’.42 NICE does go so far as to make recommendations for research, but overlooks the need to evaluate the global CVD risk approach.43 Further, global cardiovascular risk assessment is included in the Quality and Outcomes Framework in the UK as an incentive for general practitioners to be compliant with guidance for primary prevention.44

    There is evidence, from studies retrospectively risk scoring patients, that the absolute reduction in CVD events from cholesterol-lowering and blood pressure-lowering treatment is associated with baseline CVD risk.45 ,46 It is important to distinguish, however, that these data do not illustrate that the prospective use of global CVD risk assessment improves patient outcomes, but suggest that targeting high-risk patients is an efficient way to allocate resources to reduce CVD events. Nor do studies of calibration and discrimination imply effectiveness.

    We speculate the paucity of data may partly be explained by the assumption that accuracy of risk scores is a proxy for effectiveness, therefore undermining rationale for further study. While mechanical prediction, such as the use of global cardiovascular risk assessment, is generally a superior method of data combination than clinical judgement;47 it is unknown whether this holds true for cardiovascular risk. Moreover, clinicians still rely on clinical judgement to integrate risk scores within the broader context of the patient—especially for risk factors that are not included in the risk assessment algorithm—therefore risk stratification is not strictly a practice that can be replaced with mechanical prediction. The uncertainty around the clinical utility of this practice has been highlighted by UK general practitioners, who expressed that broad implementation created considerable confusion, and emphasised the need for simplification and for guidance to be updated to reflect how risk scores are actually used.15

    Strengths and limitations

    Our systematic review of systematic reviews was strengthened by its broad inclusion criteria, which reduced the chance we missed relevant literature and allowed us to include reviews whose primary objective may not have been assessing the impact of risk assessment. This method provides quality appraised systematic reviews and their primary studies and therefore can help inform policy and practice, in addition to providing new insight from rigorous data synthesis from a breadth of sources. It also highlights trends in the systematic review literature. While there was heterogeneity in the risk scores used, the exact nature of the interventions, comparisons, follow-up time and patient demographics, we feel that such heterogeneity approximates the reality of clinical practice. The results therefore provide a good approximation of impact.

    While we believe we have taken steps to ensure an exhaustive search, it is possible some systematic reviews were missed. Our post hoc analysis of primary studies reported by included systematic review should be interpreted with caution. Its purpose is to better appraise and synthesise the primary studies which are already available in the systematic review literature, and therefore it does not represent the conclusions from a systematic review of individual primary studies, and it is possible that further primary studies exist. Given that these data were not appraised and synthesised to a high standard in the included systematic reviews, we felt it necessary to do so. There are likely further primary studies that can add to our meta-analysis, and high-quality systematic reviews should be conducted and these analyses should be updated. We were unable to perform sensitivity analyses due to a paucity of data. We did not contact authors of primary studies, which may have allowed us to adjust unadjusted study results which we were forced to report narratively. However, as these studies were reported in systematic reviews, some of which contacted study authors, we believe the likelihood of further data becoming available to be minimal, and the findings of these studies did not contradict our overall findings of the meta-analyses. In addition, we did not assess publication bias and reporting bias, not least because of the paucity of evidence, which may lead to overestimations of the effective sizes. We imputed the SE of one study,48 which may underestimate heterogeneity; however sensitivity analysis revealed only a 2% absolute increase in I2 for the overall effect estimate when this study was excluded. The current evidence base is limited in that all patients were from high-income countries, many were hypertensive and most interventions used a Framingham-derived risk score.

    Implications for research and practice

    The findings of our post hoc meta-analyses should be interpreted for practice with caution given the paucity of evidence and its low quality. Policymakers worldwide should take care when implementing global cardiovascular risk approaches, especially in an era where prevention efforts are expanding worldwide, as there was no systematic review evidence to suggest that the prospective use of global cardiovascular risk assessment in clinical practice reduces CVD events. Although the most recent systematic review was published in 2015, its literature search was conducted in 2013. Researchers should therefore update and improve the quality of systematic reviews and focus on CVD-related morbidity and mortality and other hard patient outcomes. In some jurisdictions, such as many low-income and middle-income countries, high-quality primary studies may be needed and these should be done before the widespread implementation of CVD risk scoring or, if not possible, in concert.

    Conclusion

    There is currently no evidence from systematic reviews that the prospective use of global cardiovascular risk assessment translates to reductions in CVD events. Systematic reviews, which were generally of poor quality, have consistently reported uncertainty about the impact of this practice on meaningful patient outcomes. These reviews found no studies reporting CVD-related morbidity or mortality, and the reductions in SBP, cholesterol and smoking may not be clinically significant given their small effect size and short duration. Despite the widespread popularity of global cardiovascular risk assessment, resources need to be directed in the first instance to conduct high-quality systematic reviews, and further RCTs powered to measure CVD-related morbidity and mortality may be needed.

    References

    1. ↵
      World Health Organization. Cardiovascular diseases (CVDs). 2015. http://www.who.int/mediacentre/factsheets/fs317/en/ (accessed 4 Aug 2015).
    2. ↵
      WHO. Noncommunicable diseases, fact sheet. 2015. http://www.who.int/mediacentre/factsheets/fs355/en/
    3. ↵
      1. Mathers CD,
      2. Loncar D
      . Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006;3:e442. doi:10.1371/journal.pmed.0030442
      OpenUrlCrossRefPubMed
    4. ↵
      1. Roth GA,
      2. Huffman MD,
      3. Moran AE, et al
      . Global and regional patterns in cardiovascular mortality from 1990 to 2013. Circulation 2015;132:1667–78. doi:10.1161/CIRCULATIONAHA.114.008720
      OpenUrlAbstract/FREE Full Text
    5. ↵
      1. Pearson TA,
      2. Blair SN,
      3. Daniels SR, et al
      . AHA guidelines for primary prevention of cardiovascular disease and stroke: 2002 update: consensus panel guide to comprehensive risk reduction for adult patients without coronary or other atherosclerotic vascular diseases. American Heart Association Science Advisory and Coordinating Committee. Circulation 2002;106:388–91. doi:10.1161/01.CIR.0000020190.45892.75
      OpenUrlFREE Full Text
    6. ↵
      National Institute for Health and Care Excellence. Lipid modification: cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease. 2015. https://www.nice.org.uk/guidance/cg181/resources/guidance-lipid-modification-cardiovascular-risk-assessment-and-the-modification-of-blood-lipids-for-the-primary-and-secondary-prevention-of-cardiovascular-disease-pdf
    7. ↵
      WHO. Package of essential noncommunicable (PEN) disease interventions for primary health care in low-resource settings. Geneva, Switzerland. 2010. http://apps.who.int/iris/handle/10665/44260 (accessed 27 Oct 2014).
    8. ↵
      NICE. Cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease: methods, evidence, and recommendations. Published online first. 2014. http://www.nice.org.uk/guidance/cg181/evidence/lipid-modification-update-full-guideline-243786637
    9. ↵
      1. Tang L,
      2. Patao C,
      3. Chuang J, et al
      . Cardiovascular risk factor control and adherence to recommended lifestyle and medical therapies in persons with coronary heart disease (from the National Health and Nutrition Examination Survey 2007–2010). Am J Cardiol 2013;112:1126–32. doi:10.1016/j.amjcard.2013.05.064
      OpenUrlCrossRefPubMed
    10. ↵
      1. McFarlane SI,
      2. Jacober SJ,
      3. Winer N, et al
      . Control of cardiovascular risk factors in patients with diabetes and hypertension at urban academic medical centers. Diabetes Care 2002;25:718–23. doi:10.2337/diacare.25.4.718
      OpenUrlAbstract/FREE Full Text
    11. ↵
      1. Pearson TA,
      2. Laurora I,
      3. Chu H, et al
      . The lipid treatment assessment project (L-TAP): a multicenter survey to evaluate the percentages of dyslipidemic patients receiving lipid-lowering therapy and achieving low-density lipoprotein cholesterol goals. Arch Intern Med 2000;160:459–67. doi:10.1001/archinte.160.4.459
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      1. Wolf-Maier K,
      2. Cooper RS,
      3. Kramer H, et al
      . Hypertension treatment and control in five European countries, Canada, and the United States. Hypertension 2004;43:10–17. doi:10.1161/01.HYP.0000103630.72812.10
      OpenUrlCrossRef
    13. ↵
      1. Hajjar I,
      2. Kotchen TA
      . Trends in prevalence, awareness, treatment, and control of hypertension in the United States, 1988–2000. JAMA 2003;290:199–206. doi:10.1001/jama.290.2.199
      OpenUrlCrossRefPubMedWeb of Science
    14. ↵
      1. Camisasca P,
      2. Avanzini F,
      3. Alli C, et al
      . Overall cardiovascular risk still ignored in general practice care of hypertension. J Cardiovasc Risk 2002;9:147–52. doi:10.1097/00043798-200206000-00003
      OpenUrlCrossRefPubMedWeb of Science
    15. ↵
      1. Liew SM,
      2. Blacklock C,
      3. Hislop J, et al
      . Cardiovascular risk scores: qualitative study of how primary care practitioners understand and use them. Br J Gen Pract 2013;63:e401–7. doi:10.3399/bjgp13X668195
      OpenUrlAbstract/FREE Full Text
    16. ↵
      1. Williams CL,
      2. Bollella M,
      3. Wynder E
      . Preventive cardiology in primary care. Atherosclerosis 1994;108(Suppl):S117–26. doi:10.1016/0021-9150(94)90157-0
      OpenUrlPubMed
    17. ↵
      1. Goldman RE,
      2. Parker DR,
      3. Eaton CB, et al
      . Patients’ perceptions of cholesterol, cardiovascular disease risk, and risk communication strategies. Ann Fam Med 2006;4:205–12. doi:10.1370/afm.534
      OpenUrlAbstract/FREE Full Text
    18. ↵
      1. van Steenkiste B,
      2. van der Weijden T,
      3. Timmermans D, et al
      . Patients’ ideas, fears and expectations of their coronary risk: barriers for primary prevention. Patient Educ Couns 2004;55:301–7. doi:10.1016/j.pec.2003.11.005
      OpenUrlCrossRefPubMedWeb of Science
    19. ↵
      1. Conroy RM,
      2. Pyörälä K,
      3. Fitzgerald AP, et al
      . Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J 2003;24:987–1003. doi:10.1016/S0195-668X(03)00114-3
      OpenUrlAbstract/FREE Full Text
    20. ↵
      1. D'Agostino RBS,
      2. Grundy S,
      3. Sullivan LM, et al
      . Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA 2001;286:180–7. doi:10.1001/jama.286.2.180
      OpenUrlCrossRefPubMedWeb of Science
    21. ↵
      1. Hippisley-Cox J,
      2. Coupland C,
      3. Vinogradova Y, et al
      . Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ 2007;335:136. doi:10.1136/bmj.39261.471806.55
      OpenUrlAbstract/FREE Full Text
    22. ↵
      1. Thomsen TF,
      2. McGee D,
      3. Davidsen M, et al
      . A cross-validation of risk-scores for coronary heart disease mortality based on data from the Glostrup Population Studies and Framingham Heart Study. Int J Epidemiol 2002;31:817–22. doi:10.1093/ije/31.4.817
      OpenUrlAbstract/FREE Full Text
    23. ↵
      1. Higgins JPT,
      2. Green S
      , eds. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrance Collaboration, 2011. www.cochrane-handbook.org
    24. ↵
      1. Collins D,
      2. Tompson A,
      3. Roberts N, et al
      . Global cardiovascular risk assessment in the primary prevention of cardiovascular diseases in adults: an overview of systematic reviews. PROSPERO Int. Prospect. Regist. Syst. Rev. 2015. http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015019821 (accessed 4 Aug 2015).
    25. ↵
      1. Emberson JR,
      2. Whincup PH,
      3. Morris RW, et al
      . Re-assessing the contribution of serum total cholesterol, blood pressure and cigarette smoking to the aetiology of coronary heart disease: impact of regression dilution bias. Eur Heart J 2003;24:1719–26. doi:10.1016/S0195-668X(03)00471-8
      OpenUrlAbstract/FREE Full Text
    26. ↵
      1. Cooper A,
      2. Nherera L,
      3. Calvert N, et al
      . Clinical guidelines and evidence review for lipid modification: cardiovascular risk assessment and the primary and secondary prevention of cardiovascular disease. London: National Collaborating Centre for Primary Care and Royal College of General Practitioners 2008;1–241.
    27. ↵
      1. Shea BJ,
      2. Grimshaw JM,
      3. Wells GA, et al
      . Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007;7:10. doi:10.1186/1471-2288-7-10
      OpenUrlCrossRefPubMed
    28. ↵
      Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
    29. ↵
      1. Guyatt GH,
      2. Oxman AD,
      3. Vist GE, et al
      . GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. doi:10.1136/bmj.39489.470347.AD
      OpenUrlFREE Full Text
    30. ↵
      GRADEpro GDT. GRADEpro Guideline Development Tool. 2015. http://www.gradepro.org.
    31. ↵
      1. Brindle P,
      2. Beswick A,
      3. Fahey T, et al
      . Accuracy and impact of risk assessment in the primary prevention of cardiovascular disease: a systematic review. Heart 2006;92:1752–9. doi:10.1136/hrt.2006.087932
      OpenUrlAbstract/FREE Full Text
    32. ↵
      1. Sheridan SL,
      2. Crespo E
      . Does the routine use of global coronary heart disease risk scores translate into clinical benefits or harms? A systematic review of the literature. BMC Health Serv Res 2008;8:60. doi:10.1186/1472-6963-8-60
      OpenUrlCrossRefPubMed
    33. ↵
      1. Sheridan SL,
      2. Viera AJ,
      3. Krantz MJ, et al
      . The effect of giving global coronary risk information to adults. Arch Intern Med 2010;170:230–9. doi:10.1001/archinternmed.2009.516
      OpenUrlCrossRefPubMedWeb of Science
    34. ↵
      1. Waldron C-A,
      2. van der Weijden T,
      3. Ludt S, et al
      . What are effective strategies to communicate cardiovascular risk information to patients? A systematic review. Patient Educ Couns 2011;82: 169–81. doi:10.1016/j.pec.2010.04.014
      OpenUrlCrossRefPubMed
    35. ↵
      1. van Dieren S,
      2. Beulens JWJ,
      3. Kengne AP, et al
      . Prediction models for the risk of cardiovascular disease in patients with type 2 diabetes: a systematic review. Heart 2012;98:360–9. doi:10.1136/heartjnl-2011-300734
      OpenUrlAbstract/FREE Full Text
    36. ↵
      1. Usher-Smith JA,
      2. Silarova B,
      3. Schuit E, et al
      . Impact of provision of cardiovascular disease risk estimates to healthcare professionals and patients: a systematic review. BMJ Open 2015;5:e008717. doi:10.1136/bmjopen-2015-008717
      OpenUrlAbstract/FREE Full Text
    37. ↵
      Effectiveness of health checks conducted by nurses in primary care: final results of the OXCHECK study. Imperial Cancer Research Fund OXCHECK Study Group. BMJ 1995;310:1099–104. doi:10.1136/bmj.310.6987.1099
      OpenUrlAbstract/FREE Full Text
    38. ↵
      1. Emmett CL,
      2. Montgomery AA,
      3. Peters TJ, et al
      . Three-year follow-up of a factorial randomised controlled trial of two decision aids for newly diagnosed hypertensive patients. Br J Gen Pract 2005;55:551–3.
      OpenUrlAbstract/FREE Full Text
    39. ↵
      Randomised controlled trial evaluating cardiovascular screening and intervention in general practice: principal results of British family heart study. Family Heart Study Group. BMJ 1994;308:313–20. doi:10.1136/bmj.308.6924.313
      OpenUrlAbstract/FREE Full Text
    40. ↵
      1. Persell SD,
      2. Lloyd-Jones DM,
      3. Friesema EM, et al
      . Electronic health record-based patient identification and individualized mailed outreach for primary cardiovascular disease prevention: a cluster randomized trial. J Gen Intern Med 2013;28:554–60. doi:10.1007/s11606-012-2268-1
      OpenUrlCrossRefPubMed
    41. ↵
      WHO. Prevention of cardiovascular disease: guidelines for the assessment and managment of cardiovascular risk. 2007. http://www.who.int/cardiovascular_diseases/guidelines/Fulltext.pdf
    42. ↵
      1. Goff DCJ,
      2. Lloyd-Jones DM,
      3. Bennett G, et al
      . 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014;129:S49–73. doi:10.1161/01.cir.0000437741.48606.98
      OpenUrlFREE Full Text
    43. ↵
      NICE. Cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease: appendices. Published online first. 2014. http://www.nice.org.uk/guidance/cg181/evidence/lipid-modification-update-appendices-243786638
    44. ↵
      NHS Employers. 2015/16 General Medical Services (GMS) contract Quality and Outcomes Framework (QOF). 2015. http://www.nhsemployers.org/~/media/Employers/Documents/Primary care contracts/QOF/2015—16/2015 16 QOF guidance for stakeholders.pdf
    45. ↵
      1. Sundstrom J,
      2. Arima H,
      3. Woodward M, et al
      . Blood pressure-lowering treatment based on cardiovascular risk: a meta-analysis of individual patient data. Lancet (London, England) 2014;384:591–8. doi:10.1016/S0140-6736(14)61212-5
      OpenUrl
    46. ↵
      1. Mihaylova B,
      2. Emberson J,
      3. Blackwell L, et al
      . The effects of lowering LDL cholesterol with statin therapy in people at low risk of vascular disease: meta-analysis of individual data from 27 randomised trials. Lancet 2012;380:581–90. doi:10.1016/S0140-6736(12)60367-5
      OpenUrlCrossRefPubMedWeb of Science
    47. ↵
      1. Grove WM,
      2. Zald DH,
      3. Lebow BS, et al
      . Clinical versus mechanical prediction: a meta-analysis. Psychol Assess 2000;12:19–30. doi:10.1037/1040-3590.12.1.19
      OpenUrlCrossRefPubMedWeb of Science
    48. ↵
      1. Lovibond SH,
      2. Birrell PC,
      3. Langeluddecke P
      . Changing coronary heart disease risk-factor status: the effects of three behavioral programs. J Behav Med 1986;9:415–37. doi:10.1007/BF00845131
      OpenUrlCrossRefPubMedWeb of Science
    View Abstract

    Footnotes

    • ▸ Additional material is available. To view please visit the journal online (http://dx.doi.org/10.1136/bmjopen-2016-013650).

    • Contributors DRJC conceived of the study, screened articles, extracted data, analysed the data and wrote the manuscript. ACT screened articles, extracted data, contributed to analysis and manuscript writing. IJO contributed to GRADE appraisal, analysis and manuscript writing. NR reviewed and contributed to the database search strategies. AMW contributed to the analysis and manuscript writing. CJH contributed to the methodological approach, the analysis and manuscript writing.

    • Funding This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests None declared.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data sharing statement No additional data are available.