Skip to main content
Download PDF

A 10- and 15-year performance analysis of ESC/EAS and ACC/AHA cardiovascular risk scores in a Southern European cohort

BMC Cardiovascular Disorders volume 20, Article number: 301 (2020) Cite this article

Abstract

Background

A key strategy for the primary prevention of cardiovascular disease (CVD) is the use of risk prediction algorithms. We aimed to investigate the predictive ability of SCORE (Systematic COronary Risk Estimation) and PCE (Pooled Cohort Equations) systems for atherosclerotic CVD (ASCVD) risk in Portugal, a low CVD risk country, at the 10-year landmark and at a longer, 15-year follow-up.

Methods

The SCORE and PCE 10-year risk estimates were calculated for 455 and 448 patients, respectively. Discrimination was assessed by Harrell’s C-statistic. Calibration was analyzed by standardized incidence ratios (SIR).

Results

During the 10-year follow-up, 7 fatal ASCVD events (the SCORE outcome) and 32 any ASCVD events (the PCE outcome) occurred. The SCORE system showed good discrimination (C-statistic 0.83), while the PCE showed poor discrimination (C-statistic 0.62). Calibration was similar for both systems, according to SIR: SCORE, 0.3 (95% CI 0.1–0.7); PCE, 0.5 (95% CI 0.4–0.7). Globally, both 10-year fatal ASCVD risk and any ASCVD risk were overestimated in the overall population and men. However, the risk was underestimated by both systems in women. Despite an overestimation of 15-year fatal ASCVD by SCORE, the 15-year any ASCVD observed incidence was 1.8 times the 10-year incidence among men and 1.4 times among women. This acceleration of CVD risk was more relevant in the lowest classes of ASCVD risk.

Conclusion

In this prospective, contemporary, Portuguese cohort, the SCORE had better discriminatory power and similar calibration compared to PCE. However, both risk scores underestimated 10-year ASCVD risk in women.

Peer Review reports

Background

Cardiovascular disease (CVD) remains the leading cause of morbidity and mortality in developed countries, despite consistent improvement in outcomes [1]. Modifiable risk factors are the major causes of atherosclerotic CVD (ASCVD), accounting for 90% of cardiovascular risk [2, 3]. A key strategy in the primary prevention of ASCVD is the use of risk prediction algorithms, as the prophylactic interventions should target the people who should benefit from them most [1, 4]. However, it is debatable which is the best algorithm for ASCVD risk estimation.

In 2003, the European Society of Cardiology (ESC) jointly with the European Atherosclerosis Society (EAS) published the SCORE (Systematic COronary Risk Estimation): a 10-year risk estimation system for ACSVD death [5]. The SCORE Project pooled data from 12 European prospective cohort studies from eleven countries, including Southern European countries such as Spain and Italy, but not Portugal [5]. External validation has been performed for the SCORE model in several Western countries and in the Asian population [6,7,8,9,10]. However, calibration of the risk charts according to cardiovascular mortality levels of each country has been proposed for a more precise prediction of risk estimates [5]. This is of utmost importance in countries not represented in the derivation cohorts, as Portugal.

In parallel, the American College of Cardiology (ACC) and American Heart Association (AHA) developed the Pooled Cohort Equations (PCE) that estimate a composite endpoint of 10-year ASCVD risk, instead of the SCORE-estimated 10-year fatal ASCVD risk [11]. However, these equations were all derived from North American cohorts [11], which limit their applicability to other populations. Further, the PCE have been controversial because of reports that they substantially overestimate risk in both American and European populations [12,13,14,15,16].

Besides the different prediction models available to estimate the ASCVD risk, the decision thresholds recommended for drug therapy are different for, respectively, fatal ASCVD (SCORE) and any ASCVD (PCE) [17]. Such conflicting recommendations may create confusion among physicians, potentially reflecting uncertainty about the external validity of different algorithms under different settings [18], namely for low-risk countries, like those in Southern Europe [19, 20]. In Portugal, a country with one of the lowest ASCVD event rates in Europe [20], neither risk systems have been validated and doubts concerning their clinical applicability and predictive accuracy in this particular population are raised.

In this study, we aimed to determine the 10- and 15-year incidence of ASCVD events in a primary prevention cohort of a Southern European country. In addition, we aimed to compare the calibration and discrimination of both SCORE and PCE systems in this cohort at the predefined 10-year landmark and at a longer, 15-year follow-up, in order to estimate their external validity for clinical practice.

Methods

Study design and population

We conducted a prospective single-center study, including 663 patients consecutively referred by Primary Care physicians to Centro Hospitalar e Universitário de Coimbra’s Lipidology Clinic from 1994 to 2007. All patients were followed until December 2017. Among recruited participants, we selected those aged 40–79 years and with no previous history of heart disease and stroke at the screening visit. Patients with familial hypercholesterolemia or with missing information at the baseline examination were excluded, resulting in 455 individuals available for this study.

Assessment of risk factors

Baseline, demographic and clinical variables were collected, including age at referral, sex, hypertension, diabetes and smoking status. Hypertension was defined as systolic blood pressure ≥ 140 mmHg and/or diastolic blood pressure ≥ 90 mmHg, or current antihypertensive treatment. Diabetes was defined as fasting glucose ≥126 mg.dL− 1 or the use of hypoglycemic drugs. Smoking status was dichotomized as current versus past/never smokers. On the first appointment, several baseline laboratory variables and a complete lipid profile on fasting blood samples were collected.

Risk classification definitions

The predictors used to estimate risk for a first fatal or any ASCVD event included age, sex, smoking status, total cholesterol (TC), high-density lipoprotein cholesterol (HDL-C), systolic blood pressure, diabetes, and antihypertensive treatment. SCORE and PCE systems vary in the age ranges to which they apply. SCORE is recommended for use in the 40- to 65- year age range [1]. In contrast, the age range in which PCE is validated is 40–79 years [11]. Thus, we compared the performance of both risk systems in individuals aged 40–79 years. Baseline SCORE (using the model for low-risk countries) [5] and PCE [11] predicted risks were calculated for each patient. To comply with real-life clinical use of the SCORE, the absolute fatal ASCVD risk for those aged 66–79 years was corresponding to the risk at age 65 [21]. The cohort was stratified in four groups based on the SCORE risk categories: low (SCORE < 1%), moderate (SCORE 1–5%), high (SCORE 5–10% or diabetes without organ damage or major CVD risk factor), and very high (SCORE > 10% or diabetes with organ damage or major CVD risk factor) [1]. Major CVD risk factors were defined by markedly elevated single risk factor, namely TC > 310 mg.dL− 1 and blood pressure ≥ 180/110 mmHg [1]. Regarding the PCE risk, the cohort was also stratified in four risk categories: low (ASCVD risk < 5%), borderline (ASCVD risk 5–7.5%), intermediate (ASCVD risk 7.5–20%), and high (ASCVD risk > 20%) [4].

Outcome variables

In SCORE, the predicted outcome is fatal ASCVD, comprising the occurrence of death from coronary artery disease, stroke, hypertension, heart failure, peripheral artery disease or aortic disease [5]. The endpoint defined by PCE is a first ASCVD event, including nonfatal myocardial infarction, ASCVD death, and stroke [11]. The events among the study cohort were identified through record linkage with the national health registry and Health Data Platform. We ascertained nonfatal myocardial infarction or stroke events, defined according to the Cardiovascular and Stroke Endpoint Definitions for Clinical Trials [22]. Cases of fatal ASCVD [22] were ascertained from the cause of death listed on death certificates.

Statistical analysis

A total of 455 patients had complete information on the components of SCORE and 448 had complete information on the components of PCE. The median (interquartile range (IQR)) follow-up time was 15 (11–17) years. All patients were followed up for at least 10 years and 55.4% (n = 252) were followed for 15 years regarding fatal ASCVD and 48.9% (n = 219) regarding any ASCVD.

Continuous variables were expressed as mean ± standard deviation (SD). Median and IQR were used if the distribution was not normal, assessed by the use of the Kolmogorov-Smirnov test. The Student’s t-test for normal variables and the Mann-Whitney test for non-normal variables were used for comparisons among groups (male vs female). Categorical variables were presented as percentages and were compared using chi-square or Fisher’s exact test.

The predictive ability of the SCORE and PCE systems for the Southern European population was evaluated based on discrimination and calibration of the models. The discriminative power was compared with Harrell’s C-statistics, which takes into account the timing of events. A calibration analysis was conducted by using standardized incidence ratios (SIR), comparing the 10-year predicted event rate to the observed rate at 10-year follow-up. As all patients completed the 10-year follow-up, 10-year observed event rate was the actual rate. Regarding the calibration analysis at the 15-year follow-up, the Kaplan–Meier method was utilized to estimate the 15-year observed risk for each group. Both rates were plotted against the predicted risk, estimated as mean 10-year risk score in each group [23]. Participants were censored at the time of the first occurrence of ASCVD, death, time of the last follow-up, or at 15 years of follow-up.

Concerning head-to-head comparison, an intersection of the two risk systems specific subgroups was created (n = 448). The discrimination was evaluated by Harrell’s C-statistic for each risk system-specific outcome. The pairwise differences among the C-statistics corresponding to the risk systems were calculated, and, to compensate for multiple testing, bootstrapping was used to obtain 99% confidence intervals (CI) [23].

All tests were conducted using STATA 13.0 (StataCorp, Texas, USA).

Results

The mean age ± SD of the study sample of 455 individuals was 57.8 ± 9.6 years and 61.8% were male. The overall baseline characteristics were similar between genders, except that women had significantly higher levels of low-density lipoprotein cholesterol (LDL-C) and a larger proportion of statin therapy (Table 1).

Table 1 Baseline characteristics and observed events in a Portuguese cohort aged 40–79 years in primary prevention
Full size table

The average 10-year risk estimates by each of the risk systems were as follows: the mean risk for ASCVD mortality was 4.7% (5.6% in men and 3.1% in women) according to SCORE and the mean ASCVD risk was 13.5% (16.2% in men and 9.0% in women) according to PCE, globally indicating a population with moderate ASCVD risk (Table 1).

Discrimination

We assessed the ability of SCORE and PCE to discriminate between patients who developed events defined by SCORE (fatal ASCVD) and PCE (any ASCVD) and those who did not, after calculating the 10-year risk for each patient. During the 10-year follow-up, 7 (1.6%) SCORE-specific events and 32 (7.0%) PCE-specific events occurred (Table 1). The C-statistic corresponding to the model with risk score as the only covariate were 0.83 and 0.62 for the SCORE-specific and PCE-specific outcomes, respectively (Table 2).

Table 2 Harrell’s C-statistic SCORE and PCE in predicting fatal ASCVD events and any ASCVD events in a Portuguese cohort aged 40–79 years in primary prevention, respectively
Full size table

Regarding the 15-year follow-up, 5 (1.9%) ASCVD deaths and 25 (11.3%) any ASCVD events were observed. The C-statistic were 0.80 for the SCORE-specific outcomes and 0.63 for PCE-specific outcomes (Table 2).

In the head-to-head comparison, while the SCORE displayed the highest C-statistics for fatal ASCVD, the values were similar considering any ASCVD as the outcome (Fig. 1). No statistically significant differences were observed between the predictive ability of the two risk systems (Table 3).

Fig. 1
figure 1

ROC curves of the SCORE and PCE models for prediction of 10-year events in a Portuguese cohort aged 40–79 years in primary prevention. a Fatal ASCVD events and b any ASCVD events. The predictive ability of the risk scores was assessed by Harrell’s C-statistic for risk system-specific outcomes. ASCVD: atherosclerotic cardiovascular disease, SCORE: Systematic COronary Risk Evaluation, PCE: pooled cohort equations

Full size image
Table 3 Head to head comparison of the risk scores according to Harrell’s C-statistic in a Portuguese cohort aged 40–79 years in primary prevention (n = 448)
Full size table

Calibration

Score

While 7 fatal events occurred during the 10-year follow-up period, SCORE predicted 21.4 events, which means there were 66% more expected events than observed (Fig. 2).

Fig. 2
figure 2

Calibration accuracy evaluated by comparing observed and predicted events and standardised incidence ratios in a Portuguese cohort aged 40–79 years in primary prevention. A calibration analysis was conducted by using SIR, comparing the 10-year predicted event rate to the observed rate at 10- and 15-year follow-up. As all patients completed the 10-year follow-up, 10-year observed event rate was the actual rate. 15-year observed events were Kaplan–Meier adjusted. SIR, standardised incidence ratios, SCORE: Systematic COronary Risk Evaluation; PCE: pooled cohort equations

Full size image

Discordance between observed and expected cases was found throughout the risk continuum, with a predominance of overestimation in the overall population and men by all of the risk strata at 10-year and 15-year follow-up. Importantly, SCORE underestimated risk in women, particularly in those at high risk (5 to 10%) (Fig. 2).

PCE

Globally, the PCE predicted 47% more any ASCVD events (Fig. 2). Actually, the PCE overestimated 10-year risk when the predicted risk was 5% or higher. Both in the overall population and men, when the predicted risk was low (< 5%), the risk was slightly underestimated. Regarding women, PCE underestimated risk in low (< 5%) and intermediate (7.5–20%) risk strata. In the 219 individuals with 15 years of follow-up, an acceleration of the risk was observed, surpassing the 10-year predicted risk in low (< 5%) and borderline (5–7.5%) risk strata in men and low (< 5%) and intermediate (7.5–20%) risk strata in women (Fig. 2).

Discussion

In our cohort of Portuguese patients, the evaluation of PCE and SCORE risk prediction algorithms revealed that both performed at an acceptable level. The SCORE system performed better than the PCE system in discriminating their respective endpoints. Although calibration was similar, both risk systems markedly overestimated the risk.

While both risk systems address the same practical question, which individuals benefit from interventive measures, its equations differ significantly. The SCORE includes as predictors age, sex, smoking, systolic blood pressure, and TC; it is traditionally applicable in individuals from 40 to 65 years, and the predicted outcome is 10-year fatal ASCVD, disregarding non-fatal events [5]. Besides the predictors included in SCORE, PCE also incorporates ethnicity, HDL-C, antihypertensive use, and diabetes. Furthermore, PCE has a larger age range (40–79 years) and predicts the 10-year risk of fatal and non-fatal ASCVD [11].

Existing studies regarding the SCORE risk prediction system generally reported good discrimination, consistent with our findings [5, 8, 9, 24]. Considering the SCORE system, our study reported a favorable C-statistic of 0.83. The discrimination performance of the SCORE risk to predict 10-year ASCVD mortality was evaluated in the SCORE project and the C-statistic values ranged from 0.71 to 0.84 [5]. In the global population, we observed a systematic risk overestimation that has also been previously reported in low-risk populations, as in Spain [8, 9], and high-risk populations [24].

The external validation studies that evaluate the PCE system have generated controversy around the predictive accuracy of these equations in contemporary cohorts [25]. The PCE models discriminated risk reasonably (C-statistic 0.62) in our cohort, but performing worse in comparison to other studies [11, 15, 16]. The original PCE C-statistic ranged from 0.71 to 0.82 [11] and 0.74 to 0.79 in contemporary cohorts [16]. Similar to the SCORE, we observed a risk overestimation in our population, with an exception in predicting ASCVD risk in low-risk strata (< 5%). Previous literature established that the PCE generally overestimate risk among modern European and American populations [13, 15, 16, 23, 26]. Although there are no reports of underestimation of ASCVD risk by the PCE, it has been widely recognized that a large number of people with ASCVD risk prediction < 7.5% will paradoxically experience ASCVD events [27], reinforcing the value of additional risk markers to reclassify those patients [4, 27].

Accurate calibration of the risk prediction models is crucial for the success of preventive measures. Although both models overestimated the risk, when observed risks were taken into account, the accuracy of risk prediction in women was less impressive. Actually, the risk was underestimated by the PCE risk system in the low-risk (< 5%) and intermediate-risk (7.5–20%) strata. Underestimation of ASCVD risk in the female gender has only been described once previously in a Korean cohort [28].

Concerning the SCORE system, the interaction between sex and events should be analyzed as an exploratory and hypothesis-generating finding, due to the very low number of 10-year fatal ASCVD events (n = 7), especially in men (n = 2). This low ASCVDmortality rate is consistent with what has been found in a Spanish cohort of 608 non-diabetic patients on primary prevention with a similar moderate 10-year risk of fatal ASCVD (2.1%), where only 9 ASCVD deaths were reported (1.5%) [8]. Nevertheless, women’s risk was underestimated in high-risk women (5–10%). An underestimation of the risk by the SCORE system in women has already been reported in Australian women below 50 years [6], and in a Malaysian population [7]. Conversely, in another Southern European cohort from Italy, the 10-year fatal ASCVD risk was properly predicted by SCORE [29]. However, the low-risk (< 1%) women from this cohort had a 20-year rate of any ASCVD of 3.7, and 40% of ASCVD events occurred in this class, which signals potential problems with the calibration of this equation in women [29].

The causes of the unexpected findings regarding the underprediction of fatal or any ASCVD risk in women and the very low number of ASCVD deaths in men are not clear. Although women from our cohort had higher levels of LDL-C, they were also treated more commonly with statins. In the past, numerous studies have shown excess mortality in women after myocardial infarction [30]. In addition, women suffering an acute coronary syndrome are treated less intensively than men [31], and, even on primary prevention, it has been observed a lower use of lipid-lowering drugs in women [32]. Independently of the cause of the excess risk of ASCVD events in women, our results suggest that at least in our population, the risk stratification systems might need to be better calibrated among women, in order to reduce the proportion of women miscategorized and to avoid CVD events by implementing appropriate preventive measures [5].

Lastly, the SCORE overestimated the 15-year risk in the overall population, probably reflecting the decline of CVD mortality in the last decades [33]. Conversely, regarding PCE, we observed an important increase in any ASCVD events at 15-year follow-up. The observed 15-year any ASCVD incidence was 1.8 times the 10-year incidence among men and 1.4 times among women. This acceleration of ASCVD risk is even more relevant in the low- and borderline-risk strata in men and the low- and intermediate-risk strata in women, as the observed 15-year risk surpasses the 10-year predicted risk. A divergence between short-time and long-term risk has already been described in two Italian studies [29, 34]. Among the relatively large group with low and intermediate short-term risk, differences in risk factor burden seem to translate into marked differences in the incidence of ASCVD events in the remaining lifespan [35]. The added value of long-term risk estimation becomes even more relevant in women and younger men, more prone to be classified as being at low short-term risk [36].

It is essential to evaluate the applicability of risk models to each population, as risk scores may perform worse in a different setting from the one they were originally derived [37]. It is well-known that the incidence of CVD events is declining, and Portugal is no exception. Despite the high prevalence of hypertension and other chronic diseases, Portugal has one of the best indicators for cardiovascular mortality [20], namely age- and risk-standardized mortality rates concerning coronary artery disease and cerebrovascular disease [19]. This problem is well-recognized and the literature recommends that scores should be recalibrated if incidence rates differ substantially in the new settings [5, 13], as we have previously discussed for women. Additionally, newer statistical methods could considerably improve the accuracy of ASCVD risk estimates [16]. Another, more straightforward option to improve its predictive ability would be the incorporation of additional risk variables such as coronary artery calcium score and high-sensitivity C-reactive protein [4, 27] or consider the lifetime risk for CVD in addition to short-time (10-year) risk [4].

We acknowledge several limitations of our study. We have a limited sample size, representative of the Center region of Portugal, one of the regions with the lowest rate of CVD events in our country [20]. This may explain partially the overestimation of the risk by both systems, and extrapolation of our results to other populations should be done cautiously. In addition, only half of the patients had a complete 15-year follow-up, as many patients were included in this cohort after 2003. Also, we cannot overlook that two-thirds of our cohort was under statin therapy; however, the majority of the patients were under low- and moderate- intensity statins as they were recruited before the era of high-intensity statins recommendation and are representative of a real-world population seen in everyday practice. Interestingly, in a sensitivity analysis of the Copenhagen General Population Study, including statin users at baseline (7% of the population) did not explain the observed mismatch between the predicted and observed event rates [21]. Finally, we were also not able to adjust for prescription of other preventive medication during follow-up. This might also have contributed to some of the observed mismatch. A strength of our study is that the results originate from the largest contemporary Portuguese cohort evaluated so far, with no patient lost to follow-up.

Conclusions

In this prospective, contemporary, Portuguese cohort, SCORE had better discriminatory power compared with PCE. Overall, both systems overestimated ASCVD risk at the 10-year landmark. However, among women, ASCVD risk was underestimated with both risk systems. Lastly, we also observed an acceleration of the cardiovascular risk at 15-year follow-up, particularly at the lowest risk classes. These findings may have the potential to improve risk stratification and, ultimately, treatment allocation in a primary prevention setting.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACC:

American college of cardiology

AHA:

American Heart Association

ASCVD:

Atherosclerotic cardiovascular disease

CVD:

Cardiovascular disease

EAS:

European atherosclerosis society

ESC:

European society of cardiology

HDL-C:

High-density lipoprotein cholesterol

LDL-C:

Low-density lipoprotein cholesterol

PCE:

Pooled cohort Eqs.

TC:

Total cholesterol

SCORE:

Systematic COronary risk estimation

SD:

Standard deviation

SIR:

Standardized incidence ratios

References

  1. Piepoli MF, Hoes AW, Agewall S, Albus C, Brotons C, Catapano AL, et al. 2016 European guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2016;37(29):2315–81.

    Article  Google Scholar 

  2. Yusuf S, Hawken S, Ôunpuu S, Dans T, Avezum A, Lanas F, et al. Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case-control study. Lancet. 2004;364:937–52.

    Article  Google Scholar 

  3. Murray CJL, Lopez AD. Measuring the global burden of disease. N Engl J Med. 2013;369(5):448–57.

    Article  CAS  Google Scholar 

  4. Arnett DK, Blumenthal RS, Albert MA, Buroker AB, Goldberger ZD, Hahn EJ, et al. 2019 ACC/AHA Guideline on the Primary Prevention of Cardiovascular Disease: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines. J Am Coll Cardiol. 2019;1097(19):33876–8 S0735.

    Google Scholar 

  5. Conroy RM, Pyörälä K, Fitzgerald AP, Sans S, Menotti A, De Backer G, et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24(11):987–1003.

    Article  CAS  Google Scholar 

  6. Goh LGH, Welborn TA, Dhaliwal SS. Independent external validation of cardiovascular disease mortality in women utilising Framingham and SCORE risk models: a mortality follow-up study. BMC Womens Health. 2014;14(1):1–11.

    Article  Google Scholar 

  7. Selvarajah S, Kaur G, Haniff J, Cheong KC, Hiong TG, van der Graaf Y, et al. Comparison of the Framingham risk SCORE, SCORE and WHO/ISH cardiovascular risk prediction models in an Asian population. Int J Cardiol. 2014;176(1):211–8.

    Article  Google Scholar 

  8. Barroso LC, Muro EC, Herrera ND, Ochoa GF, Hueros JI, Buitrago F. Performance of the Framingham and SCORE cardiovascular risk prediction functions in a non-diabetic population of a Spanish health care Centre: a validation study. Scand J Prim Health Care. 2010;28(4):242–8.

    Article  Google Scholar 

  9. Buitrago F, Cañón-Barroso L, Díaz-Herrera N, Cruces-Muro E, Escobar-Fernández M, Serrano-Arias JM. Comparación de las tablas REGICOR y SCORE para la clasificación del riesgo cardiovascular y la identificación de pacientes candidatos a tratamiento hipolipemiante o antihipertensivo. Rev Esp Cardiol. 2007;60:139–47.

    Article  Google Scholar 

  10. Sawano M, Kohsaka S, Okamura T, Inohara T, Sugiyama D, Watanabe M, et al. Validation of the european SCORE risk chart in the healthy middle-aged Japanese. Atherosclerosis. 2016;252:116–21.

    Article  CAS  Google Scholar 

  11. Goff DC, Lloyd-Jones DM, Bennett G, Coady S, D'Agostino RB Sr, Gibbons R, et al. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American college of cardiology/American heart association task force on practice guidelines. Circulation. 2014;129(25 SUPPL. 1):49–73.

    Article  Google Scholar 

  12. Kavousi M, Leening MJG, Nanchen D, Greenland P, Graham IM, Steyerberg EW, et al. Comparison of application of the ACC/AHA guidelines, adult treatment panel III guidelines, and European Society of Cardiology Guidelines for cardiovascular disease prevention in a European cohort. JAMA. 2014;311(14):1416.

    Article  Google Scholar 

  13. Mora S, Wenger NK, Cook NR, Liu J, Howard BV, Limacher MC, et al. Evaluation of the pooled cohort risk equations for cardiovascular risk prediction in a multiethnic cohort from the Women’s health initiative. JAMA Intern Med. 2018;02215:1–10.

    Google Scholar 

  14. Cook NR, Ridker PM. Further insight into the cardiovascular risk calculator controversy: the roles of statins, revascularizations, and under-ascertainment in the Women’s health study. JAMA Intern Med. 2014;174(12):1964–71.

    Article  Google Scholar 

  15. Defilippis AP, Young R, Carrubba CJ, McEvoy JW, Budoff MJ, Blumenthal RS, et al. An analysis of calibration and discrimination among multiple cardiovascular risk scores in a modern multiethnic cohort. Ann Intern Med. 2015;162(4):266–75.

    Article  Google Scholar 

  16. Yadlowsky S, Hayward RA, Sussman JB, McClelland RL, Min YI, Basu S. Clinical implications of revised pooled cohort equations for estimating atherosclerotic cardiovascular disease risk. Ann Intern Med. 2018;169(1):20–9.

    Article  Google Scholar 

  17. Ray KK, Kastelein JJP, Matthijs Boekholdt S, Nicholls SJ, Khaw KT, Ballantyne CM, et al. The ACC/AHA 2013 guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular disease risk in adults: the good the bad and the uncertain: a comparison with ESC/EAS guidelines for the management of dyslipidaemias 2011. Eur Heart J. 2014;35(15):960–8.

    Article  Google Scholar 

  18. Pennells L, Kaptoge S, Wood A, Sweeting M, Zhao X, White I, et al. Equalization of four cardiovascular risk algorithms after systematic recalibration: individual-participant meta-analysis of 86 prospective studies. Eur Heart J. 2019;40(7):621–31.

    Article  Google Scholar 

  19. GBD 2015 Healthcare Access and Quality Collaborators. Healthcare access and quality index based on mortality from causes amenable to personal health care in 195 countries and territories, 1990–2015: A novel analysis from the global burden of disease study 2015. Lancet. 2017;390(10091):231–66.

    Article  Google Scholar 

  20. Chipman A. Global heart health: evaluating efforts to promote healthy hearts. In: The Economist Intelligence Unit. 2018. Available at: https://eiuperspectives.economist.com/sites/default/files/Globalhearthealth-1.pdf. Accessed 6 Apr 2020.

  21. Mortensen MB, Nordestgaard BG, Afzal S, Falk E. ACC/AHA guidelines superior to ESC/EAS guidelines for primary prevention with statins in non-diabetic Europeans: the Copenhagen general population study. Eur Heart J. 2017;38(8):586–94.

    CAS  PubMed  Google Scholar 

  22. Hicks KA, Mahaffey KW, Mehran R, Nissen SE, Wiviott SD, Dunn B, et al. 2017 cardiovascular and stroke endpoint definitions for clinical trials. Circulation. 2018;137(9):961–72.

    Article  Google Scholar 

  23. Saar A, Läll K, Alver M, Marandi T, Ainla T, Eha J, et al. Estimating the performance of three cardiovascular disease risk scores: the Estonian biobank cohort study. J Epidemiol Community Health. 2019;73(3):272-7.

  24. Vikhireva O, Pajak A, Broda G, Malyutina S, Tamosiunas A, Kubinova R, et al. SCORE performance in central and eastern Europe and former Soviet Union: MONICA and HAPIEE results. Eur Heart J. 2014;35(9):571–7.

    Article  Google Scholar 

  25. Rana JS, Tabada GH, Solomon MD, Lo JC, Jaffe MG, Sung SH, et al. Accuracy of the atherosclerotic cardiovascular risk equation in a large contemporary, Multiethnic Population. J Am Coll Cardiol. 2016;67(18):2118–30.

    Article  Google Scholar 

  26. Cook NR, Ridker PM. Calibration of the pooled cohort equations for atherosclerotic cardiovascular disease: an update. Ann Intern Med. 2016;165(11):786–94.

    Article  Google Scholar 

  27. Yeboah J, Young R, McClelland RL, Delaney JC, Polonsky TS, Dawood FZ, et al. Utility of nontraditional risk markers in atherosclerotic cardiovascular disease risk assessment. J Am Coll Cardiol. 2016;67(2):139–47.

    Article  Google Scholar 

  28. Jung KJ, Jang Y, Oh DJ, Oh BH, Lee SH, Park SW, et al. The ACC/AHA 2013 pooled cohort equations compared to a Korean risk prediction model for atherosclerotic cardiovascular disease. Atherosclerosis. 2015;242(1):367–75.

    Article  CAS  Google Scholar 

  29. Veronesi G, Giampaoli S, Vanuzzo D, Gianfagna F, Palmieri L, Grassi G, et al. Combined use of short-term and long-term cardiovascular risk scores in primary prevention. J Cardiovasc Med. 2017;18(5):318–24.

    Article  Google Scholar 

  30. Lawesson SS, Alfredsson J, Fredrikson M, Swahn E. Time trends in STEMI-improved treatment and outcome but still a gender gap: A prospective observational cohort study from the SWEDEHEART register. BMJ Open. 2012;2(2):e000726.

  31. Bugiardini R, Yan AT, Yan RT, Fitchett D, Langer A, Manfrini O, et al. Factors influencing underutilization of evidence-based therapies in women. Eur Heart J. 2011;32(11):1337–44.

    Article  CAS  Google Scholar 

  32. Koopman C, Vaartjes I, Heintjes EM, Spiering W, van Dis I, Herings RM, et al. Persisting gender differences and attenuating age differences in cardiovascular drug use for prevention and treatment of coronary heart disease, 1998-2010. Eur Heart J. 2013;34(41):3198–205.

    Article  CAS  Google Scholar 

  33. Mensah GA, Wei GS, Sorlie PD, Fine LJ, Rosenberg Y, Kaufmann PG, et al. Decline in Cardiovascular Mortality. Circ Res. 2017;120(2):366–80.

    Article  CAS  Google Scholar 

  34. Di Castelnuovo A, Costanzo S, Persichillo M, Olivieri M, de Curtis A, Zito F, et al. Distribution of short and lifetime risks for cardiovascular disease in Italians. Eur J Prev Cardiol. 2012;19(4):723–30.

    Article  Google Scholar 

  35. Berry JD, Liu K, Folsom AR, Lewis CE, Carr JJ, Polak JF, et al. Prevalence and progression of subclinical atherosclerosis in younger adults with low short- term but high lifetime estimated risk for cardiovascular disease : the Cardia and Mesa. Circulation. 2010;119(3):382–9.

    Article  Google Scholar 

  36. Marma AK, Berry JD, Ning H, Persell SD, Lloyd-Jones DM. Distribution of 10-year and lifetime predicted risks for cardiovascular disease in US adults: findings from the national health and nutrition examination survey 2003 to 2006. Circ Cardiovasc Qual Outcomes. 2010;3(1):8–14.

    Article  Google Scholar 

  37. Poses RM, Cebul RD, Collins M, Fager SS. The importance of disease prevalence in transporting clinical prediction rules. Ann Intern Med. 1986;105:586–91.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We thank Adriana Belo for assistance with the statistical analysis.

Funding

This work was supported by grant POCI-01-0145-FEDER-032414. The funding source was not involved in the design of the study, collection, analysis, and interpretation of data or writing of the manuscript.

Author information

Authors and Affiliations

  1. Cardiology Unit, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal

    Cátia Santos-Ferreira, Rui Baptista, Manuel Oliveira-Santos & Lino Gonçalves

  2. Coimbra Institute for Clinical and Biomedical Research (iCBR), Faculty of Medicine, University of Coimbra, Coimbra, Portugal

    Rui Baptista & Lino Gonçalves

  3. Internal Medicine Unit, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal

    José Pereira Moura

  4. Faculty of Medicine, University of Coimbra, Coimbra, Portugal

    José Pereira Moura

Authors
  1. Cátia Santos-Ferreira
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rui Baptista
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manuel Oliveira-Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. José Pereira Moura
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lino Gonçalves
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CSF, RB, MOS, JPM, LG designed the study; CSF, RB, MOS acquired the data; CSF, RB, MOS performed the statistical analysis and interpreted the results; CSF drafted the first version of the manuscript; CSF, RB, MOS, JPM, LG read and critically reviewed the final version of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Cátia Santos-Ferreira.

Ethics declarations

Ethics approval and consent to participate

Written informed consent was obtained from each patient and the study was conducted in accordance with the Declaration of Helsinki and approved by the local ethics committee (Comissão de Ética do Centro Hospitalar e Universitário de Coimbra).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Santos-Ferreira, C., Baptista, R., Oliveira-Santos, M. et al. A 10- and 15-year performance analysis of ESC/EAS and ACC/AHA cardiovascular risk scores in a Southern European cohort. BMC Cardiovasc Disord 20, 301 (2020). https://doi.org/10.1186/s12872-020-01574-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12872-020-01574-2

Keywords

BMC Cardiovascular Disorders

ISSN: 1471-2261

Contact us