30 day predicted outcome in undifferentiated chest pain: multicenter validation of the HEART score in Tunisian population
BMC Cardiovascular Disorders volume 21, Article number: 555 (2021)
Chest pain remains one of the most challenging serious complaints in the emergency department (ED). A prompt and accurate risk stratification tool for chest pain patients is paramount to help physcian effectively progrnosticate outcomes. HEART score is considered one of the best scores for chest pain risk stratification. However, most validation studies of HEART score were not performed in populations different from those included in the original one.
To validate HEART score as a prognostication tool, among Tunisian ED patients with undifferentiated chest pain.
Our prospective, multicenter study enrolled adult patients presenting with chest pain at chest pain units. Patients over 30 years of age with a primary complaint of chest pain were enrolled. HEART score was calculated for every patient. The primary outcome was major cardiovascular events (MACE) occurrence, including all-cause mortality, non-fatal myocardial infarction (MI), and coronary revascularisation over 30 days following the ED visit. The discriminative power of HEART score was evaluated by the area under the ROC curve. A calibration analysis of the HEART score in this population was performed using Hosmer–Lemeshow goodness of test.
We enrolled 3880 patients (age 56.3; 59.5% males). The application of HEART score showed that most patients were in intermediate risk category (55.3%). Within 30 days of ED visit, MACE were reported in 628 (16.2%) patients, with an incidence of 1.2% in the low risk group, 10.8% in the intermediate risk group and 62.4% in the high risk group. The area under receiver operating characteristic curve was 0.87 (95% CI 0.85–0.88). HEART score was not well calibrated (χ2 statistic = 12.34; p = 0.03).
HEART score showed a good discrimination performance in predicting MACE occurrence at 30 days for Tunisian patients with undifferentiated acute chest pain. Heart score was not well calibrated in our population.
Chest pain remains one of the most common, potentially serious presenting complaints for adults emergency department  visits with approximately 7.6 million yearly visits in the United States . The priority for emergency physician is to determine whether these patients with acute chest pain have a potential life threatening underlying etiology. The great challenge is to differentiate patients presenting with acute coronary syndrome  and those with other more benign conditions. Obviously, medical history, clinical examination, and laboratory values may help to identify patients with true ACS. None is sufficiently accurate to be used independently . Thus, more than 2% of ACS patients are inappropriately discharged annually . Therefore, there is a global tendency for ED physician to overinvestigate chest pain patients with further, often more invasive testing, even in low risk patients. This kind of practice leads to resource overutilization and a huge health costs waste contrasting with no outcomes improvement .
For many years, physicians were searching tools, ranging from specific diagnostic tests to entire strategies of evaluation, to appropriately risk stratify patients with chest pain in order to simultaneously prevent major adverse cardiac events  and reduce unnecessary testing and hospitalisations. Based on the principal that a prompt quick and accurate identification of patients who are at high and low risk of developing major adverse cardiac events is paramount, and in order to optimally allocate ED and hospital resources, many bioclinical scores have been developed. HEART score is one of the more recently proposed model derived through a process involving expert opinion and review of medical literature. It is calculated based on admission data of medical history, EKG, age, cardiovascular risk factors and troponin levels . The HEART score was created specifically to identify ED patients presenting with undifferentiated chest pain who were at low risk as well as patients at high risk of short-term MACE occurrence. Several scientific societies are encouraging the use of HEART score, for evaluating patients with chest pain suggestive of ACS in the ED [8, 9]. However, most of validating HEART score studies targeted Caucasian populations in high-income countries with scarce validation in other ethnic groups. For this reason, HEART score needs to be tested in various populations to check its accuracy and the eventual need for customization [10, 11]. Additional studies providing further worldwide data about the validation of this risk score will empower emergency physicians’ decision making when relying on this score in ruling in or ruling out their chest pain patients. The goal of our investigation is to validate HEART score as a prognostication tool among ED patients with chest pain in teaching hospitals in Tunisia.
Study design and setting
We conducted a cohort study of ED patients who were admitted to chest pain units in the ED of 3 Tunisian hospitals: Fattouma Bourguiba University Hospital, Monastir; Sahloul University Hospital, Sousse and Farhat Hached University Hospital, Sousse.
The study’s objectives and procedures were approved by the local independent ethics committee. It is conducted in accordance with the principles of the Declaration of Helsinki. All patients and/or their surrogates received written information about the study and provided their verbal consent to participate. The present manuscript was drafted in compliance with the STROBE checklist for cohort studies.
Selection of participants
Patients with a chief complaint of chest pain were prospectively recruited during the period from January 2015 to April 2017. Our inclusion criteria comprised any adult aged older than 30 years with a chief complaint of ‘‘chest pain’’, ‘‘chest tightness’’, or ‘‘chest pressure’’. We excluded subjects with an ST segment elevation myocardial infarction (STEMI) and patients lost to follow up. We also excluded patients in whom an obvious diagnosis was made immediately after initial medical evaluation.
HEART score measurement
HEART score calculation relies on five elements : history, EKG, age, risk factors, and troponin. The history component was scored using a list of predefined chest pain characteristics that were categorized as typical or atypical. Chest pain was considered as typical chest discomfort if it is characterized by a retrosternal or precordial sensation of pain, pressure, or tightness radiating to the left arm, the neck, or the jaw, either intermittent or persistent, occurring at rest or related to exercise. Chest pain was considered as atypical when patient related different chest location of the pain, or different radiation than described below. The history was classified as «non-suspicious» if it contained only atypical characteristics. If the patient history contained both typical and atypical characteristics, the history was classified as «moderately suspicious». If the history contained only typical elements, the history was classified highly suspicious.
The EKG component was scored based on the impression of the first EKG by the treating physician. The measured troponin values were interpreted according to local lab standards and reference values. Troponin T (Roche, Diagnostics (Basel, Switzerland), lower limit of detection 0.01 ng/mL; 99th centile < 0.01 ng/mL; 10% coefficient of variation 0.035 ng/mL) was used during the study period. Troponin T > 0.01 was considered positive. Only the troponin value of the first blood sample was used for the HEART score calculation. High sensitive troponin was not used at the time of the study conduct. The sum of points given for each component defined the HEART score value. The standard version of the HEART score was used . Patients with a HEART score of 0 to 3 were categorized as low risk to develop MACE. Patients with a HEART score between 4 and 6 were categorized as intermediate risk and a HEART score of 7 or upper was considered at high risk of MACE occurrence.
The primary outcome was MACE occurrence including all-cause mortality, non-fatal myocardial infarction (MI), and coronary revascularisation within 30 days. The diagnosis of MI was defined according to the third definition of myocardial infarction . All study files were reviewed by two independent, experienced physicians, a cardiologist and an emergency physician. When disagreement occurs, a third opinion was asked from another experienced cardiologist. To check for MACE occurrence at day 30, data were collected through direct phone calls. If required, patients were reconvened to check their health records to ensure that myocardial infarction or coronary intervention occurred during the one-month period after discharge.
We aimed to find a difference in one month MACE between low, intermediate and high-risk categories of HEART score. The power calculation for our study assumes an alpha of 0.05 and beta of 0.1 looking for a false negative rate of 1% in the low risk group yielding a sample size of at least 3874 patients. Since we anticipated that 5–10% of patients would be excluded, we aimed for a sample size of 4260. All continuous data are presented as either the median with the interquartile range or the mean with Standard Deviation (SD), according to the distribution of the data. The categorical data are presented as the percentage of occurrence. We used Student’s t test for comparison of means for continuous variables, Chi-square and Fisher’s exact test for comparison of categorical variables. We calculated the area under the receiver operating characteristic curve (ROC) with its binomial exact 95% confidence interval for the HEART score in predicting the occurrence of MACE within one month of ED visit. Calibration analysis to assess whether the observed MACE rate match expected MACE rate was tested using the Hosmer–Lemeshow goodness of fit test. Statistical significance was defined as p < 0.05, two-sided. Statistical analysis was carried out using IBM SPSS Statistics for Windows software version 20.0®.
During the study period, we enrolled 4267 patients; we excluded 387 patients (Fig. 1). The main exclusion criterion was lost for follow up. This resulted in 3880 subjects included in our study. Baseline characteristics of the study population are shown in Table 1. Mean age was 56.3 years with male/female ratio of 1.47. Diabetes and hypercholesterolemia were the most prevalent cardiovascular risk factors (43% and 36.8% respectively). There were 2959 (76.3%) patients discharged home from the ED, 409 (10.5%) admitted to coronary care unit, and 512 (13.2%) were admitted to the ward. For risk stratification groups, we noticed that most of our patients were classified as intermediate risk score (55.3%) (Fig. 2). Within 30 days of ED visit, MACE were reported in 628 (16.2%) patients. Among these patients, 122 developed non-fatal myocardial infarction and 484 underwent coronary intervention: 350 (9%) underwent percutaneous coronary intervention 45 (1.2%) had a coronary artery bypass graft surgery and 89 (2.3%) had a coronary angiography with obvious stenosis but managed conservatively. The distribution of major cardiovascular events in the different risk groups at 30-day assessment is shown in Fig. 3. The numerical distribution of the score’s five components in the groups with and without MACE differed significantly (Table 2). Among the five components, ECG and troponin showed remarkably significant positive likelihood ratio for MACE occurrence. The average HEART score was 4.16 ± 1.7 in non-MACE group and 6.84 ± 1.6 in MACE group. The ability of HEART score to predict MACE occurrence in the study cohort is shown in Fig. 4. The area under receiver operating characteristic curve was 0.87 (95% CI 0.85–0.88). Hosmer–Lemeshow test showed a statistically significant difference between observed and expected MACE rates (χ2 = 12.34 and p = 0.03). Table 3 shows sensitivity, specificity, positive (PPV) and negative (NPV) predictive values of HEART score using the cutoff values usually accepted.
Subgroups analysis showed that area under ROC curve did not change significantly according to gender. However, it was higher in patients under the age of 65 [0.89 (95% CI 0.87–0.90)] compared to older patients (0.83 (95% CI 0.80–0.87)) p = 0.004. The lowest AUC value was found among the subgroup of patients with the highest level of Troponin (0.72 (95%CI 0.66–0.78)). HEART score had similar sensitivity level in both sex groups. However, sensitivity was the lowest when the level of troponin was normal (sensitivity = 82.5%). Specificity is low in all subgroups. The NPV is high in all subgroups and reaches 100% in the subgroup of patients with troponin superior to 3 times the normal limit.
In this study, we analyzed the accuracy of HEART score in predicting short-term risk of major adverse cardiovascular events in a large contemporary cohort of Tunisian patients presenting to the ED for acute undifferentiated chest pain. We found that HEART score has an excellent prognostic value and could serve as an effective risk stratification tool.
It is well known that patients admitted to the ED with chest pain are at risk for several life-threatening conditions. Given the difficulties associated with accurate risk stratification of these patients, and the potential consequences associated with inappropriate discharge, clinicians often elect to admit patients even whom they believe to be at low risk of MACE . As a result, the AHA/ACC guidelines have recommended that risk stratification scores should be used to aid in clinical decision-making , but the best one to be used is still unknown. Among the widely used risk stratification scores, we mention TIMI score and the GRACE score. However, neither TIMI nor GRACE scores were designed for ED chest pain risk stratification. The relevance of their use for MACE prediction and patient disposition in ED undifferentiated chest pain is up for debate [15,16,17,18]. Boubaker et al. have shown that both scores had low prognostic value and do not serve as an effective risk stratification tool in Tunisian chest pain population . Recently, the HEART score has emerged as a reliable alternative to risk stratify patients presenting with undifferentiated chest pain in emergency departments. It was firstly introduced in Europe. It is easy to use, intuitive and includes well-established factors associated with the probability of having an ACS. It helps identifying low risk patients in whom immediate further cardiac testing can be safely forgone. It was developed and validated initially in Netherlands, then validated in American and Asian populations but has not been tested in North African populations. Ethnic validation of risk scores is paramount, since inter-ethnic differences in cardiovascular risk factors potentially influence risk score performances. Thus, extrapolation of risk stratification models to different settings cannot be anticipated [20,21,22,23]. This is the first prospective study assessing HEART score risk stratification performance in a large sample of Tunisian patients with acute chest pain. Our study population is comparable to the original study population  and other previous cohorts validating HEART score [3, 24, 25]. However, our patients were younger. In addition, we had higher frequency of diabetes and lower rate of hypertension in our population. Like the previous validating HEART score studies, our incidence of MACE was low in the three HEART score categories, compared to the original study population . Our results suggest that HEART score can be used in risk stratifying chest pain patients. A c-statistic of 0.87 for the HEART score indicates a good to excellent ability to discriminate the short-term prognosis in ED chest pain patients. Our findings are in accordance with the results of many studies that tested and validated the clinical value of the HEART score in many countries. Matthew et al.  reported that the AUROC of HEART score was as good as 0.88, 95% CI (0.84–0.93); they showed that there was no MACE in their low risk group patients. In a stepped-wedge, cluster randomized trial; Poldervaart et al.  also reported that HEART score was an accurate risk stratification instrument and safe to use when assessing patients with chest pain in the ED. In our low risk group patients, incidence of MACE was 1.2%. This finding is quite similar to that shown in the meta-analysis of Berg et al. . They showed that the pooled incidence of “missed” MACE was 1.6% in the low risk group. It is noteworthy that none of our low risk patients died during the 30-day follow up. Even though, we should acknowledge that to safely rule-out ACS, the HEART score should achieve higher sensitivity and NPV ; its poor calibration must still urge to more caution in its use in clinical practice.
There are several potential limitations to our study that should be acknowledged. First, although our study has the largest sample size, it may not reflect the full spectrum of patients with acute non traumatic chest pain because we did not include those admitted to nonteaching hospitals or patients treated in an ambulatory setting. However, many of these patients were secondarily transferred to our emergency departments to be investigated in our chest pain units. Second, the relative short duration of follow-up in current study could not allow us to observe more clinical events. Future study is warranted to evaluate whether the HEART score is also useful for longterm risk prediction in our population. Third, the HEART score utilized conventional troponins as cardiac biomarker component; the question whether using highly sensitive troponins would improve the performance of the score is a relevant issue requiring a specific study. Fourth, we need to know more about the real effects of using the HEART score in routine clinical practice. Such experience should be investigated to provide the evidence for its potential benefit. Fifth, there were 76 (1.8%) patients lost to follow. Despite that such rate is considered low, assuming that these patients reached endpoint, there could be an impact on the estimated prognostic accuracy.
Our study indicates that the HEART sore had a good performance to evaluate the risk of MACE within 30 days in Tunisian patients with undifferentiated acute chest pain. However, its use in clinical decision making should be prudent.
Availability of data and materials
All orignal data used to support the findigs.
Rui P, Kang K. National Hospital Ambulatory Medical Care Survey: 2017 emergency department summary tables. National Center for Health Statistics. Available from: https://www.cdc.gov/nchs/data/nhamcs/web_tables/2017_ed_web_tables-508.pdf
Amsterdam EA, Wenger NK, Brindis RG, et al. 2014 AHA/ACC guideline for the management of patients with non–st-elevation acute coronary syndromes: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;64:139–228.
Backus BE, Six AJ, Kelder JC, et al. A prospective validation of the HEART score for chest pain patients at the emergency department. Int J Cardiol. 2013;168:2153–8.
Fanaroff AC, Rymer JA, Goldstein SA, et al. Does this patient with chest pain have acute coronary syndrome?: The rational clinical examination systematic review. JAMA. 2015;314:1955–65.
Waxman DA, Kanzaria HK, Schriger DL. Unrecognized cardiovascular emergencies among medicare patients. JAMA Intern Med. 2018;178:477–84.
Sandhu AT, Heidenreich PA, Bhattacharya J, et al. Cardiovascular testing and clinical outcomes in emergency department patients with chest pain. JAMA Intern Med. 2017;177:1175–82.
Six AJ, Backus BE, Kelder JC. Chest pain in the emergency room: value of the HEART score. Neth Heart J. 2008;16:191–6.
Amsterdam E, Kirk JD, Bluemke DA, et al. Testing of low-risk patients presenting to the emergency department with chest pain: a scientific statement from the American Heart Association. Circulation. 2010;122:1756–76.
Roffi M, Patrono C, Collet JP, et al. 2015 ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: task force for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation of the European Society of Cardiology (ESC). Eur Heart J. 2016;37:267–315.
Graham G. Racial and ethnic differences in acute coronary syndrome and myocardial infarction within the United States: from demographics to outcomes. Clin Cardiol. 2016;39:299–306.
Gasevic D, Ross ES, Lear SA. Ethnic differences in cardiovascular disease risk factors: a systematic review of North American Evidence. Can J Cardiol. 2015;31:1169–79.
Liu N, Ng JC, Ting CE, et al. Clinical scores for risk stratification of chest pain patients in the emergency department: an updated systematic review. J Emerg Crit Care Med. 2018;2:1–14.
Thygesen K, Alpert JS, Jaffe AS, et al. Third universal definition of myocardial infarction. Circulation. 2012;126:2020–35.
Katz DA, Williams GC, Brown RL, et al. Emergency physicians’ fear of malpractice in evaluating patients with possible acute cardiac ischemia. Ann Emerg Med. 2005;46:525–33.
Hess EP, Agarwal D, Chandra S, et al. Diagnostic accuracy of the TIMI risk score in patients with chest pain in the emergency department: a meta-analysis. CMAJ. 2010;182:1039–44.
Conti A, Poggioni C, Viviani G, et al. Risk scores prognostic implementation in patients with chest pain and nondiagnostic electrocardiograms. Am J Emerg Med. 2012;30:1719–28.
Goodacre SW, Bradburn M, Mohamed A, et al. Evaluation of Global Registry of Acute Cardiac Events and Thrombolysis in Myocardial Infarction scores in patients with suspected acute coronary syndrome. Am J Emerg Med. 2012;30:37–44.
Lyon R, Morris A, Caesar D, et al. Chest pain presenting to the emergency department—to stratify risk with GRACE or TIMI? Resuscitation. 2007;74:90.
Boubaker H, Beltaief K, Grissa MH, et al. Inaccuracy of thrombolysis in myocardial infarction and global registry in acute coronary events scores in predicting outcome in ED patients with potential ischemic chest pain. Am J Emerg Med. 2015;33:1209–12.
Collins GS, de Groot J, Dutton S, et al. External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol. 2014;14:1–11.
De Hoog VC, Lim SH, Bank IE, et al. Ethnic differences in clinical outcome of patients presenting to the emergency department with chest pain. Eur Heart J Acute Cardiovasc Care. 2016;5:32–40.
Yusuf S, Hawken S, Ôunpuu S, et al. Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case-control study. Lancet. 2004;364:937–52.
Anand SS, Yusuf S, Vuksan V, et al. Differences in risk factors, atherosclerosis, and cardiovascular disease between ethnic groups in Canada: the Study of Health Assessment and Risk in Ethnic groups (SHARE). Lancet. 2000;356:279–84.
Backus BE, Six A, Kelder JC, et al. Chest pain in the emergency room: a multicenter validation of the HEART score. Crit Pathw Cardiol. 2010;9:164–9.
Six AJ, Cullen L, Backus BE, et al. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol. 2013;12:121–6.
Poldervaart JM, Reitsma JB, Backus BE, et al. The impact of the HEART risk score in the early assessment of patients with acute chest pain: design of a stepped wedge, cluster randomised trial. BMC Cardiovasc Disord. 2013;26:13–20.
Streitz MJ, Oliver JJ, Hyams JM, et al. A retrospective external validation study of the HEART score among patients presenting to the emergency department with chest pain. Intern Emerg Med. 2018;13:727–48.
Poldervaart JM, Reitsma JB, Backus BE, et al. Effect of using the HEART score in patients with chest pain in the emergency department: a stepped-wedge, cluster randomized trial. Ann Intern Med. 2017;166:689–97.
Berg P, Body R. The HEART score for early rule out of acute coronary syndromes in the emergency department: a systematic review and meta-analysis. Eur Heart J Acute Cardiovasc Care. 2018;7:111–9.
Than M, Herbert M, Flaws D, et al. What is an acceptable risk of major adverse cardiac event in chest pain patients soon after discharge from the Emergency Department?: a clinical survey. Int J Cardiol. 2013;166:752–4.
The authors acknowledge all of our Research Laboratory LR12SP18 University of Monastir members who contributed greatly to this study.
The authors received no specific funding for this work.
Ethics approval and consent to participate
The study complies with the Declaration of Helsinki. The research protocol have been approved by the local ethic committee of Fattouma Bourguiba Hospital. Informed consent have been obtained from all patients or their surrogates.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Khalil, M.H., Sekma, A., Yaakoubi, H. et al. 30 day predicted outcome in undifferentiated chest pain: multicenter validation of the HEART score in Tunisian population. BMC Cardiovasc Disord 21, 555 (2021). https://doi.org/10.1186/s12872-021-02381-z