Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Heart rate n-variability (HRnV) and its application to risk stratification of chest pain patients in the emergency department

BMC Cardiovascular Disorders volume 20, Article number: 168 (2020) Cite this article

Abstract

Background

Chest pain is one of the most common complaints among patients presenting to the emergency department (ED). Causes of chest pain can be benign or life threatening, making accurate risk stratification a critical issue in the ED. In addition to the use of established clinical scores, prior studies have attempted to create predictive models with heart rate variability (HRV). In this study, we proposed heart rate n-variability (HRnV), an alternative representation of beat-to-beat variation in electrocardiogram (ECG), and investigated its association with major adverse cardiac events (MACE) in ED patients with chest pain.

Methods

We conducted a retrospective analysis of data collected from the ED of a tertiary hospital in Singapore between September 2010 and July 2015. Patients > 20 years old who presented to the ED with chief complaint of chest pain were conveniently recruited. Five to six-minute single-lead ECGs, demographics, medical history, troponin, and other required variables were collected. We developed the HRnV-Calc software to calculate HRnV parameters. The primary outcome was 30-day MACE, which included all-cause death, acute myocardial infarction, and revascularization. Univariable and multivariable logistic regression analyses were conducted to investigate the association between individual risk factors and the outcome. Receiver operating characteristic (ROC) analysis was performed to compare the HRnV model (based on leave-one-out cross-validation) against other clinical scores in predicting 30-day MACE.

Results

A total of 795 patients were included in the analysis, of which 247 (31%) had MACE within 30 days. The MACE group was older, with a higher proportion being male patients. Twenty-one conventional HRV and 115 HRnV parameters were calculated. In univariable analysis, eleven HRV and 48 HRnV parameters were significantly associated with 30-day MACE. The multivariable stepwise logistic regression identified 16 predictors that were strongly associated with MACE outcome; these predictors consisted of one HRV, seven HRnV parameters, troponin, ST segment changes, and several other factors. The HRnV model outperformed several clinical scores in the ROC analysis.

Conclusions

The novel HRnV representation demonstrated its value of augmenting HRV and traditional risk factors in designing a robust risk stratification tool for patients with chest pain in the ED.

Peer Review reports

Background

Chest pain, which may be caused by life-threatening myocardial infarction (MI) or benign musculoskeletal pain, is one of the most common presenting complaints in the emergency department (ED) [1,2,3]. Majority of chest pain patients are subjected to extensive diagnostic tests to rule out acute coronary syndrome (ACS), resulting in oftentimes, prolonged and costly ED admission, with only a small proportion of these patients eventually receiving a diagnosis of ACS [3]. This can strain crowded EDs and reduce availability of resources for patients who need urgent medical attention. Hence, early identification of chest pain patients who are at high-risk of developing adverse cardiac events has been a pressing issue to contend with in the ED. Several established clinical scores have been used for risk stratifying chest pain patients in the ED [4, 5], including the History, ECG, Age, Risk factors and Troponin (HEART) [6], the Thrombolysis in Myocardial Infarction (TIMI) [7], and the Global Registry of Acute Coronary Events (GRACE) [8] scores. Of these scores, the HEART score is the most accurate and widely used [5, 9,10,11,12], with recent studies focusing on the development of risk score-based clinical pathways for rapid, yet safe discharge of low-risk patients [1, 3, 13, 14].

In a recent review of clinical scores for ED patients with chest pain [5], heart rate variability (HRV) has demonstrated its capability in building predictive models for accurate risk stratification [15,16,17]. HRV is a widely adopted tool for evaluating changes in cardiac autonomic regulation, and has been shown to be strongly associated with the autonomic nervous system (ANS) [18,19,20]. HRV analysis characterizes the beat-to-beat variation in an electrocardiogram (ECG) by utilizing time and frequency domains, and nonlinear analyses [19]. Reduced HRV has been found to be a significant predictor of adverse cardiac outcomes [21]. Given the complexity of quantifying HRV representation, several tools such as the PhysioNet Cardiovascular Signal Toolbox [22] and Kubios HRV [23] have been developed to standardize HRV analyses.

Based on the principle of parameter calculation on normal R-R intervals (RRIs; in this paper, RRIs are equivalent to normal-to-normal [NN] intervals, in which abnormal beats have been removed), HRV analysis generates only one set of parameters from a fixed length of ECG record. This limits the amount of information that can be extracted from raw ECG signals. In this paper, we proposed a novel representation of beat-to-beat variation, named as heart rate n-variability (HRnV) [24] to characterize RRIs from a different perspective. With the use of HRnV measures, multiple sets of parameters can be calculated from the same ECG record, which significantly increases the amount of extracted information. Our study is the first clinical application and evaluation of the HRnV representation in risk stratification of chest pain patients in the ED. We hypothesized that HRnV, while closely related to conventional HRV, can provide supplementary information associated with adverse cardiac events. We also investigated the potential use of HRnV parameters to develop risk prediction tools.

Methods

Study design and setting

We conducted a retrospective analysis of data collected in our previous study on risk stratification of chest pain patients in the ED [9]. A convenience sample of patients was recruited at the ED of Singapore General Hospital, a tertiary hospital with around-the-clock primary percutaneous coronary intervention capabilities and a median door-to-balloon time of 101 min [25], between September 2010 and July 2015. At ED triage, patients are classified using the Patient Acuity Category Scale (PACS), with PACS 1 patients being the most critically ill and requiring immediate medical attention and PACS 4 patients being non-urgent cases. In this study, patients > 20 years old who presented to the ED with chief complaint of chest pain and with PACS of 1 or 2 were included. Patients were excluded from the study if they had ST-elevation myocardial infarction (STEMI) or an obvious non-cardiac etiology of chest pain diagnosed by the primary emergency physician. Patients were also excluded if their ECGs had high level of noise or if they were in non-sinus rhythm; these criteria were applied to ensure the quality of HRV and HRnV analyses. Ethical approval was obtained from the Centralized Institutional Review Board (CIRB, Ref: 2014/584/C) of SingHealth, the largest public healthcare system in Singapore that includes the Singapore General Hospital as a key partner. Patient consent was waived for this study.

Data collection

During the data collection period, five to six-minute single-lead (lead II) ECG recordings were retrieved from the X-Series Monitor (ZOLL Medical Corporation, Chelmsford, MA). The first set of vital signs and troponin values from the recruited patients were extracted from the hospital’s electronic health records (EHR). In this study, high-sensitivity troponin-T was used, and an abnormal value was defined as > 0.03 ng/mL [26]; it was further stratified into three groups and coded as 0 if the value was ≤0.03 ng/mL, 1 if the value was between 1 and 3 times the normal limit, and 2 if the value was > 3 times the normal limit. Additionally, patients’ first 12-lead ECGs were interpreted by two independent clinical reviewers. Pathologic ST-elevation, ST-depression, T-wave inversions, and Q-waves were recorded. Patient demographics, medical history, and information required for computing the HEART, TIMI, and GRACE scores were retrospectively reviewed and obtained from EHR.

Proposed HRnV representation of beat-to-beat variation in ECG

HRnV: a novel measure with non-overlapping RRIs

Prior to introducing the new HRnV measure, we define a new type of RRI called RRnI, where 1 ≤ n ≤ N, and \( N\ll \hat{N} \); \( \hat{N} \) is the total number of RRIs. The definition of RRnI is illustrated in Fig. 1a. When n = 1, RRnI is equivalent to conventional RRI. When n > 1, every n adjacent RRI is connected to form a new sequence of RRnIs. By using this strategy, we can create a maximum number of (N − 1) new RRnI sequences from conventional single RRI sequence. With these newly generated RRnI sequences, the calculation of HRnV parameters is straightforward and can be accomplished by applying established quantitative methods including time and frequency domain analyses and nonlinear analysis [18, 19]. In describing this new measure, we use the term “HRnV” prior to parameter names to indicate that these parameters are calculated from RRnI sequences. As noted in the above, HRnV is a novel measure based on newly generated, non-overlapping RRnIs. The computed HRnV parameters include but are not limited to the following: the average of RRnIs (HRnV mean NN), standard deviation of RRnIs (HRnV SDNN), square root of the mean squared differences between RRnIs (HRnV RMSSD), the number of times that the absolute difference between two successive RRnIs exceeds 50 ms (HRnV NN50), HRnV NN50 divided by the total number of RRnIs (HRnV pNN50), the integral of the RRnI histogram divided by the height of the histogram (HRnV triangular index), low frequency power (HRnV LF power), high frequency power (HRnV HF power), approximate entropy (HRnV ApEn), sample entropy (HRnV SampEn), and detrended fluctuation analysis (HRnV DFA), among others. Notably, two new parameters NN50n and pNN50n are created, where 50 × n ms is set as the threshold to assess the difference between pairs of consecutive RRnIs.

Fig. 1
figure 1

a Illustration of R-R intervals (RRIs) and the definition of RRnI where 1 ≤ n ≤ N and \( N\ll \hat{N} \). \( \hat{N} \) is the total number of RRIs; b Illustration of RRIs and the definition of RRnIm where 1 ≤ n ≤ N, 1 ≤ m ≤ N − 1, and \( N\ll \hat{N} \). \( \hat{N} \) is the total number of RRIs and m indicates the non-overlapping portion between two consecutive RRnIm sequences

Full size image

HRnVm: a novel measure with overlapping RRIs

Like RRnI that is used in HRnV, to define HRnVm measure, we introduce another type of RRI called RRnIm, where 1 ≤ n ≤ N, 1 ≤ m ≤ N − 1, and \( N\ll \hat{N} \). In the RRnIm sequence, m is used to indicate the level of overlap between consecutive RRnIm sequences. As illustrated in Fig. 1b, (n − m) RRIs form the overlapping portions. When m = n, RRnIm becomes RRnI; therefore, the upper limit of m is N − 1. By controlling the overlap among these newly generated RRnIm sequences, we can create a maximum number of (N × (N − 1)/2) RRnIm sequences (excluding the RRnI sequence) from conventional single RRI sequence. For each of the newly created RRnIm sequences, we apply time and frequency domain analyses, and nonlinear analysis to calculate HRnVm parameters. We add the term “HRnVm” prior to the parameters to denote that they are computed from RRnIm sequences. For example, the average RRnIm intervals and the sample entropy are written as HRnVm mean NN and HRnVm SampEn, respectively. The HRnVm measure extracts more information than HRnV, by adopting a strategy of controlling sequence overlap.

HRnV analysis and parameter calculation

We developed the HRnV-Calc software suite (https://github.com/nliulab/HRnV) to calculate HRnV parameters. The HRnV-Calc software integrates functions from the PhysioNet Cardiovascular Signal Toolbox [22] to perform standardized ECG signal processing and QRS complex detection. Given the short ECG records in this study, the upper limit of n was set as three; thus, six sets of parameters were calculated, namely HRV, HR2V, HR2V1, HR3V, HR3V1, and HR3V2.

Clinical outcomes

The primary endpoint in this study was a composite outcome of major adverse cardiac events (MACE) [27], including all-cause death, acute myocardial infarction (AMI), and revascularization (coronary artery bypass graft [CABG] or percutaneous coronary intervention [PCI]) within 30 days of ED presentation.

Statistical analysis

Continuous variables were presented as mean and standard deviation and compared between two categories of the primary outcome (MACE) using two-sample t-test. Categorical variables were presented as frequency and percentage and compared between two categories of the primary outcome (MACE) using chi-square test. A statistically significant difference was defined as p < 0.05. To evaluate the HRnV parameters and other risk factors, we conducted univariable and multivariable analyses and subsequently developed simple prediction models using traditional logistic regression. In building the HRnV prediction model, we selected candidate variables with p < 0.2 in the univariable analysis and fed them into the multivariable stepwise logistic regression. To evaluate the predictive performance, we used leave-one-out cross-validation (LOOCV) to conduct the analysis.

Receiver operating characteristic (ROC) analysis [28] was performed to compare prediction performances among the HRnV model, HEART, TIMI and GRACE scores. The area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were reported as predictive measures. Data preparation, descriptive analysis, and predictive model development were performed in R version 3.6.0 (R Foundation, Vienna, Austria); ROC analysis was conducted in MATLAB R2019a (MathWorks, Natick, MA).

Results

A total of 795 patients were selected from the originally recruited 922 patients [9]. Twenty-eight patients were excluded for ECG recording issues, four were excluded for obvious non-cardiac chest pain, and 95 were excluded for irregular rhythm/artifacts. Among the included 795 patients, 247 (31%) had the primary outcome of 30-day MACE. Table 1 shows patient baseline characteristics. Patients with the primary outcome were older (mean age 61 years vs. 59 years, p = 0.035), with a higher proportion being males (76.1% vs. 64.6%, p = 0.002). There was no statistically significant difference between MACE and non-MACE groups in terms of patient ethnicity. Factors such as history of diabetes and current smoking status were significantly more prevalent in the group with MACE.

Table 1 Patient baseline characteristics
Full size table

Descriptive analyses of HRV and HRnV parameters are tabulated in Table 2. In this clinical case study, N was set as 3, thus HR2V, HR2V1, HR3V, HR3V1 and HR3V2 parameters were calculated. Among time domain parameters such as mean NN, SDNN and RMSSD, the HRnV and HRnVm values were generally incremental with an increase in n. Notably, HR2V NN50 and HR3V NN50 were much lower than conventional HRV NN50. Moreover, NN50n and pNN50n are parameters specifically applicable to the HRnV representation. Like time domain parameters, the same trend of changes in frequency domain parameters were observed. The magnitude of increment in VLF power and LF power was larger than that of HF power with increasing n. One exception, however, was the normalized HF power, where HRnV and HRnVm parameters were smaller than that of HRV. In nonlinear analysis, there were marked differences in Poincaré SD2 values between HRV and HRnV parameters. HR2V SampEn and HR3V SampEn were considerably larger compared to SampEn parameters of HRV, HR2V1, HR3V1, and HR3V2, as their confidence intervals (CIs) were wide. The wide CI was due to insufficient data points of less than 200 [19], as our ECG recordings were only five to six minutes long. HR2V1, HR3V1 and HR3V2 were free from this issue as they were calculated from overlapping RRnIm sequences where more data points were available.

Table 2 Descriptive analyses of heart rate variability (HRV) and heart rate n-variability (HRnV) parameters
Full size table

Table 3 presents the results of univariable analyses of HRnV and HRnVm parameters. Eleven out of 21 conventional HRV parameters were statistically significant. Additionally, 13 HR2V, six HR3V, 11 HR2V1, seven HR3V1 and 11 HR3V2 parameters were also significant. Overall, additional 115 HRnV parameters were derived, among which 48 showed statistical significances between patients with 30-day MACE and those without. Among all HRV and HRnV parameters, mean NN, SDNN, RMSSD, NN50, pNN50, HF power, Poincaré SD1 and SD2 were statistically significant in at least five out of six measures (i.e., HRV, HR2V, HR2V1, HR3V, HR3V1, and HR3V2). Furthermore, skewness, LF power, SampEn, and ApEn, which did not demonstrate statistical significance in conventional HRV analysis, were statistically significant in HRnV representation. Table 4 presents the results of the multivariable analyses of HRnV and HRnVm parameters by adjusting for age and sex. After adjustment, several parameters such as NN50 of HR3V and HR3V2, and triangular index of HRV, HR2V, and HR3V2, became statistically non-significant, while parameters such as ApEn of HR2V, HR2V1, and HR3V2 became statistically significant.

Table 3 Univariable analysis of HRnV and HRnVm parameters
Full size table
Table 4 Multivariable analysis of HRnV and HRnVm parameters by adjusting for age and sex
Full size table

Table 5 lists the 16 variables that were selected through multivariable stepwise logistic regression, among which there were one conventional HRV parameter and seven HRnV parameters. In addition to traditional predictors of adverse cardiac outcomes such as ST segment changes and troponin, HR2V ApEn (OR = 0.095; 95% CI 0.014–0.628), HR2V1 ApEn (OR = 19.700; 95% CI 2.942–131.900) and HR3V skewness (1.560; 95% CI 1.116–2.181) also demonstrated strong predictive power in assessing the risk of 30-day MACE. Figure 2 shows the ROC curves and Table 6 presents the results of ROC analysis in evaluating the predictive performance of the HRnV model (based on LOOCV), HEART, TIMI, and GRACE scores. The HRnV model achieved the highest AUC value and outperformed HEART, TIMI, and GRACE scores in terms of specificity, PPV, and NPV at the optimal cut-off scores, defined as the points nearest to the upper-left corner of the ROC curves.

Table 5 Multivariable analysis with stepwise logistic regression (backward selection) on all variables
Full size table
Fig. 2
figure 2

The receiver operating characteristic (ROC) curves produced by heart rate n-variability (HRnV) model (performance was based on leave-one-out cross-validation), the History, ECG, Age, Risk factors and Troponin (HEART) score, the Thrombolysis in Myocardial Infarction (TIMI) score, and the Global Registry of Acute Coronary Events (GRACE) score

Full size image
Table 6 Comparison of performance of the HRnV model (based on leave-one-out cross-validation), HEART, TIMI, and GRACE scores in predicting 30-day major adverse cardiac events (MACE)
Full size table

Discussion

HRV has generated significant research interest in the past decades [18, 19, 29], with majority of studies focusing on development of advanced nonlinear techniques to derive novel parameters [30, 31]. There is, however, a paucity of research on alternative approaches to analyze RRIs. Vollmer [32] used relative RRIs to describe the relative variation of consecutive RRIs, with which HRV was analyzed. Likewise, we proposed a novel HRnV representation, providing more HRnV parameters than conventional HRV analysis. In this paper, we introduced two measures of HRnV, namely HRnV and HRnVm. HRnV was calculated based on non-overlapping RRnI sequences, while HRnVm was computed from overlapping RRnIm sequences. HRnV was not developed to replace the conventional HRV but to augment it. It enables the creation of additional parameters from raw ECGs, and thus empowers the extraction of supplementary information.

In our clinical case study, we investigated the predictive value of HRnV parameters in assessing the risk of 30-day MACE for chest pain patients in the ED. In addition to 21 HRV parameters, 115 HRnV parameters were derived, of which 48 were found to be statistically significant in their association with the primary outcome. Notably, even with a small n (three in our study), newly generated HRnV parameters greatly boosted the number of candidate predictors. When longer ECG records are available, more HRnV parameters can be calculated. With HRnV parameters, HRV parameters, vital signs, and several established risk factors, we conducted multivariable logistic regression analysis and selected age, diastolic BP, pain score, ST-elevation, ST-depression, Q wave, cardiac history, troponin, HRV NN50, and seven HRnV parameters. In addition to traditional risk factors such as ST segment changes, HR2V ApEn, HR2V1 ApEn, and HR3V skewness were found to be strong predictors for 30-day MACE. Compared to the HEART, TIMI, and GRACE scores, the HRnV model achieved the highest AUC, specificity, PPV, and NPV values at the optimal cut-off points in ROC analysis. This demonstrated the clinical utility of HRnV in determining the risk of 30-day MACE for ED patients with chest pain.

Due to the wide differential diagnosis for chest pain, accurate stratification is vital, particularly for preventing low-risk patients from obtaining expensive and unnecessary medical testing and intervention [3]. Although the TIMI and GRACE scores have been validated for risk prediction of patients with chest pain in the ED [4, 33, 34], some criteria used in these scores may be inappropriate for undifferentiated chest pain cohorts in the ED, as they were originally developed for post-acute myocardial infarction patients [1]. In comparison, the HEART score was derived from a population of ED patients with chest pain, and has been extensively validated worldwide [10, 13, 27, 35]. It has demonstrated its utility in identifying both low-risk patients for possible early discharge and high-risk patients for urgent intervention. Built upon established scores, several chest pain pathways [14, 36,37,38] have been implemented and tested, particularly for the management of low-risk patients. Than et al. [38] evaluated a TIMI score-based accelerated diagnostic protocol (ADP) with a reported sensitivity of 99.3% and NPV of 99.1%. Similarly, a systematic review by Laureano-Phillips et al. [39] reported that the HEART score achieved both sensitivity and NPV of 100% in several validation studies. Furthermore, a cost-effectiveness study conducted in Brisbane, Australia reported economic benefits by adopting an ADP in the ED, with reduction in expected cost and length of stay amongst patients with chest pain [40].

Most established clinical scores use conventional risk factors such as biomarkers, medical history, and presenting vital signs. However, patient history can sometimes be subjective and blood tests, such as troponin, require waiting time. HRV, as a noninvasive measure, can be easily calculated from ECGs; it is an objective tool to assess the activities of the ANS [19]. It also has the advantage of requiring only several minutes to acquire (five to six minutes in our protocol), which is much faster than serum biomarkers. Over the past decades, HRV has been widely investigated in a broad range of clinical applications, particularly in cardiovascular research. Apart from being associated with sudden cardiac death [18], HRV also showed significant correlations with adverse clinical outcomes in prehospital setting [41] and with MACE outcomes in ED patients with chest pain [17]. HRV parameters have been integrated with other risk factors into machine learning algorithms to predict adverse outcomes [42, 43]. These promising results motivated the use of HRV to develop objective and computerized risk stratification tools for chest pain patients [44, 45]. In an updated review of clinical scores for chest pain, Liu et al. [5] summarized several studies which aimed to develop alternative techniques for risk stratification.

This study aimed to present novel HRnV representation and its measures and investigate their association with clinical outcomes. Although HRnV parameters showed promising performance in identifying high-risk chest pain patients, this study was not intended to create a ready-to-use clinical tool. Instead, we demonstrated the feasibility of utilizing HRnV parameters to augment conventional HRV and risk factors in designing a prediction tool/score. These HRnV parameters can be readily calculated without the collection of supplementary data. In this study, with five to six-minute ECG recording and n = 3, five-fold more HRnV parameters were calculated compared to HRV alone. When longer ECG recordings are available and parameter n is larger, more HRnV parameters can be derived. To build a HRnV-based risk stratification tool, a systematic approach is needed to derive a point-based, consistent score to ease its clinical application and practical implementation.

As a natural extension of conventional HRV, HRnV representation creates the opportunity to generate additional parameters. This representation could also serve as a smoother for RRIs, making them less sensitive to sudden changes caused by abnormal heart beats (e.g. very short or very long RRI). However, since HRnV is a novel representation of beat-to-beat variations in ECG, many technical issues need to be addressed in future research. For instance, as shown in Table 2, SampEn became larger when the available number of data points was less than 200 [19], suggesting that additional research is required to investigate its applicability to short ECG records. Moreover, parameters NN50n and pNN50n are newly introduced in HRnV representation only. They characterize the number of times that the absolute difference between two successive RRnI sequences exceeds 50 × n ms, by assuming that the absolute difference may be magnified when the corresponding RRnI is n times longer than RRI. Thus, in-depth investigations are required in the selection of appropriate thresholds. More importantly, physiological interpretations of the HRnV parameters and their normal values [29] need to be determined through numerous research. One example is the identification of frequency bands that correlate with certain physiological phenomenon. In the current analysis, the conventional cut-off values were adopted (i.e., ≤0.04 Hz as very low frequency range; 0.04–0.15 Hz as low frequency range; 0.15–0.4 Hz as high frequency range). With the increase in n, frequency domain analysis may need to be changed accordingly.

Beyond its use in risk stratification of ED patients with chest pain, HRnV can potentially be used in other clinical domains, where conventional HRV has been extensively investigated [46,47,48,49]. With the augmented RRnI and RRnIm sequences, HRnV could possibly capture more dynamic changes in cardiac rhythms than HRV. This capability enables the extraction of additional information from limited raw ECGs. This study utilized HRnV parameters as independent risk factors and analyzed them with traditional biostatistical methods. There are multiple ways to use HRnV parameters, e.g. each set of HRnV parameters can be analyzed individually and subsequently combined with an ensemble learning [50] (a special type of machine learning algorithm) architecture to reach a decision. However, artificial intelligence and machine learning methods generally create black-box predictive models, making interpretation a challenge [51].

Limitations

This study has several limitations. First, we did not develop a scoring tool for practical clinical use. The primary aim of this study was to demonstrate the feasibility of using HRnV parameters and common risk factors to build predictive models. Second, the HRnV model was evaluated with LOOCV strategy due to the small sample size. Ideally, separate patient cohorts are needed to train and test prediction models. When a new scoring tool is developed, it is necessary to conduct external validations on cohorts with diverse patient characteristics. Furthermore, properly designed clinical pathways are needed as well. Third, the patients included in this study were mainly from the high acuity group, resulting in a higher 30-day MACE rate (i.e., 31%) compared to other similar studies [10, 39]. As a result, the generalizability of the HRnV model developed in this study may be uncertain in other patient cohorts. Fourth, the calculated HRnV and HRV parameters depended on the choice of tools and methods for ECG signal analysis. Thus, the values of these parameters may vary across studies. Last, the physiology of HRnV and interpretations of its measures are mostly unknown; calculation of some parameters also needs to be standardized. All these require future collaborative research efforts between clinicians and scientists to address.

Conclusions

In this study, we proposed a novel HRnV representation and investigated the use of HRnV and established risk factors to develop a predictive model for risk stratification of patients with chest pain in the ED. Multiple HRnV parameters were found to be statistically significant predictors, which effectively augmented conventional HRV, vital signs, troponin, and cardiac risk factors in building an effective model with good discrimination performance. The HRnV model outperformed the HEART, TIMI, and GRACE scores in the ROC analysis. It also demonstrated its capability in identifying low-risk patients, which could potentially be used to build a new clinical pathway. Moving forward, we suggest further development of a point-based, ready-to-use HRnV risk stratification tool. Although some issues remain to be addressed, we hope to stimulate a new stream of research on HRnV. We believe that future endeavors in this field will lead to the possibility of in-depth evaluation of the associations between HRnV measures and various human diseases.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACS:

Acute coronary syndrome

ADP:

Accelerated diagnostic protocol

AMI:

Acute myocardial infarction

ANS:

Autonomic nervous system

AUC:

Area under the curve

ApEn:

Approximate entropy

CABG:

Coronary artery bypass graft

CI:

Confidence interval

DFA:

Detrended fluctuation analysis

ED:

Emergency department

EHR:

Electronic health records

GRACE:

Global registry of acute coronary events

HEART:

History, ECG, age, risk factors and troponin

HF:

High frequency

HRnV:

Heart rate n-variability

HRV:

Heart rate variability

LF:

Low frequency

LOOCV:

Leave-one-out cross-validation

MACE:

Major adverse cardiac events

Mean NN:

Average of R-R intervals

MI:

Myocardial infarction

NN50:

The number of times that the absolute difference between 2 successive R-R intervals exceeds 50 ms

NN50n :

The number of times that the absolute difference between 2 successive RRnI/RRnIm sequences exceeds 50 × n ms

NPV:

Negative predictive value

PACS:

Patient acuity category scale

PCI:

Percutaneous coronary intervention

pNN50:

NN50 divided by the total number of R-R intervals

pNN50n :

NN50n divided by the total number of RRnI/RRnIm sequences

PPV:

Positive predictive value

RMSSD:

Square root of the mean squared differences between R-R intervals

ROC:

Receiver operating characteristic

RRI:

R-R interval

SampEn:

Sample entropy

SD:

Standard deviation

SDNN:

Standard deviation of R-R intervals

STEMI:

ST-elevation myocardial infarction

TIMI:

Thrombolysis in Myocardial Infarction

VLF:

Very low frequency

References

  1. Long B, Koyfman A. Best clinical practice: current controversies in the evaluation of Low-risk chest pain with risk stratification aids. Part 2. J Emerg Med. 2017;52(1):43–51.

    Article  PubMed  Google Scholar 

  2. Long B, Koyfman A. Best clinical practice: current controversies in evaluation of Low-risk chest pain-part 1. J Emerg Med. 2016;51(6):668–76.

    Article  PubMed  Google Scholar 

  3. Hollander JE, Than M, Mueller C. State-of-the-art evaluation of emergency department patients presenting with potential acute coronary syndromes. Circulation. 2016;134(7):547–64.

    Article  PubMed  Google Scholar 

  4. Backus BE, Six AJ, Kelder JH, Gibler WB, Moll FL, Doevendans PA. Risk scores for patients with chest pain: evaluation in the emergency department. Curr Cardiol Rev. 2011;7(1):2–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Liu N, Ng JCJ, Ting CE, Sakamoto JT, Ho AFW, Koh ZX, Pek PP, Lim SH, Ong MEH. Clinical scores for risk stratification of chest pain patients in the emergency department: an updated systematic review. J Emerg Crit Care Med. 2018;2:16.

  6. Six AJ, Cullen L, Backus BE, Greenslade J, Parsonage W, Aldous S, Doevendans PA, Than M. The HEART score for the assessment of patients with chest pain in the emergency department: a multinational validation study. Crit Pathw Cardiol. 2013;12(3):121–6.

    Article  PubMed  Google Scholar 

  7. Antman EM, Cohen M, Bernink PJ, McCabe CH, Horacek T, Papuchis G, Mautner B, Corbalan R, Radley D, Braunwald E. The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making. Jama. 2000;284(7):835–42.

    Article  CAS  PubMed  Google Scholar 

  8. Granger CB, Goldberg RJ, Dabbous O, Pieper KS, Eagle KA, Cannon CP, Van De Werf F, Avezum A, Goodman SG, Flather MD, et al. Predictors of hospital mortality in the global registry of acute coronary events. Arch Intern Med. 2003;163(19):2345–53.

    Article  PubMed  Google Scholar 

  9. Sakamoto JT, Liu N, Koh ZX, Guo D, Heldeweg MLA, Ng JCJ, Ong MEH. Integrating heart rate variability, vital signs, electrocardiogram, and troponin to triage chest pain patients in the ED. Am J Emerg Med. 2018;36(2):185–192.

  10. Poldervaart JM, Langedijk M, Backus BE, Dekker IMC, Six AJ, Doevendans PA, Hoes AW, Reitsma JB. Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department. Int J Cardiol. 2017;227:656–61.

    Article  CAS  PubMed  Google Scholar 

  11. Fernando SM, Tran A, Cheng W, Rochwerg B, Taljaard M, Thiruganasambandamoorthy V, Kyeremanteng K, Perry JJ. Prognostic accuracy of the HEART score for prediction of major adverse cardiac events in patients presenting with chest pain: a systematic review and meta-analysis. Acad Emerg Med Off J Soc Acad Emerg Med. 2019;26(2):140–51.

    Article  Google Scholar 

  12. Reaney PDW, Elliott HI, Noman A, Cooper JG. Risk stratifying chest pain patients in the emergency department using HEART, GRACE and TIMI scores, with a single contemporary troponin result, to predict major adverse cardiac events. Emerg Med J. 2018;35(7):420–7.

    Article  PubMed  Google Scholar 

  13. Van Den Berg P, Body R. The HEART score for early rule out of acute coronary syndromes in the emergency department: a systematic review and meta-analysis. Eur Heart J Acute Cardiovasc Care. 2018;7(2):111–9.

    Article  Google Scholar 

  14. Mahler SA, Riley RF, Hiestand BC, Russell GB, Hoekstra JW, Lefebvre CW, Nicks BA, Cline DM, Askew KL, Elliott SB, et al. The HEART pathway randomized trial: identifying emergency department patients with acute chest pain for early discharge. Circ Cardiovasc Qual Outcomes. 2015;8(2):195–203.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Liu N, Lin Z, Cao J, Koh ZX, Zhang T, Huang G-B, Ser W, Ong MEH. An intelligent scoring system and its application to cardiac arrest prediction. IEEE Trans Inf Technol Biomed. 2012;16(6):1324–31.

    Article  PubMed  Google Scholar 

  16. Liu N, Koh ZX, Chua ECP, Tan LML, Lin Z, Mirza B, Ong MEH. Risk scoring for prediction of acute cardiac complications from imbalanced clinical data. IEEE J Biomed Health Inform. 2014;18(6):1894–902.

    Article  PubMed  Google Scholar 

  17. Ong MEH, Goh K, Fook-Chong S, Haaland B, Wai KL, Koh ZX, Shahidah N, Lin Z. Heart rate variability risk score for prediction of acute cardiac complications in ED patients with chest pain. Am J Emerg Med. 2013;31(8):1201–7.

    Article  PubMed  Google Scholar 

  18. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Heart rate variability: standards of measurement, physiological interpretation and clinical use. Circulation. 1996;93(5):1043–65.

    Article  Google Scholar 

  19. Rajendra Acharya U, Paul Joseph K, Kannathal N, Lim CM, Suri JS. Heart rate variability: a review. Med Biol Eng Comput. 2006;44(12):1031–51.

    Article  CAS  PubMed  Google Scholar 

  20. Billman GE. Heart rate variability - a historical perspective. Front Physiol. 2011;2:86.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Carpeggiani C, L'Abbate A, Landi P, Michelassi C, Raciti M, Macerata A, Emdin M. Early assessment of heart rate variability is predictive of in-hospital death and major complications after acute myocardial infarction. Int J Cardiol. 2004;96(3):361–8.

    Article  PubMed  Google Scholar 

  22. Vest AN, Da Poian G, Li Q, Liu C, Nemati S, Shah AJ, Clifford GD. An open source benchmarked toolbox for cardiovascular waveform and interval analysis. Physiol Meas. 2018;39(10):105004.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Tarvainen MP, Niskanen JP, Lipponen JA, Ranta-Aho PO, Karjalainen PA. Kubios HRV–heart rate variability analysis software. Comput Methods Prog Biomed. 2014;113:210–20.

    Article  Google Scholar 

  24. Liu N, Guo D, Koh ZX, Ho AFW, Ong MEH. Heart rate n-variability (HRnV): A novel representation of beat-to-beat variation in electrocardiogram. bioRxiv. 2018:449504. https://doi.org/10.1101/449504.

  25. Ho AF, Fook-Chong S, Pek PP, Ng YY, Wong AS, Ong ME. Prehospital presentation of patients with ST-segment elevation myocardial infarction in Singapore. Int J Cardiol. 2013;168(4):4273–6.

    Article  PubMed  Google Scholar 

  26. Januzzi JL Jr, Bamberg F, Lee H, Truong QA, Nichols JH, Karakas M, Mohammed AA, Schlett CL, Nagurney JT, Hoffmann U, et al. High-sensitivity troponin T concentrations in acute chest pain patients evaluated with cardiac computed tomography. Circulation. 2010;121(10):1227–34.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Sakamoto JT, Liu N, Koh ZX, Fung NX, Heldeweg ML, Ng JC, Ong ME. Comparing HEART, TIMI, and GRACE scores for prediction of 30-day major adverse cardiac events in high acuity chest pain patients in the emergency department. Int J Cardiol. 2016;221:759–64.

    Article  PubMed  Google Scholar 

  28. Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27(8):861–74.

    Article  Google Scholar 

  29. Shaffer F, Ginsberg JP. An overview of heart rate variability metrics and norms. Front Public Health. 2017;5:258.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Peng CK, Havlin S, Stanley HE, Goldberger AL. Quantification of scaling exponents and crossover phenomena in nonstationary heartbeat time series. Chaos. 1995;5(1):82–7.

    Article  CAS  PubMed  Google Scholar 

  31. Barbieri R, Matten EC, Alabi AA, Brown EN. A point-process model of human heartbeat intervals: new definitions of heart rate and heart rate variability. Am J Phys Heart Circ Phys. 2005;288(1):H424–35.

    CAS  Google Scholar 

  32. Vollmer M. A robust, simple and reliable measure of heart rate variability using relative RR intervals. In: Computing in Cardiology Conference (CinC): 6–9 Sept. 2015, vol. 2015; 2015. p. 609–12.

    Chapter  Google Scholar 

  33. Chase M, Robey JL, Zogby KE, Sease KL, Shofer FS, Hollander JE. Prospective validation of the thrombolysis in myocardial infarction risk score in the emergency department chest pain population. Ann Emerg Med. 2006;48(3):252–9.

    Article  PubMed  Google Scholar 

  34. Pollack CV, Sites FD, Shofer FS, Sease KL, Hollander JE. Application of the TIMI risk score for unstable angina and non-ST elevation acute coronary syndrome to an unselected emergency department chest pain population. Acad Emerg Med Off J Soc Acad Emerg Med. 2006;13(1):13–8.

    Article  Google Scholar 

  35. Marcoon S, Chang AM, Lee B, Salhi R, Hollander JE. HEART score to further risk stratify patients with low TIMI scores. Crit Pathw Cardiol. 2013;12(1):1–5.

    Article  PubMed  Google Scholar 

  36. Long B, Oliver J, Streitz M, Koyfman A. An end-user's guide to the HEART score and pathway. Am J Emerg Med. 2017;35(9):1350–5.

    Article  PubMed  Google Scholar 

  37. Than MP, Pickering JW, Aldous SJ, Cullen L, Frampton CM, Peacock WF, Jaffe AS, Goodacre SW, Richards AM, Ardagh MW, et al. Effectiveness of EDACS versus ADAPT accelerated diagnostic pathways for chest pain: a pragmatic randomized controlled trial embedded within practice. Ann Emerg Med. 2016;68(1):93–102 e101.

    Article  PubMed  Google Scholar 

  38. Than M, Cullen L, Reid CM, Lim SH, Aldous S, Ardagh MW, Peacock WF, Parsonage WA, Ho HF, Ko HF, et al. A 2-h diagnostic protocol to assess patients with chest pain symptoms in the Asia-Pacific region (ASPECT): a prospective observational validation study. Lancet (London, England). 2011;377(9771):1077–84.

    Article  Google Scholar 

  39. Laureano-Phillips J, Robinson RD, Aryal S, Blair S, Wilson D, Boyd K, Schrader CD, Zenarosa NR, Wang H. HEART score risk stratification of Low-risk chest pain patients in the emergency department: a systematic review and meta-analysis. Ann Emerg Med. 2019;74(2):187–203.

    Article  PubMed  Google Scholar 

  40. Cheng Q, Greenslade JH, Parsonage WA, Barnett AG, Merollini K, Graves N, Peacock WF, Cullen L. Change to costs and lengths of stay in the emergency department and the Brisbane protocol: an observational study. BMJ Open. 2016;6(2):e009746.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Ong ME, Padmanabhan P, Chan YH, Lin Z, Overton J, Ward KR, Fei DY. An observational, prospective study exploring the use of heart rate variability as a predictor of clinical outcomes in pre-hospital ambulance patients. Resuscitation. 2008;78(3):289–97.

    Article  PubMed  Google Scholar 

  42. Liu N, Zhang Z, Ho AFW, Ong MEH. Artificial intelligence in emergency medicine. J Emerg Crit Care Med. 2018;2:82.

    Article  Google Scholar 

  43. Chiew CJ, Liu N, Tagami T, Wong TH, Koh ZX, Ong MEH. Heart rate variability based machine learning models for risk prediction of suspected sepsis patients in the emergency department. Medicine. 2019;98(6):e14197.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Liu N, Sakamoto JT, Cao J, Koh ZX, Ho AFW, Lin Z, Ong MEH. Ensemble-based risk scoring with extreme learning machine for prediction of adverse cardiac events. Cogn Comput. 2017;9(4):545–54.

    Article  Google Scholar 

  45. Liu N, Koh ZX, Goh J, Lin Z, Haaland B, Ting BP, Ong MEH. Prediction of adverse cardiac events in emergency department patients with chest pain using machine learning for variable selection. BMC Med Inform Decis Mak. 2014;14:75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Quintana DS, Alvares GA, Heathers JA. Guidelines for reporting articles on psychiatry and heart rate variability (GRAPH): recommendations to advance research communication. Transl Psychiatry. 2016;6:e803.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Kloter E, Barrueto K, Klein SD, Scholkmann F, Wolf U. Heart rate variability as a prognostic factor for Cancer survival - a systematic review. Front Physiol. 2018;9:623.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Schroeder EB, Chambless LE, Liao D, Prineas RJ, Evans GW, Rosamond WD, Heiss G. Diabetes, glucose, insulin, and heart rate variability: the atherosclerosis risk in communities (ARIC) study. Diabetes Care. 2005;28(3):668–74.

    Article  CAS  PubMed  Google Scholar 

  49. Buchman TG, Stein PK, Goldstein B. Heart rate variability in critical illness and critical care. Curr Opin Crit Care. 2002;8(4):311–5.

    Article  PubMed  Google Scholar 

  50. Polikar R. Ensemble based systems in decision making. IEEE Circuits Syst Mag. 2006;6(3):21–44.

    Article  Google Scholar 

  51. Lundberg SM, Nair B, Vavilala MS, Horibe M, Eisses MJ, Adams T, Liston DE, King-Wai Low D, Newman SF, Kim J, et al. Explainable machine-learning predictions for the prevention of hypoxaemia during surgery. Nat Biomed Eng. 2018;2(10):749–60.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank and acknowledge the contributions of doctors, nurses, and clinical research coordinators from the Department of Emergency Medicine, Singapore General Hospital.

Funding

This work was supported by the SHF Foundation Research Grant (SHF/FG652P/2017). The study sponsor was not involved in the study design; in the collection, analysis and interpretation of data; in the writing of the manuscript; and in the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. Duke-NUS Medical School, National University of Singapore, 8 College Road, Singapore, 169857, Singapore

    Nan Liu, Andrew Fu Wah Ho, Feng Xie, Pin Pin Pek, Bibhas Chakraborty & Marcus Eng Hock Ong

  2. Health Services Research Centre, Singapore Health Services, 20 College Road, Singapore, 169856, Singapore

    Nan Liu & Marcus Eng Hock Ong

  3. SingHealth Duke-NUS Emergency Medicine Academic Clinical Programme, Singapore, Singapore

    Dagang Guo & Andrew Fu Wah Ho

  4. Department of Emergency Medicine, Singapore General Hospital, Singapore, Singapore

    Zhi Xiong Koh, Pin Pin Pek, Swee Han Lim & Marcus Eng Hock Ong

  5. National Heart Research Institute Singapore, National Heart Centre Singapore, Singapore, Singapore

    Andrew Fu Wah Ho

  6. Department of Emergency and Critical Care Medicine, Nippon Medical School Musashikosugi Hospital, Tokyo, Japan

    Takashi Tagami

  7. School of Medicine, Stanford University, Stanford, California, USA

    Jeffrey Tadashi Sakamoto

  8. National Heart Centre Singapore, Singapore, Singapore

    Jack Wei Chieh Tan

Authors
  1. Nan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dagang Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Xiong Koh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andrew Fu Wah Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Feng Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Takashi Tagami
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jeffrey Tadashi Sakamoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Pin Pin Pek
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Bibhas Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Swee Han Lim
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jack Wei Chieh Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Marcus Eng Hock Ong
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NL invented the HRnV representation, conceived the study, supervised the project, and wrote the first draft of the manuscript. NL, DG, ZXK, and FX performed the analyses. NL, DG, ZXK, AFWH, FX, TT, JTS, PPP, BC, SHL, JWCT, and MEHO contributed to evaluation of the HRnV measures, interpretation of the results, and revision of the manuscript. NL, DG, ZXK, AFWH, FX, TT, JTS, PPP, BC, SHL, JWCT, and MEHO approved the final manuscript.

Corresponding author

Correspondence to Nan Liu.

Ethics declarations

Ethics approval and consent to participate

The ethical approval was obtained from the Centralized Institutional Review Board (CIRB, Ref: 2014/584/C) of SingHealth, in which patient consent was waived.

Consent for publication

Not applicable.

Competing interests

NL and MEHO hold patents related to using heart rate variability and artificial intelligence for medical monitoring. NL, DG, ZXK, and MEHO are currently advisers to TIIM SG. The other authors report no conflicts.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, N., Guo, D., Koh, Z.X. et al. Heart rate n-variability (HRnV) and its application to risk stratification of chest pain patients in the emergency department. BMC Cardiovasc Disord 20, 168 (2020). https://doi.org/10.1186/s12872-020-01455-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12872-020-01455-8

Keywords

BMC Cardiovascular Disorders

ISSN: 1471-2261

Contact us