Using the LACE index to predict hospital readmissions in congestive heart failure patients
© Wang et al.; licensee BioMed Central Ltd. 2014
Received: 24 June 2014
Accepted: 30 July 2014
Published: 7 August 2014
The LACE index has been used to predict the risk of unplanned readmission within 30 days after hospital discharge in both medical and surgical patients. The aim of this study is to validate the accuracy of using the LACE index in CHF patients.
This was a retrospective study. The LACE index score was calculated on each patient who was admitted to hospital due to an acute CHF exacerbation. Operational and clinical variables were collected from patients including basic clinical characteristics, length of hospitalization, comorbidities, number of previous ED visits in the past 6 months before the index admission, and the number of post discharge ED revisits at 30, 60, and 90 days. All variables were analyzed by multivariate logistic regression to determine the association between clinical variables and the hospital unplanned readmissions. C-statistic was used to discriminate those patients with high risk of readmissions.
Of the 253 patients included in the study, 24.50% (62/253) experienced unplanned readmission to hospital within 30 days after discharge. The LACE index was slightly higher in patients readmitted versus patients not readmitted (12.17 ± 2.22 versus 11.80 ± 1.92, p = 0.199). Adjusted odds ratios based on logistic regression of all clinical variables showed only the number of previous ED visits (OR 1.79, 95% CI 1.30-2.47, p < 0.001), history of myocardial infarction (OR 2.51, 95% CI 1.02-6.21, p = 0.045), and history of peripheral vascular disease (OR 10.75, 95% CI 1.52-75.73, p = 0.017) increased the risk of unplanned readmission within 30 days of hospital discharge. However, patients with high LACE scores (≥10) had a significantly higher rate of ED revisits (15.04% vs 0%) within 30 days from the index discharge than those with low LACE scores (p = 0.030).
The LACE index may not accurately predict unplanned readmissions within 30 days from hospital discharge in CHF patients. The LACE high risk index may have utility as a screening tool to predict high risk ED revisits after hospital discharge.
Readmission is considered a second admission to hospital within a short period of time (usually within 30 days) from hospital discharge and has been considered both costly and an indication of poor health care quality delivery [1, 2]. A recent study reported 30 days hospital readmission of approximately 20% among all Medicare patients with an estimated cost of 17.4 billion US dollars . In order to properly use and reduce the significant healthcare cost, a number of interventions designed to prevent and reduce hospital readmissions were reported by different studies. However, the success of these studies was largely dependent on proper identification of patients at high risk for readmission [4–6]. Several scoring systems have been reported to predict unplanned readmissions and the LACE index is one of the most commonly used systems in the US [1, 7–9].
Detail of LACE score salculation
LACE score calculation table
Length of stay (days)
14 or more
Acuity of Admission
If the total score is between 0 and 3, C-score equals to the total score, if the total score is 4 or higher, C-score is 5
Previous myocardial infarction
Peripheral vascular disease
Diabetes without complications
Congestive heart failure
Diabetes with end organ damage
Chronic pulmonary disease
Mild liver or renal disease
Any tumor (including lymphoma or leukemia)
Connective tissue disease
Moderate or severe liver or renal disease
Metastatic solid tumor
Emergency department visits
How many times has the patient visited an emergency department in the six months prior to admission (not including the emergency department visit immediately preceding the current admission)?
Score equal to the same number of ED visits if the number of ED visits less than 4. If the number of ED visits more than 4 (including 4), E-score is 4.
Total LACE score = L-score + A-score + C-score + E-score 0–4 Low, 5–9 Moderate, > 9 High Risk
Congestive heart failure (CHF) is one of the most common and severe diseases seen in the Emergency Department (ED) and is associated with very high hospital admissions and readmissions [12, 13]. Previous studies in CHF showed readmissions might be associated with length of hospitalization, medical comorbidities, frequent ED revisits, low literacy skills, and severity of illness [14–16]. In order to reduce high readmissions, it is suggested that high risk CHF patients need to be identified earlier and be linked to some intervention programs upon discharge [13, 17].
Therefore, the aim of this observational study was to externally validate the accuracy of using the LACE index to predict 30 days readmissions in CHF patients. Our secondary goal was to determine the potential independent risk factors that are predictive of readmission if the LACE index was determined unreliable.
Study Design and Population: This was a retrospective study of adult patients who presented to an urban publicly funded hospital ED with CHF exacerbations between June 2012 and June 2013. The study population included patients greater than 18 years of age. All patients were admitted to hospital from the ED due to CHF exacerbation. Patients receiving a discharge diagnosis of CHF based on criteria from the 9th edition of international classification of disease (ICD-9) code were included. The diagnosis of CHF was confirmed by cardiology consult notes, ICD-9 code discharge diagnosis, or recent echocardiography report. Recent echocardiography was defined as a study performed at either the index admission or within 6 months. For patients admitted more than once during the study period, only the initial admission was included. Study excluded patients who died in hospital or whose primary diagnosis was not CHF exacerbation. Study also excluded patients that were not admitted directly from ED due to an extreme small sample size (only 5 patients) likely causing significant bias. Hospital readmission was defined as all cause patient readmission from the ED for the second time within 30 days of the index admission. It is assumed that patient readmissions had not been arranged or planned if they presented directly to the ED prior to hospital readmission. This study was approved by the local John Peter Smith Health Network Institutional Review Board.
Clinical variables and data collection: Patient demographic data and their medical history records were reviewed using the electronic health record. Variables including age, gender, ethnicity, the number of previous ED visit within 6 months, the length of hospitalization stay (LOS), and the Charlson comorbidity index (CCI) were collected. The LACE index was then calculated as reported in previous studies [14–16]. Thirty days readmissions, mortality, and post discharge ED visits were also obtained from the electronic health record.
Statistics: Univariate comparisons between patients that were readmitted to hospital within 30 days versus those not readmitted were analyzed. The student t test was used for continuous data and the χ2 test was used for categorical data. To exclude potential confounding factors, all variables were then analyzed using multivariate logistic regression. C-statistic (area under the receiver operating characteristics) with 95% confidence intervals (CI) was used to assess the discriminatory power of the model and compare goodness of fit for logistic regression. A value of 0.5 indicates the model is no better than chance for making a prediction. A value of 0.7 or higher is considered statistically significant to identify a difference between groups. All other tests were two-sided with p value less than 0.05 considered statistically significant. Stata 12.0 statistical software (Stata Corp, College Station, TX, USA) was used for statistical data analysis.
The LACE index may not accurately predict unplanned readmissions
The basic characteristics of hospitalized CHF patients in groups of whether experienced readmissions
Readmission n = 62
No readmission n = 191
LACE index ± SD
12.17 ± 2.22
11.80 ± 1.92
Age, mean year ± SD
57.67 ± 11.68
56.17 ± 11.43
Age group, %
Male Gender, %
Ethnicity and race, %
Length of index hospitalization stay, day ± SD
5.33 ± 3.32
5.90 ± 3.88
Number of ED visits 6 months before the index admission ± SD
0.80 ± 1.29
0.34 ± 0.73
Charlson comorbidity index ± SD
4.62 ± 0.87
4.53 ± 1.01
Mode of arrival by Ambulance
No primary care physician/unknown
Frequent ED visits before the index admission and history of myocardial infarction or peripheral vascular disease might increase the risk of readmission within 30 days from index discharge in CHF patients.
Adjusted odds ratios of clinical variables by multivariate logistic regression between patients readmitted within 30 days from discharge and those without
Length of index hospitalization stay
Charlson comorbidity index
Number of ED visits 6 months before the index admission
History of myocardial infarction
History of peripheral vascular disease
LACE index can predict ED revisits more accurately than it predicts unplanned readmissions
The role of high risk LACE index on predicting unplanned readmissions and Emergency revisits after index discharge
High risk for readmission N = 226
Low risk for readmission N = 27
OR (95% CI)
Within 30 days after index discharge
Hospital unplanned readmission, %
ED revisits, %
Within 60 days after index discharge
Hospital unplanned readmission, %
ED revisits, %
Within 90 days after index discharge
Hospital unplanned readmission, %
ED revisits, %
Unplanned hospital readmissions are considered a marker of the quality of hospital care based on the underlying reason that return visits were related to premature discharge and inadequate treatment [18, 19]. This occurs commonly in the CHF population . The LACE index is an easy to use scoring tool that was reported by several studies to be accurate for predicting the risk of early death or unplanned readmission after discharge from hospital [17, 21, 22]. However, other studies showed poor performance of the LACE index in different patient populations [16, 23, 24]. Our results also show that use of the LACE index to identify high risk CHF patients for readmissions is not reliable.
Our study population had a high Charlson comorbidity index score (mean CCI = 4.56) resulting in a higher average LACE score (mean LACE score = 11.89). However, the population examined whereby the LACE index was initially derived had a mean CCI score of 0.5 and a mean LACE score of 6.0 which was much lower than our study population . This may, in part, explain the inconsistency of using the LACE index to predict readmissions in our study. In addition, our study population had relatively high psychosocial risks including transportation challenges, active psychiatric problems, lacking primary care physicians, less commercial insurance coverage, or no insurance which could lead to frequent ED visits. This phenomenon not only occurred in patients with frequent readmissions, it also occurred commonly in patients with no readmissions showing the high consistency in this study population (Table 2). Similar results from other studies showed the high occurrence of medication noncompliance, a lack of primary care follow up, and/or a lack of family support placed patients into a high risk group more likely to develop chronic disease exacerbations resulting in more frequent hospital readmissions [25–27]. Taken together, it is noted that due to significant differences in study populations, the LACE index may not reliably predict hospital readmissions accurately.
An independent risk factor that demonstrated reliable predictability of readmissions in our study was number of ED visits prior to the index admission. This suggests that frequent ED visits may result in a higher frequency of hospital readmissions. This could be related to a higher burden of chronic illness among these patients. Patients having chronic medical conditions may experience a higher frequency of ED visits, higher rates of hospital admissions, and more lengthy hospital stays [27, 28]. It could also be attributed to the extreme age reported in some studies [28, 29]. Our study results showed length of hospital stay, age, and CCI score had no significant difference regardless as to whether patients were readmitted or not. Further review of chronic illnesses in the study population showed that patients with a history of MI or PVD tended to have more hospital readmissions. Similar results are found within Medicare data reporting comorbidities including history of diabetes, MI, PVD, and stroke could predict a higher risk of readmissions in CHF patients . Previous studies found MI and CHF were the two most common diseases associated with high admissions and readmissions . The coexistence of these two chronic conditions is high . Our study confirmed the hypothesis and showed that CHF patients with history of MI experienced higher readmissions but did not discriminate as to whether or not MI was a consequence of CHF.
To the best of our knowledge, there is no previously published study that investigates the link between the LACE index and post index discharge ED revisits. Our study found that the LACE index can predict post discharge ED revisits more accurately than it predicts hospital readmissions though this predictability is not overwhelming (c < 0.7). A high LACE index predicts a high risk of post discharge ED visits when patients are followed up to 90 days post index discharge. Additionally patients with a low LACE index experienced no ED revisits within 30 days post index discharge. Our study also showed CHF patients with history of prior frequent ED visits are highly likely to have the same pattern of frequent ED revisits during the post index discharge period. This could be due, at least partially, to the high psychosocial risks and associated comorbidities in our study population. These patients tend to use the ED as their primary resource for health care. In addition, given the fact of other comorbidities affecting hospital readmissions indicates its complexity and multifactory. Since the LACE index is a user friendly tool, it is practical to screen CHF patients before hospital discharge to identify relatively high risk patients. With limited health care resources at their disposable, these CHF patients with a high risk LACE index can be prioritized to services linking them to community intervention programs. Several CHF intervention programs are now in place in our community providing an alternate resource for these patients and curbing ED overuse for health maintenance needs among them.
This is a retrospective study from a single urban tertiary care publicly funded hospital with a special patient population. Retrospective methodology limits its applicability in a way that includes bias regarding the accuracy of information, potential selection bias due to one institutional database, incomplete follow up data, and incomplete inter-subject data for analysis. In addition, as this study examines data associated only with patients admitted from the ED and excludes patients admitted from other primary care services this might also lead to patient selection bias. Second, all readmissions were reviewed and collected from hospital electronic health records. Patients that may have been admitted to other hospitals were not included in this study. This may contribute to incomplete follow up data. We did monitor other measures during the patient post-discharge period, such as follow up visits with primary care physicians and ED revisits. With many high risk psychosocial patients in our study population a certain number of them were lost to follow up which may also lead to incomplete and/or inaccurate analysis of data. A multicenter prospective study is required to more accurately identify CHF patients at high risk of hospital readmission and ED revisits and to further validate the results of this study.
In conclusion, our study shows application of the LACE index to identify CHF patients at high risk for unplanned readmissions within 30 days of discharge may not be reliable. Better predictors of high risk readmissions among CHF patients may be 1) number of previous ED visits, 2) history of MI, 3) and/or history of PVD. A LACE high risk index may have the best application in predicting the likelihood of ED revisits in the post index discharge period and therefore be of particular interest in linking these patients to alternate community healthcare services thereby curbing ED overuse among this population.
- Ben-Chetrit E, Chen-Shuali C, Zimran E, Munter G, Nesher G: A simplified scoring tool for prediction of readmission in elderly patients hospitalized in internal medicine departments. Isr Med Assoc J. 2012, 14: 752-756.PubMedGoogle Scholar
- Balla U, Malnick S, Schattner A: Early readmissions to the department of medicine as a screening tool for monitoring quality of care problems. Medicine (Baltimore). 2008, 87: 294-300.View ArticleGoogle Scholar
- Jencks SF, Williams MV, Coleman EA: Rehospitalizations among patients in the Medicare fee-for-service program. N Engl J Med. 2009, 360: 1418-1428.View ArticlePubMedGoogle Scholar
- Stewart S, Vandenbroek AJ, Pearson S, Horowitz JD: Prolonged beneficial effects of a home-based intervention on unplanned readmissions and mortality among patients with congestive heart failure. Arch Intern Med. 1999, 159: 257-261.View ArticlePubMedGoogle Scholar
- Stewart S, Marley JE, Horowitz JD: Effects of a multidisciplinary, home-based intervention on unplanned readmissions and survival among patients with chronic congestive heart failure: a randomised controlled study. Lancet. 1999, 354: 1077-1083.View ArticlePubMedGoogle Scholar
- McAlister FA, Youngson E, Bakal JA, Kaul P, Ezekowitz J, van Walraven C: Impact of physician continuity on death or urgent readmission after discharge among patients with heart failure. CMAJ. 2013, 185: E681-E689.View ArticlePubMedPubMed CentralGoogle Scholar
- van Walraven C, Wong J, Forster AJ: LACE + index: extension of a validated index to predict early death or urgent readmission after hospital discharge using administrative data. Open Med. 2012, 6: e80-e90.PubMedPubMed CentralGoogle Scholar
- van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, Zarnke K, Austin PC, Forster AJ: Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. 2010, 182: 551-557.View ArticlePubMedPubMed CentralGoogle Scholar
- Gruneir A, Dhalla IA, van Walraven C, Fischer HD, Camacho X, Rochon PA, Anderson GM: Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Med. 2011, 5: e104-e111.PubMedPubMed CentralGoogle Scholar
- Cotter PE, Bhalla VK, Wallis SJ, Biram RW: Predicting readmissions: poor performance of the LACE index in an older UK population. Age Ageing. 2012, 41: 784-789.View ArticlePubMedGoogle Scholar
- Tan SY, Low LL, Yang Y, Lee KH: Applicability of a previously validated readmission predictive index in medical patients in Singapore: a retrospective study. BMC Health Serv Res. 2013, 13: 366-View ArticlePubMedPubMed CentralGoogle Scholar
- Gwadry-Sridhar FH, Flintoft V, Lee DS, Lee H, Guyatt GH: A systematic review and meta-analysis of studies comparing readmission rates and mortality rates in patients with heart failure. Arch Intern Med. 2004, 164: 2315-2320.View ArticlePubMedGoogle Scholar
- Pandor A, Gomersall T, Stevens JW, Wang J, Al-Mohammad A, Bakhai A, Cleland JG, Cowie MR, Wong R: Remote monitoring after recent hospital discharge in patients with heart failure: a systematic review and network meta-analysis. Heart. 2013, 99: 1717-1726.View ArticlePubMedGoogle Scholar
- Au AG, McAlister FA, Bakal JA, Ezekowitz J, Kaul P, van Walraven C: Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. Am Heart J. 2012, 164: 365-372.View ArticlePubMedGoogle Scholar
- Islam T, O'Connell B, Lakhan P: Hospital readmission among older adults with congestive heart failure. Aust Health Rev. 2013, 37: 362-368.PubMedGoogle Scholar
- McNaughton CD, Collins SP, Kripalani S, Rothman R, Self WH, Jenkins C, Miller K, Arbogast P, Naftilan A, Dittus RS, Storrow AB: Low numeracy is associated with increased odds of 30-day emergency department or hospital recidivism for patients with acute heart failure. Circ Heart Fail. 2013, 6: 40-46.View ArticlePubMedGoogle Scholar
- Ellery S, Pakrashi T, Paul V, Sack S: Predicting mortality and rehospitalization in heart failure patients with home monitoring–the Home CARE pilot study. Clin Res Cardiol. 2006, 3 (Suppl 3): III29-III35.Google Scholar
- McPhee JT, Barshes NR, Ho KJ, Madenci A, Ozaki CK, Nguyen LL, Belkin M: Predictive factors of 30-day unplanned readmission after lower extremity bypass. J Vasc Surg. 2013, 57: 955-962.View ArticlePubMedGoogle Scholar
- Ashton CM, Kuykendall DH, Johnson ML, Wray NP, Wu L: The association between the quality of inpatient care and early readmission. Ann Intern Med. 1995, 122: 415-421.View ArticlePubMedGoogle Scholar
- Kossovsky MP, Sarasin FP, Perneger TV, Chopard P, Sigaud P, Gaspoz J: Unplanned readmissions of patients with congestive heart failure: do they reflect in-hospital quality of care or patient characteristics?. Am J Med. 2000, 109: 386-390.View ArticlePubMedGoogle Scholar
- Braithwaite D, Moore DH, Satariano WA, Kwan ML, Hiatt RA, Kroenke C, Caan BJ: Prognostic impact of comorbidity among long-term breast cancer survivors: results from the LACE study. Cancer Epidemiol Biomarkers Prev. 2012, 21: 1115-1125.View ArticlePubMedPubMed CentralGoogle Scholar
- Dai YT, Wu SC, Weng R: Unplanned hospital readmission and its predictors in patients with chronic conditions. J Formos Med Assoc. 2002, 101: 779-785.PubMedGoogle Scholar
- Wong EL, Cheung AW, Leung MC, Yam CH, Chan FW, Wong FY, Yeoh EK: Unplanned readmission rates, length of hospital stay, mortality, and medical costs of ten common medical conditions: a retrospective analysis of Hong Kong hospital data. BMC Health Serv Res. 2011, 11: 149-View ArticlePubMedPubMed CentralGoogle Scholar
- Clark RM, Growdon WB, Wiechert A, Boruta D, Del CM, Goodman AK, Bradford L, Rauh-Hain A, Schorge JO: Patient, treatment and discharge factors associated with hospital readmission within 30 days after surgical cytoreduction for epithelial ovarian carcinoma. Gynecol Oncol. 2013, 130: 407-410.View ArticlePubMedGoogle Scholar
- Gruneir A, Bell CM, Bronskill SE, Schull M, Anderson GM, Rochon PA: Frequency and pattern of emergency department visits by long-term care residents–a population-based study. J Am Geriatr Soc. 2010, 58: 510-517.View ArticlePubMedGoogle Scholar
- Hansagi H, Olsson M, Sjoberg S, Tomson Y, Goransson S: Frequent use of the hospital emergency department is indicative of high use of other health care services. Ann Emerg Med. 2001, 37: 561-567.View ArticlePubMedGoogle Scholar
- Rask KJ, Williams MV, McNagny SE, Parker RM, Baker DW: Ambulatory health care use by patients in a public hospital emergency department. J Gen Intern Med. 1998, 13: 614-620.View ArticlePubMedPubMed CentralGoogle Scholar
- Lyratzopoulos G, Havely D, Gemmell I, Cook GA: Factors influencing emergency medical readmission risk in a UK district general hospital: a prospective study. BMC Emerg Med. 2005, 5: 4-View ArticlePubMedPubMed CentralGoogle Scholar
- Suri MF, Qureshi AI: Readmission within 1 month of discharge among patients with acute ischemic stroke: results of the University HealthSystem Consortium Stroke Benchmarking study. J Vasc Interv Neurol. 2013, 6: 47-51.PubMedPubMed CentralGoogle Scholar
- Aranda JM, Johnson JW, Conti JB: Current trends in heart failure readmission rates: analysis of Medicare data. Clin Cardiol. 2009, 32: 47-52.View ArticlePubMedGoogle Scholar
- Richter CA, Kalenga JC, Rowe BH, Bresee LC, Tsuyuki RT: Practice patterns and outcomes in patients presenting to the emergency department with acute heart failure. Can J Cardiol. 2009, 25: e173-e178.View ArticlePubMedPubMed CentralGoogle Scholar
- Dharmarajan K, Hsieh AF, Lin Z, Bueno H, Ross JS, Horwitz LI, Barreto-Filho JA, Kim N, Suter LG, Bernheim SM, Drye EE, Krumholz HM: Hospital readmission performance and patterns of readmission: retrospective cohort study of Medicare admissions. BMJ. 2013, 347: f6571-View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2261/14/97/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.