Research article | Open | Open Peer Review | Published:
Using the LACE index to predict hospital readmissions in congestive heart failure patients
BMC Cardiovascular Disordersvolume 14, Article number: 97 (2014)
The LACE index has been used to predict the risk of unplanned readmission within 30 days after hospital discharge in both medical and surgical patients. The aim of this study is to validate the accuracy of using the LACE index in CHF patients.
This was a retrospective study. The LACE index score was calculated on each patient who was admitted to hospital due to an acute CHF exacerbation. Operational and clinical variables were collected from patients including basic clinical characteristics, length of hospitalization, comorbidities, number of previous ED visits in the past 6 months before the index admission, and the number of post discharge ED revisits at 30, 60, and 90 days. All variables were analyzed by multivariate logistic regression to determine the association between clinical variables and the hospital unplanned readmissions. C-statistic was used to discriminate those patients with high risk of readmissions.
Of the 253 patients included in the study, 24.50% (62/253) experienced unplanned readmission to hospital within 30 days after discharge. The LACE index was slightly higher in patients readmitted versus patients not readmitted (12.17 ± 2.22 versus 11.80 ± 1.92, p = 0.199). Adjusted odds ratios based on logistic regression of all clinical variables showed only the number of previous ED visits (OR 1.79, 95% CI 1.30-2.47, p < 0.001), history of myocardial infarction (OR 2.51, 95% CI 1.02-6.21, p = 0.045), and history of peripheral vascular disease (OR 10.75, 95% CI 1.52-75.73, p = 0.017) increased the risk of unplanned readmission within 30 days of hospital discharge. However, patients with high LACE scores (≥10) had a significantly higher rate of ED revisits (15.04% vs 0%) within 30 days from the index discharge than those with low LACE scores (p = 0.030).
The LACE index may not accurately predict unplanned readmissions within 30 days from hospital discharge in CHF patients. The LACE high risk index may have utility as a screening tool to predict high risk ED revisits after hospital discharge.
Readmission is considered a second admission to hospital within a short period of time (usually within 30 days) from hospital discharge and has been considered both costly and an indication of poor health care quality delivery [1, 2]. A recent study reported 30 days hospital readmission of approximately 20% among all Medicare patients with an estimated cost of 17.4 billion US dollars . In order to properly use and reduce the significant healthcare cost, a number of interventions designed to prevent and reduce hospital readmissions were reported by different studies. However, the success of these studies was largely dependent on proper identification of patients at high risk for readmission [4–6]. Several scoring systems have been reported to predict unplanned readmissions and the LACE index is one of the most commonly used systems in the US [1, 7–9].
The LACE index has been used to predict the risk of unplanned readmission or death within 30 days after hospital discharge in both medical and surgical patients. It includes the length of hospitalization stay (“L”), acuity of the admission (“A”), comorbidities of patients (“C”), and emergency department use of patients (“E”). Studies of the LACE index showed that higher LACE scores predicted higher patient readmissions (see detail in Table 1). In general, the LACE index score of greater than ten is considered patients at high risk for unplanned hospital readmissions . However, the results of the LACE index in predicting readmissions were controversial in different studies, especially lack of validation if applied to a particular patient population [10, 11].
Congestive heart failure (CHF) is one of the most common and severe diseases seen in the Emergency Department (ED) and is associated with very high hospital admissions and readmissions [12, 13]. Previous studies in CHF showed readmissions might be associated with length of hospitalization, medical comorbidities, frequent ED revisits, low literacy skills, and severity of illness [14–16]. In order to reduce high readmissions, it is suggested that high risk CHF patients need to be identified earlier and be linked to some intervention programs upon discharge [13, 17].
Therefore, the aim of this observational study was to externally validate the accuracy of using the LACE index to predict 30 days readmissions in CHF patients. Our secondary goal was to determine the potential independent risk factors that are predictive of readmission if the LACE index was determined unreliable.
Study Design and Population: This was a retrospective study of adult patients who presented to an urban publicly funded hospital ED with CHF exacerbations between June 2012 and June 2013. The study population included patients greater than 18 years of age. All patients were admitted to hospital from the ED due to CHF exacerbation. Patients receiving a discharge diagnosis of CHF based on criteria from the 9th edition of international classification of disease (ICD-9) code were included. The diagnosis of CHF was confirmed by cardiology consult notes, ICD-9 code discharge diagnosis, or recent echocardiography report. Recent echocardiography was defined as a study performed at either the index admission or within 6 months. For patients admitted more than once during the study period, only the initial admission was included. Study excluded patients who died in hospital or whose primary diagnosis was not CHF exacerbation. Study also excluded patients that were not admitted directly from ED due to an extreme small sample size (only 5 patients) likely causing significant bias. Hospital readmission was defined as all cause patient readmission from the ED for the second time within 30 days of the index admission. It is assumed that patient readmissions had not been arranged or planned if they presented directly to the ED prior to hospital readmission. This study was approved by the local John Peter Smith Health Network Institutional Review Board.
Clinical variables and data collection: Patient demographic data and their medical history records were reviewed using the electronic health record. Variables including age, gender, ethnicity, the number of previous ED visit within 6 months, the length of hospitalization stay (LOS), and the Charlson comorbidity index (CCI) were collected. The LACE index was then calculated as reported in previous studies [14–16]. Thirty days readmissions, mortality, and post discharge ED visits were also obtained from the electronic health record.
Statistics: Univariate comparisons between patients that were readmitted to hospital within 30 days versus those not readmitted were analyzed. The student t test was used for continuous data and the χ2 test was used for categorical data. To exclude potential confounding factors, all variables were then analyzed using multivariate logistic regression. C-statistic (area under the receiver operating characteristics) with 95% confidence intervals (CI) was used to assess the discriminatory power of the model and compare goodness of fit for logistic regression. A value of 0.5 indicates the model is no better than chance for making a prediction. A value of 0.7 or higher is considered statistically significant to identify a difference between groups. All other tests were two-sided with p value less than 0.05 considered statistically significant. Stata 12.0 statistical software (Stata Corp, College Station, TX, USA) was used for statistical data analysis.
The LACE index may not accurately predict unplanned readmissions
Between June 2012 and June 2013, a total of 343 patients were admitted to hospital with the primary admission diagnoses of CHF exacerbations. Among all these 343 patients, 5 patients were directly admitted from outside ED and the other 85 patients were admitted to hospital multiple times with CHF exacerbations. Therefore, a total of 253 patients were included in this study. The rate of unplanned readmission to hospital within 30 days of index discharge for this group was 24.50% (62/253). The average Charlson comorbidity index (CCI) score was 4.56 ± 0.98 and average LACE index score was 11.89 ± 2.00. Considering a higher LACE index (LACE ≥10) indicates higher unplanned readmissions, patients were divided into two groups based on their LACE index scores. There were no statistical significant difference on patient basic characteristics between these two groups including age, gender, and ethnicity (p > 0.05). However, our results also show no significant difference in readmissions between these two groups as well (High LACE group: 24.34% versus Low LACE group: 25.93%, p = 0.856). This indicates that a value of 10 may not accurately differentiate the low limit index score in terms of predicting unplanned readmissions in our CHF patients. In order to determine whether the LACE index itself is a reliable clinical decision tool and what is an accurate low limit index score above which the predictability of readmissions among high risk patients is improved, patients were stratified into two groups based on whether or not they experienced unplanned readmissions within 30 days of index discharge. The results of our study show the LACE index is slightly higher in patients that experienced readmissions versus those that did not (12.17 ± 2.22 versus 11.80 ± 1.92, p = 0.199).The LACE index in both groups was higher than 10 and no statistically significant difference was reached (Table 2). In addition, the C-statistic of logistic regression for the LACE index was 0.5610 (95% CI: 0.4771-0.6447) which was again not discriminative for predicting readmissions in the study population regardless whether or not patients achieved a high risk LACE index. Therefore, our results suggest that the LACE index may not accurately predict for unplanned readmissions in CHF patients.
Frequent ED visits before the index admission and history of myocardial infarction or peripheral vascular disease might increase the risk of readmission within 30 days from index discharge in CHF patients.
All clinical variables were analyzed to determine potential independent risk factors that could predict readmission more accurately than the LACE index. In order to avoid confounding factors, a multivariate logistic regression model was used for variable analysis. Our results showed only three clinical variables demonstrate significant differences between patients readmitted within 30 days of discharge versus those not readmitted. These independent risk factors included (1) the number of ED visits in the past 6 months before the index admission (adjusted OR = 1.79), (2) history of myocardial infarction (MI, adjusted OR = 2.51), and (3) history of peripheral vascular diseases (PVD, adjusted OR = 10.75). Table 3 shows the adjusted odds ratios of clinical variables between the readmission versus non-readmission groups. Our findings suggest frequent prior ED visits and history of MI or PVD might increase the risk of readmissions within 30 days from hospital discharge in CHF patients.
LACE index can predict ED revisits more accurately than it predicts unplanned readmissions
Patients were followed up after 30, 60, and 90 days from the index discharge. Unplanned readmissions, deaths, and post discharge ED revisits were reviewed. We analyzed the role of the LACE index in the prediction of both unplanned hospital readmissions and post discharge ED revisits. Our results showed high risk patients (LACE ≥10) had slightly lower unplanned readmissions within 30 days from index discharge, however no significant statistical difference was reached between groups. Only one patient died within 30 days of hospital discharge and this patient fell into the high risk LACE index group. In addition, when extending unplanned readmissions analysis to 60 and 90 days, the LACE index again demonstrated poor prediction of readmissions. When ED revisits after the index hospital discharge were evaluated, our results show that patients with a high LACE score (≥10) had a higher rate of ED revisits (15.04%) within 30 days from index discharge, whereas, no patient with a low LACE score visited the ED within 30 days. The results were also consistent when extended up to 90 days from index discharge (Table 4). Using the LACE index to predict likelihood of ED revisits at 30, 60, and 90 days post discharge the odds ratios were 1.42, 1.29, and 1.23 separately (p < 0.01). The C-statistics associated with the LACE index were 0.66, 0.63, and 0.60 respectively (Figure 1). Taken together, our study shows the LACE index can predict ED revisits more accurately than unplanned readmissions after the index discharge.
Unplanned hospital readmissions are considered a marker of the quality of hospital care based on the underlying reason that return visits were related to premature discharge and inadequate treatment [18, 19]. This occurs commonly in the CHF population . The LACE index is an easy to use scoring tool that was reported by several studies to be accurate for predicting the risk of early death or unplanned readmission after discharge from hospital [17, 21, 22]. However, other studies showed poor performance of the LACE index in different patient populations [16, 23, 24]. Our results also show that use of the LACE index to identify high risk CHF patients for readmissions is not reliable.
Our study population had a high Charlson comorbidity index score (mean CCI = 4.56) resulting in a higher average LACE score (mean LACE score = 11.89). However, the population examined whereby the LACE index was initially derived had a mean CCI score of 0.5 and a mean LACE score of 6.0 which was much lower than our study population . This may, in part, explain the inconsistency of using the LACE index to predict readmissions in our study. In addition, our study population had relatively high psychosocial risks including transportation challenges, active psychiatric problems, lacking primary care physicians, less commercial insurance coverage, or no insurance which could lead to frequent ED visits. This phenomenon not only occurred in patients with frequent readmissions, it also occurred commonly in patients with no readmissions showing the high consistency in this study population (Table 2). Similar results from other studies showed the high occurrence of medication noncompliance, a lack of primary care follow up, and/or a lack of family support placed patients into a high risk group more likely to develop chronic disease exacerbations resulting in more frequent hospital readmissions [25–27]. Taken together, it is noted that due to significant differences in study populations, the LACE index may not reliably predict hospital readmissions accurately.
An independent risk factor that demonstrated reliable predictability of readmissions in our study was number of ED visits prior to the index admission. This suggests that frequent ED visits may result in a higher frequency of hospital readmissions. This could be related to a higher burden of chronic illness among these patients. Patients having chronic medical conditions may experience a higher frequency of ED visits, higher rates of hospital admissions, and more lengthy hospital stays [27, 28]. It could also be attributed to the extreme age reported in some studies [28, 29]. Our study results showed length of hospital stay, age, and CCI score had no significant difference regardless as to whether patients were readmitted or not. Further review of chronic illnesses in the study population showed that patients with a history of MI or PVD tended to have more hospital readmissions. Similar results are found within Medicare data reporting comorbidities including history of diabetes, MI, PVD, and stroke could predict a higher risk of readmissions in CHF patients . Previous studies found MI and CHF were the two most common diseases associated with high admissions and readmissions . The coexistence of these two chronic conditions is high . Our study confirmed the hypothesis and showed that CHF patients with history of MI experienced higher readmissions but did not discriminate as to whether or not MI was a consequence of CHF.
To the best of our knowledge, there is no previously published study that investigates the link between the LACE index and post index discharge ED revisits. Our study found that the LACE index can predict post discharge ED revisits more accurately than it predicts hospital readmissions though this predictability is not overwhelming (c < 0.7). A high LACE index predicts a high risk of post discharge ED visits when patients are followed up to 90 days post index discharge. Additionally patients with a low LACE index experienced no ED revisits within 30 days post index discharge. Our study also showed CHF patients with history of prior frequent ED visits are highly likely to have the same pattern of frequent ED revisits during the post index discharge period. This could be due, at least partially, to the high psychosocial risks and associated comorbidities in our study population. These patients tend to use the ED as their primary resource for health care. In addition, given the fact of other comorbidities affecting hospital readmissions indicates its complexity and multifactory. Since the LACE index is a user friendly tool, it is practical to screen CHF patients before hospital discharge to identify relatively high risk patients. With limited health care resources at their disposable, these CHF patients with a high risk LACE index can be prioritized to services linking them to community intervention programs. Several CHF intervention programs are now in place in our community providing an alternate resource for these patients and curbing ED overuse for health maintenance needs among them.
This is a retrospective study from a single urban tertiary care publicly funded hospital with a special patient population. Retrospective methodology limits its applicability in a way that includes bias regarding the accuracy of information, potential selection bias due to one institutional database, incomplete follow up data, and incomplete inter-subject data for analysis. In addition, as this study examines data associated only with patients admitted from the ED and excludes patients admitted from other primary care services this might also lead to patient selection bias. Second, all readmissions were reviewed and collected from hospital electronic health records. Patients that may have been admitted to other hospitals were not included in this study. This may contribute to incomplete follow up data. We did monitor other measures during the patient post-discharge period, such as follow up visits with primary care physicians and ED revisits. With many high risk psychosocial patients in our study population a certain number of them were lost to follow up which may also lead to incomplete and/or inaccurate analysis of data. A multicenter prospective study is required to more accurately identify CHF patients at high risk of hospital readmission and ED revisits and to further validate the results of this study.
In conclusion, our study shows application of the LACE index to identify CHF patients at high risk for unplanned readmissions within 30 days of discharge may not be reliable. Better predictors of high risk readmissions among CHF patients may be 1) number of previous ED visits, 2) history of MI, 3) and/or history of PVD. A LACE high risk index may have the best application in predicting the likelihood of ED revisits in the post index discharge period and therefore be of particular interest in linking these patients to alternate community healthcare services thereby curbing ED overuse among this population.
Ben-Chetrit E, Chen-Shuali C, Zimran E, Munter G, Nesher G: A simplified scoring tool for prediction of readmission in elderly patients hospitalized in internal medicine departments. Isr Med Assoc J. 2012, 14: 752-756.
Balla U, Malnick S, Schattner A: Early readmissions to the department of medicine as a screening tool for monitoring quality of care problems. Medicine (Baltimore). 2008, 87: 294-300.
Jencks SF, Williams MV, Coleman EA: Rehospitalizations among patients in the Medicare fee-for-service program. N Engl J Med. 2009, 360: 1418-1428.
Stewart S, Vandenbroek AJ, Pearson S, Horowitz JD: Prolonged beneficial effects of a home-based intervention on unplanned readmissions and mortality among patients with congestive heart failure. Arch Intern Med. 1999, 159: 257-261.
Stewart S, Marley JE, Horowitz JD: Effects of a multidisciplinary, home-based intervention on unplanned readmissions and survival among patients with chronic congestive heart failure: a randomised controlled study. Lancet. 1999, 354: 1077-1083.
McAlister FA, Youngson E, Bakal JA, Kaul P, Ezekowitz J, van Walraven C: Impact of physician continuity on death or urgent readmission after discharge among patients with heart failure. CMAJ. 2013, 185: E681-E689.
van Walraven C, Wong J, Forster AJ: LACE + index: extension of a validated index to predict early death or urgent readmission after hospital discharge using administrative data. Open Med. 2012, 6: e80-e90.
van Walraven C, Dhalla IA, Bell C, Etchells E, Stiell IG, Zarnke K, Austin PC, Forster AJ: Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. 2010, 182: 551-557.
Gruneir A, Dhalla IA, van Walraven C, Fischer HD, Camacho X, Rochon PA, Anderson GM: Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Med. 2011, 5: e104-e111.
Cotter PE, Bhalla VK, Wallis SJ, Biram RW: Predicting readmissions: poor performance of the LACE index in an older UK population. Age Ageing. 2012, 41: 784-789.
Tan SY, Low LL, Yang Y, Lee KH: Applicability of a previously validated readmission predictive index in medical patients in Singapore: a retrospective study. BMC Health Serv Res. 2013, 13: 366-
Gwadry-Sridhar FH, Flintoft V, Lee DS, Lee H, Guyatt GH: A systematic review and meta-analysis of studies comparing readmission rates and mortality rates in patients with heart failure. Arch Intern Med. 2004, 164: 2315-2320.
Pandor A, Gomersall T, Stevens JW, Wang J, Al-Mohammad A, Bakhai A, Cleland JG, Cowie MR, Wong R: Remote monitoring after recent hospital discharge in patients with heart failure: a systematic review and network meta-analysis. Heart. 2013, 99: 1717-1726.
Au AG, McAlister FA, Bakal JA, Ezekowitz J, Kaul P, van Walraven C: Predicting the risk of unplanned readmission or death within 30 days of discharge after a heart failure hospitalization. Am Heart J. 2012, 164: 365-372.
Islam T, O'Connell B, Lakhan P: Hospital readmission among older adults with congestive heart failure. Aust Health Rev. 2013, 37: 362-368.
McNaughton CD, Collins SP, Kripalani S, Rothman R, Self WH, Jenkins C, Miller K, Arbogast P, Naftilan A, Dittus RS, Storrow AB: Low numeracy is associated with increased odds of 30-day emergency department or hospital recidivism for patients with acute heart failure. Circ Heart Fail. 2013, 6: 40-46.
Ellery S, Pakrashi T, Paul V, Sack S: Predicting mortality and rehospitalization in heart failure patients with home monitoring–the Home CARE pilot study. Clin Res Cardiol. 2006, 3 (Suppl 3): III29-III35.
McPhee JT, Barshes NR, Ho KJ, Madenci A, Ozaki CK, Nguyen LL, Belkin M: Predictive factors of 30-day unplanned readmission after lower extremity bypass. J Vasc Surg. 2013, 57: 955-962.
Ashton CM, Kuykendall DH, Johnson ML, Wray NP, Wu L: The association between the quality of inpatient care and early readmission. Ann Intern Med. 1995, 122: 415-421.
Kossovsky MP, Sarasin FP, Perneger TV, Chopard P, Sigaud P, Gaspoz J: Unplanned readmissions of patients with congestive heart failure: do they reflect in-hospital quality of care or patient characteristics?. Am J Med. 2000, 109: 386-390.
Braithwaite D, Moore DH, Satariano WA, Kwan ML, Hiatt RA, Kroenke C, Caan BJ: Prognostic impact of comorbidity among long-term breast cancer survivors: results from the LACE study. Cancer Epidemiol Biomarkers Prev. 2012, 21: 1115-1125.
Dai YT, Wu SC, Weng R: Unplanned hospital readmission and its predictors in patients with chronic conditions. J Formos Med Assoc. 2002, 101: 779-785.
Wong EL, Cheung AW, Leung MC, Yam CH, Chan FW, Wong FY, Yeoh EK: Unplanned readmission rates, length of hospital stay, mortality, and medical costs of ten common medical conditions: a retrospective analysis of Hong Kong hospital data. BMC Health Serv Res. 2011, 11: 149-
Clark RM, Growdon WB, Wiechert A, Boruta D, Del CM, Goodman AK, Bradford L, Rauh-Hain A, Schorge JO: Patient, treatment and discharge factors associated with hospital readmission within 30 days after surgical cytoreduction for epithelial ovarian carcinoma. Gynecol Oncol. 2013, 130: 407-410.
Gruneir A, Bell CM, Bronskill SE, Schull M, Anderson GM, Rochon PA: Frequency and pattern of emergency department visits by long-term care residents–a population-based study. J Am Geriatr Soc. 2010, 58: 510-517.
Hansagi H, Olsson M, Sjoberg S, Tomson Y, Goransson S: Frequent use of the hospital emergency department is indicative of high use of other health care services. Ann Emerg Med. 2001, 37: 561-567.
Rask KJ, Williams MV, McNagny SE, Parker RM, Baker DW: Ambulatory health care use by patients in a public hospital emergency department. J Gen Intern Med. 1998, 13: 614-620.
Lyratzopoulos G, Havely D, Gemmell I, Cook GA: Factors influencing emergency medical readmission risk in a UK district general hospital: a prospective study. BMC Emerg Med. 2005, 5: 4-
Suri MF, Qureshi AI: Readmission within 1 month of discharge among patients with acute ischemic stroke: results of the University HealthSystem Consortium Stroke Benchmarking study. J Vasc Interv Neurol. 2013, 6: 47-51.
Aranda JM, Johnson JW, Conti JB: Current trends in heart failure readmission rates: analysis of Medicare data. Clin Cardiol. 2009, 32: 47-52.
Richter CA, Kalenga JC, Rowe BH, Bresee LC, Tsuyuki RT: Practice patterns and outcomes in patients presenting to the emergency department with acute heart failure. Can J Cardiol. 2009, 25: e173-e178.
Dharmarajan K, Hsieh AF, Lin Z, Bueno H, Ross JS, Horwitz LI, Barreto-Filho JA, Kim N, Suter LG, Bernheim SM, Drye EE, Krumholz HM: Hospital readmission performance and patterns of readmission: retrospective cohort study of Medicare admissions. BMJ. 2013, 347: f6571-
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2261/14/97/prepub
The authors declare no competing interests.
HW conceived of the study, participated in the study design, data collection, statistical analysis, data interpretation, and drafted the manuscript. RDR participated in the study design, data interpretation, coordination, and helped to draft the manuscript. CJ participated data collection and interpretation. NRZ participated in the design of the study, coordination, and helped to draft the manuscript. RDJ participated in the data collection and performed the statistical analysis. JK participated in the data collection and helped to draft the manuscript. KAD participated in the study design and helped to draft the manuscript. All authors read and approved the final manuscript.