Skip to main content

Prognostic nomogram for 30-day mortality of deep vein thrombosis patients in intensive care unit

Abstract

Background

We aimed to use the Medical Information Mart for Intensive Care III database to build a nomogram to identify 30-day mortality risk of deep vein thrombosis (DVT) patients in intensive care unit (ICU).

Methods

Stepwise logistic regression and logistic regression with least absolute shrinkage and selection operator (LASSO) were used to fit two prediction models. Bootstrap method was used to perform internal validation.

Results

We obtained baseline data of 535 DVT patients, 91 (17%) of whom died within 30 days. The discriminations of two new models were better than traditional scores. Compared with simplified acute physiology score II (SAPSII), the predictive abilities of two new models were improved (Net reclassification improvement [NRI] > 0; Integrated discrimination improvement [IDI] > 0; P < 0.05). The Brier scores of two new models in training set were 0.091 and 0.108. After internal validation, corrected area under the curves for two models were 0.850 and 0.830, while corrected Brier scores were 0.108 and 0.114. The more concise model was chosen to make the nomogram.

Conclusions

The nomogram developed by logistic regression with LASSO model can provide an accurate prognosis for DVT patients in ICU.

Peer Review reports

Background

Patients in ICU are at a high risk of developing DVT. Among patients who do not receive anticoagulation therapy in ICU, the prevalence of DVT is between 10 and 80% [1]. According to the classical Virchow’s triad, the stagnation of blood flow in patients within ICU due to long-term bedridden is an important factor that makes them more likely to suffer from DVT [2, 3]. In addition, endothelial damage caused by mechanical ventilation, catheterization and infection also increases the risk [2]. DVT is one kind of venous thromboembolism (VTE), which can cause acute pulmonary embolism (PE) if thrombi in lower extremity falls and flows back to the lung [4, 5]. Current guidelines recommend anticoagulation or thrombolytic therapy for patients with DVT found in ICU [5]. However, since patients in ICU are often complicated with multiple organ dysfunction or renal failure, anticoagulation or thrombolysis may cause major bleeding and lead to death [6, 7]. Therefore, DVT in ICU is in urgent need of attention. Patients in ICU are characterized by dynamic changes in thrombosis threshold and bleeding risk from day to day [2], which causes fluctuations in the mortality risk and brings challenges for doctors to make clinical decisions. The establishment of relevant scoring or prediction models can assist doctors in ICU to make important decisions in a short time. However, there is lack of a scoring model for predicting the risk of mortality of DVT patients in ICU. The existing scores associated with DVT, like Wells, Padua and Caprini, are not suitable for critically ill patients [8,9,10], and also can’t predict future mortality [11,12,13]. We hoped to fully include the initial admission information of DVT patients in ICU, consisting of general status, comorbidity information and important laboratory indicators to make a concise prediction model and present as nomogram for predicting the risk of 30-day mortality.

Nomogram is a graphical calculation tool designed to perform complex calculations quickly. Because of the trend of precision medicine and the aim to reach the simplicity of clinical decision-making, nomogram is widely used in medical treatment, especially in clinical predictive modeling [14, 15]. We also presented our prediction model as nomogram in this study in order to promote the decision-making ability for DVT patients in ICU in the future.

Methods

Data retrieval

The data used in this study was obtained from Medical Information Mart for Intensive Care III (MIMIC-III) database. The MIMIC-III database integrates information on more than 50,000 ICU hospitalized patients from Beth Israel Deaconess Medical Center in Boston, Massachusetts from 2001 to 2012.[16]. MIMIC database uses international classification of diseases (ICD)-9 diagnostic code to define the patient’s condition, which we used to select the baseline data of patients diagnosed as lower extremity DVT (ICD-9 diagnostic code including 45340, 45341, 45342, 45350, 45351 and 45352). We extracted the admission data and clinical outcomes of all patients diagnosed as DVT. The admission data included general condition, comorbidity information, laboratory indicators and severity scores. The clinical outcome was defined as all-cause death within 30 days after admission. Variables with missing data of more than 30% were excluded. In the general admission condition of patients, heart rate, systolic blood pressure, diastolic blood pressure, respiratory rate, body temperature, percutaneous oxygen saturation (spO2) and blood glucose were all the average values of the data collected on first day of ICU admission. In laboratory indicators, red blood cell volume distribution width (RDW), lymphocyte, monocyte, neutrophil, hematocrit, white blood cell and platelet count, blood sodium, blood potassium, serum anion gap, serum bicarbonate, serum chloride, blood urea nitrogen, serum creatinine, albumin, hemoglobin, serum lactate, partial thromboplastin time (PTT) and prothrombin time (PT) were all defined as the average values of data collected on the first day of admission or the earliest day after admission if detection delayed. Neutrophil-to-lymphocyte ratio (NLR) and lymphocyte-to-monocyte ratio (LMR) were also accessed using laboratory data detected at the first time. The comorbidity information and severity scores of each patient were collected using the code on github [17] to establish materialized views and extract relevant information on the PostgreSQL software. Comorbidity information was the ICD-9 diagnosis of patient who was admitted to hospital at the same time.

Statistical analysis

In the baseline data of patients, continuous variables with normal distribution would be represented by mean with standard deviation (SD), compared with t-test. Continuous variables with abnormal distribution would be represented by median and interquartile range, compared with Wilcoxon rank-sum test. Categorical variables would be represented by frequency and percentage, compared with chi-square test. We used general conditions, comorbidity information and laboratory indicators from patients’ baseline data as candidate variables to develop new models. First of all, we transformed the variables including RDW, monocyte, creatinine, lactate, NLR and LMR which with abnormal distribution to new variables that conformed to normal distribution (we used a stable and large value of 50 minus each value of RDW to get a new variable, and monocyte, creatinine, lactate, NLR and LMR were transformed using the logarithm of 10 to construct new variables). For some variables that contained outliers (glucose and anion gap) and would affect the stability of the final model, we truncated them at 1% and 99%. Then we performed single imputation for the whole dataset based on the complete conditional specification and used predictive mean matching method to fill the missing value. Each incomplete variable was estimated by an independent model to ensure the validity of the imputation results. This process was implemented using the “mice” package in R software (Version: 3.6.1) [18]. For the convenience of using the model in clinic, we chose to convert all continuous variables into categorical variables. We used restricted cubic splines to detect the linear relationship between continuous variables and clinical outcome. Group transformations according to the analysis of restricted cubic splines were carried out for continuous variables that were not linear with the clinical outcome [19]. For the continuous variables that had a linear relationship with the outcome, the best categorical cut-off value of them would be determined by clinical significance or the analysis of the receiver operating characteristic (ROC) curves where the Youden index reached the maximum.

Model building

Firstly, we used stepwise logistic regression to fit the model with all candidate variables and the outcome of 30-day mortality, and selected the model with the smallest akaike information criterion (AIC). Considering the convenience of clinical application, we then used LASSO to screen all candidate variables. LASSO can help to simplify the model by increasing penalty coefficients λ to compress the estimate of each variable [20]. After that, less variables were selected according to LASSO results and clinical significance. Multivariate logistic regression was then used to fit a more concise model. After building two new models using stepwise logistic regression and logistic regression with L1 regularization (i.e. LASSO), these two new models were used to calculate the discrimination and calibration in the original training set. Discrimination was measured by area under the curves (AUC) and calibration was measured by Brier score. The Brier score was calculated as the following formula:

$$\mathrm{Brier\, Score}=\frac{1}{N}\sum_{t=1}^{N}{({f}_{t}-{o}_{t})}^{2}$$

In the formula, N represents the total number of predictions, \({f}_{t}\) represents the actual results and \({o}_{t}\) represents the prediction probability of the model. Then AUC, NRI and IDI were used as indicators to compare predictive abilities of two new models and traditional scoring models. Bootstrap was used to validate the two new models internally and the number of repetitions was set as 100 [21]. Finally, for the convenience of clinical application, we made a nomogram according to the model fitted by logistic regression with LASSO. The above data processing was done in R software (Version: 3.6.1).

Results

Of all 535 DVT patients enrolled in this study, 91 patients died within 30 days after admission. In the previous data cleaning, we removed variables that had more than 30% missing data, including most of the variables for blood gas analysis. In remaining variables, missing data of lactate and albumin were more than 20%; Missing data of other variables were no more than 10%. The top five variables with most missing data were albumin, lactate, LMR, NLR and neutrophils. Clinical outcome had none missing data. Figure 1 shows the situation of missing values. The statistical description and univariate analysis of baseline data of patients is shown in Table 1. After classifying all the continuous variables into categorical variables, we incorporated the general condition, comorbidity information and laboratory indicators of all 535 patients’ baseline data into the stepwise logistic regression model. Among them, the location of DVT in patients was excluded because of its uncertain classification, and monocyte was excluded because of poor prediction of outcome. The specific classification of variables is shown in Additional file 1: Table S1. Finally, AIC of the stepwise logistic regression model was 356.75, and 18 variables were included in the model. In order to further simplify the model, we used LASSO to screen all the candidate variables of 535 patients. Then tenfold cross validation for logistic regression was conducted to help select the suitable penalty coefficient λ. The relationship between penalty coefficient λ and variables remaining in the model is shown in Fig. 2. Finally, the penalty coefficient λ as 0.0536 and a model consisting of 8 variables were chosen. The selected 8 variables were then put into multivariable logistic regression to fit the model. The AIC of logistic regression with LASSO model was 382.96. The variables and their coefficients in stepwise logistic regression model and logistic regression with LASSO model are shown in Table 2. ROC curves were then conducted to show the predictive abilities of two new models, SAPSII, oxford acute severity of illness score (OASIS) and sequential organ failure assessment (SOFA) on the clinical outcome of DVT patients. The results showed that the AUC of stepwise logistic regression was the best, which was 0.885 (95% confidence intervals [CI]: 0.849–0.921). The second was the logistic regression with LASSO model, AUC of which was 0.845 (95% CI: 0.804–0.885). Among the three severity scores, AUC of SAPSII took the highest, which was 0.781 (95% CI: 0.732–0.831). The ROC curves are shown in Fig. 3. Then, we evaluated the calibration of stepwise logistic regression model and logistic regression with LASSO model in the original training set. The results showed that the Brier score of stepwise logistic regression model was 0.091, and the Brier score of logistic regression with LASSO model was 0.108. Calibration curves of two new models are shown in Fig. 4. Then NRI and IDI were used to evaluate the improvement of predictive abilities of two new models compared with SAPSII. The classification nodes of risk of mortality were set as 0.2, 0.6 and 0.8. The results showed that the prediction or classification abilities of the stepwise logistic regression model and logistic regression with LASSO model were both better than SAPSII (NRI [categorical and continuous] both > 0; IDI both > 0), and there were statistical significances. Related results about NRI and IDI are shown in Table 3. After using bootstrap for internal validation, the corrected AUC and Brier score of the stepwise logistic regression were 0.850 and 0.105, respectively. And for logistic regression with LASSO model, the results were 0.830 and 0.114, respectively. Related results about internal validation of two new models are shown in Table 4. Although the prediction ability of stepwise logistic regression model was better than that of logistic regression with LASSO model in further analysis (NRI [Continuous] = 0.658 [95% CI 0.442–0.873]; IDI = 0.113 [95% CI 0.071–0.155]; P < 0.001), considering the convenience of clinical application of the model and the good enough prediction ability of logistic regression with LASSO model, logistic regression with LASSO model was chosen to make a nomogram. Finally, the converted new variables (transformed from lactate and NLR) in logistic regression with LASSO model were converted back to the original data form to facilitate clinical application. The final nomogram is shown in Fig. 5, which contains 8 variables.

Fig. 1
figure1

Situation of data missing. The histograms on the lower left represent the number of missing values of the top five variables which have most missing data, while the vertical line on the lower right and the histograms above represent the situation of common deletions. Among them, lactate and albumin are more deficient, missing data of which are both more than 20% of themselves. NA not available, NLR neutrophil-to-lymphocyte ratio, LMR lymphocyte-to-monocyte ratio

Table 1 Baseline data of DVT patients
Fig. 2
figure2

Cross-validation of logistic regression with LASSO. Lower abscissa represents the continuous increase of penalty coefficient λ, and the upper represents the continuous decrease of variables in the model from left to right. The ordinate represents corresponding binomial deviation (or minimum mean cross-validated error) of each model. The black dotted line represents the model with the least binomial deviation while the red one represents the model including eight variables we selected in this study. Line segment of each model represents 95% CI of binomial deviation. LASSO least absolute shrinkage and selection operator, CI confidence interval

Table 2 Variables and coefficients included in stepwise logistic regression model and logistic regression with LASSO model
Fig. 3
figure3

ROC curves of two new models and traditional scores. ROC receiver operating characteristic, AUC area under the curve, CI confidence interval, LASSO least absolute shrinkage and selection operator, SAPSII simplified acute physiology score II, OASIS oxford acute severity of illness score, SOFA sequential organ failure assessment

Fig. 4
figure4

Calibration curves of two new models. a Represents the calibration curve of stepwise logistic regression model, b represents the calibration curve of logistic regression with LASSO model. Calibration curve shows the mean predicted probability of outcome against the observed proportion of clinical outcomes. LASSO least absolute shrinkage and selection operator

Table 3 Improvement in prediction abilities of two new models compared with SAPSII score
Table 4 Corrected performance of two new models after internal validation
Fig. 5
figure5

The nomogram obtained from the logistic regression with LASSO model. a If a patient meets the target requirement in each variable, he/she will be given a score according to the points above (considering that the nomogram is difficult to calculate with naked eyes, the score that each indicator get has been pointed out). The total score obtained by adding up the scores of all indicators can be compared with the risk of 30-day death probability below. b A simple case analysis: a 64 years old female got deep vein thrombosis when admitted to intensive care unit. She had complications of sepsis and metastatic cancer. Her systolic blood pressure was 107 mmHg. After laboratory test, her blood urea nitrogen was 32 mg/dL, albumin was 2.5 g/dL, lactate was 3.2 mmol/L and NLR was 10.7. According to our nomogram, she finally got 416 score and a 30-day death probability that higher than 0.75. LASSO least absolute shrinkage and selection operator, NLR neutrophil-to-lymphocyte ratio

Discussion

This research used comprehensive data recorded in MIMIC-III to develop two complete models by using methods of stepwise logistic regression and logistic regression with LASSO. These two new models were verified to have good predictive abilities for 30-day mortality of DVT patients (AUC both > 0.8 in the original data and after internal validation), good calibration (Brier scores were 0.091 and 0.108 in original data set, 0.105 and 0.114 after internal validation) and improvement in predictive abilities compared with widely-used SAPSII score (NRI [categorical and continuous] both > 0; IDI both > 0; P both < 0.05). The model obtained by using logistic regression with LASSO only included 8 variables, which was more suitable for rapid decision-making in ICU and was used to make the final nomogram.

DVT is a common and critical disease in ICU, which not only increases the time of bed-staying, but also endangers patients’ lives [22, 23]. And since the critically ill patients in ICU are usually complicated with a variety of basic diseases, such as cancer and multiple organ dysfunction (organ dysfunction accounts for 54.6% of the total DVT patients, metastatic cancer accounts for 11.0% and solid tumor accounts for 5.2% in this study), anticoagulation or thrombolysis therapy may cause major bleeding and even death [2]. The condition of DVT patients in ICU brings difficulties and challenges for doctors, especially for non-cardiovascular surgeons. A good scoring system or nomogram can help doctors in ICU predict the risk of mortality of DVT patients so as to strengthen monitoring or change decision-making. However, there is still lack of a prediction model specifically built for DVT patients in ICU, and none of previous studies had evaluated the predictive abilities of SAPSII, OASIS and SOFA on mortality of DVT patients in ICU. This study showed that the SAPSII score had better discrimination in predicting 30-day mortality in patients with DVT in ICU (AUC = 0.781 [95% CI 0.732–0.831]), while the other two scores showed worse abilities (AUC both < 0.7). This might be due to the reason that OASIS score doesn’t contain laboratory indicators and comorbidity information, while SOFA focuses more on organ failure. There are more than 15 indicators in SAPSII scoring model, which is more complicated to use compared with the nomogram developed in this study. The advantage of visualization and the categorical indicators of nomogram also increase the convenience of clinical application. Therefore, we recommend that doctors refer to our nomogram to quickly and accurately assess the 30-day risk of mortality in patients with DVT in ICU.

Old age can lead to a poor prognosis in patients with DVT in ICU, which may be due to a high risk of bleeding, cardiopulmonary circulatory disorders, or decreased immunity and more susceptibility to infection [24]. Age is also a risk factor that is included in SAPSII and pulmonary embolism severity index (PESI) which is suitable for predicting mortality in patients with PE [25]. Since development of model is based on a specific population or disease, there will be differences in the classification criteria in different models. In this study, we chose 75 years old as the best classification cut-off value according to the analysis of ROC curve, which is different from SAPSII and PESI. Similarly, as for systolic blood pressure, different diseases have different classification criteria. Low systolic blood pressure and high systolic blood pressure are usually associated with poor clinical prognosis [26,27,28]. More attention should be paid to the harm caused by low systolic blood pressure in ICU because patients are in critical state and may be complicated with heart failure or other organ dysfunction. This study used 110 mmHg as the truncated standard of systolic blood pressure, which was different from PESI.

The nomogram included sepsis and metastatic cancer among the comorbidity information of patients, and metastatic cancer had the highest score of all variables. Sepsis is a common disease in ICU which is also related with high mortality [29]. From the perspective of Virchow triad, systemic bacterial infection and inflammation, as well as damage to endothelial cells are important factors in promoting thrombosis. Many studies have pointed out that patients with sepsis were prone to secondary thrombotic diseases [30, 31], which might increase the risk of acute PE and death or difficulty in anticoagulation therapy. Metastatic cancer is also an important predictor in SAPSII score. In this study, metastatic cancer accounted for 11.0% of the total DVT patients, and was significantly correlated with clinical outcomes in both univariate and multivariate analyses (P = 0.001 in univariate analyses, P < 0.001 in two multivariate models). Cancer cells can differentially express genes including rat sarcoma family, phosphatase and tensin homolog, and tumor protein p53 to influence the genesis of thrombosis, which makes cancer patients themselves hypercoagulable [32, 33]. And cancer patients often have central venous catheterization because they are in need of long-term infusion [34], which also damages the endothelial and increases the risk of thrombosis. However, patients with metastatic cancer complicated with DVT have an increased risk of major bleeding during anticoagulation or thrombosis therapy [35, 36], which undoubtedly makes it difficult to treat this kind of patients. Whether inside or outside ICU, concerns about bleeding risk and unknown thrombosis are great barriers and challenges for thrombolytic therapy for DVT [37]. The nomogram proposed in this study can also assist doctors in risk grading or treating of DVT patients complicated with sepsis or cancer in ICU.

Laboratory indicators can provide doctors with a reference to the condition and help judge the prognosis of patients. Nomogram in this study included 4 indicators: blood urea nitrogen, albumin, lactate and NLR. In previous studies, RDW and anion gap were considered to be related to the prognosis of ICU patients [38, 39]. However, these two variables were screened out in logistic regression with LASSO and they were not shown in the nomogram in this study. Blood urea nitrogen was included in our nomogram and also in SAPSII. Blood urea nitrogen is considered to be a key factor reflecting the complex relationship among nutritional status, protein metabolism and renal condition. In several indicators (glomerular filtration rate, creatine and blood urea nitrogen) that reflect the renal function, blood urea nitrogen is more sensitive in reflecting the status of heart failure [40]. A previous retrospective study showed that high blood urea nitrogen was related with poor prognosis in critically ill patients in ICU. And even after adjusted for renal failure, blood urea nitrogen was still an independent variable to predict poor prognosis [41]. This study also showed that blood urea nitrogen could predict 30-day mortality independently in patients with DVT in ICU and 18.5 mg/dL was set as the cut-off value of classification. Albumin is an important component of human body, which has a variety of functions, such as extracellular antioxidants, buffers, immunomodulators and antidotes, and can alleviate inflammation caused by bacterial infection [42]. Previous studies showed that plasma albumin levels were reduced in many critically ill patients, up to 50% in patients with a value of lower than 35 g/L [43]. Decrease of albumin will cause disorder of blood osmotic pressure and serum composition, and may also be related with the loss of liver function, which will increase the mortality risk of DVT patients. In this study, the classification cut-off value of albumin was 3 g/dL. Many previous studies have pointed out the relationship between high lactate content and high mortality or poor prognosis [44, 45]. In this study, lactate could be used as an independent variable to predict the clinical outcome as well, classification cut-off value of which was set as 2.25 mmol/L. NLR is an inflammatory indicator that can reflect the level of inflammation, which was also an important risk factor for predicting the clinical outcome in this study. Inflammation not only can promote thrombosis, but also has an important effect on the progression of DVT patients in ICU [46]. The classification cut-off value of NLR was set as 12.6.

Our research has several strengths. Firstly, our study is the first to develop a 30-day mortality risk score for DVT patients in ICU. Secondly, we used two methods to develop two complete models respectively and tested their predictive abilities in original training set and internal validation. Among them, LASSO belongs to machine learning and can simplify the model while ensuring the predictive ability of the model, which provides methodological convenience for us to make models suitable for clinical application. Thirdly, our final model for clinical application was presented as nomogram and all the included continuous variables were classified as categorical variables according to certain criteria, which provides great convenience for clinicians.

Our research also has limitations. Firstly, the missing data of albumin and lactate contained in the nomogram were both more than 20% before imputation, which may have an impact on the predictive ability of the model in external validation. Secondly, our study lacks data of blood gas analysis, for the reason that we found too much data missing in blood gas analysis in initial inclusion of variables. For the sake of the stability of the model, we cleaned out most of the variables of blood gas analysis though there were many variables that we considered to be excellent in predicting the clinical outcomes. Further studies can incorporate some items of blood gas analysis on the basis of our model to explore the predictive abilities of blood gas analysis on the mortality of patients with DVT. Thirdly, the clinical outcome we set was all-cause mortality rather than death directly related to DVT or embolic death (or PE), which was due to recording limitations of open database. And we can’t have access to the patient's clinical end point and do further follow up.

Conclusions

Using the data from the open database MIMIC-III, we developed two sets of prediction models for 30-day mortality risk of DVT patients in ICU with two statistical methods, and selected the more concise model to make a nomogram for clinical application. The prediction ability of the nomogram is better than traditional scores, and can be used in the decision-making of DVT which has a high prevalence in ICU.

Availability of data and materials

The datasets generated and/or analysed during the current study are available in the MIMIC-III critical care database, which can be accessed on https://mimic.physionet.org/ [16].

Abbreviations

ICU:

Intensive care unit

ICD:

International classification of diseases

DVT:

Deep vein thrombosis

VTE:

Venous thromboembolism

PE:

Pulmonary embolism

MIMIC-III:

Medical Information Mart for Intensive Care III

LASSO:

Least absolute shrinkage and selection operator

ROC:

Receiver operating characteristic

AIC:

Akaike information criterion

AUC:

Area under the curve

NRI:

Net reclassification improvement

IDI:

Integrated discrimination improvement

SAPSII:

Simplified acute physiology score II

OASIS:

Oxford acute severity of illness score

SOFA:

Sequential organ failure assessment

PESI:

Pulmonary embolism severity index

spO2:

Percutaneous oxygen saturation

RDW:

Red blood cell volume distribution width

PTT:

Partial thromboplastin time

PT:

Prothrombin time

NLR:

Neutrophil-to-lymphocyte ratio

LMR:

Lymphocyte-to-monocyte ratio

SD:

Standard deviation

SE:

Standard error

CI:

Confidence intervals

References

  1. 1.

    Geerts WH, Pineo GF, Heit JA, Bergqvist D, Lassen MR, Colwell CW, et al. Prevention of venous thromboembolism: the seventh ACCP conference on antithrombotic and thrombolytic therapy. Chest. 2004;126(3 Suppl):338S-400S.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  2. 2.

    Boddi M, Peris A. Deep vein thrombosis in intensive care. Adv Exp Med Biol. 2017;906:167–81.

    PubMed  Article  CAS  Google Scholar 

  3. 3.

    Shorr AF, Jackson WL Jr. Deep vein thrombosis in the intensive care unit: underappreciated, understudied, and undertreated. J Crit Care. 2005;20(4):301–3.

    PubMed  Article  Google Scholar 

  4. 4.

    Geerts W, Selby R. Prevention of venous thromboembolism in the ICU. Chest. 2003;124(6 Suppl):357S-S363.

    PubMed  Article  Google Scholar 

  5. 5.

    McLeod AG, Geerts W. Venous thromboembolism prophylaxis in critically ill patients. Crit Care Clin. 2011;27(4):765–80.

    PubMed  Article  PubMed Central  Google Scholar 

  6. 6.

    Arnold DM, Donahoe L, Clarke FJ, Tkaczyk AJ, Heels-Ansdell D, Zytaruk N, et al. Bleeding during critical illness: a prospective cohort study using a new measurement tool. Clin Investig Med. 2007;30(2):E93-102.

    Article  Google Scholar 

  7. 7.

    Cook D, Douketis J, Meade M, Guyatt G, Zytaruk N, Granton J, et al. Venous thromboembolism and bleeding in critically ill patients with severe renal insufficiency receiving dalteparin thromboprophylaxis: prevalence, incidence and risk factors. Crit Care. 2008;12(2):R32.

    PubMed  PubMed Central  Article  Google Scholar 

  8. 8.

    Barbar S, Noventa F, Rossetto V, Ferrari A, Brandolin B, Perlati M, et al. A risk assessment model for the identification of hospitalized medical patients at risk for venous thromboembolism: the Padua Prediction Score. J Thromb Haemost. 2010;8(11):2450–7.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  9. 9.

    Caprini JA, Arcelus JI, Reyna JJ. Effective risk stratification of surgical and nonsurgical patients for venous thromboembolic disease. Semin Hematol. 2001;38(2 Suppl 5):12–9.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  10. 10.

    Wells PS, Owen C, Doucette S, Fergusson D, Tran H. Does this patient have deep vein thrombosis? JAMA. 2006;295(2):199–207.

    CAS  PubMed  Article  Google Scholar 

  11. 11.

    Johnson AE, Kramer AA, Clifford GD. A new severity of illness scale using a subset of Acute Physiology And Chronic Health Evaluation data elements shows comparable predictive accuracy. Crit Care Med. 2013;41(7):1711–8.

    PubMed  Article  Google Scholar 

  12. 12.

    Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993;270(24):2957–63.

    PubMed  Article  PubMed Central  Google Scholar 

  13. 13.

    Vincent JL, de Mendonca A, Cantraine F, Moreno R, Takala J, Suter PM, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998;26(11):1793–800.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  14. 14.

    Park SY. Nomogram: an analogue tool to deliver digital knowledge. J Thorac Cardiovasc Surg. 2018;155(4):1793.

    PubMed  Article  PubMed Central  Google Scholar 

  15. 15.

    Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. 2015;16(4):e173–80.

    PubMed  PubMed Central  Article  Google Scholar 

  16. 16.

    Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  17. 17.

    Code for MIMIC-III database. https://github.com/MIT-LCP/mimic-code/tree/master/concepts/. Accessed 12 Mar 2020.

  18. 18.

    Zhang Z. Multiple imputation with multivariate imputation by chained equation (MICE) package. Ann Transl Med. 2016;4(2):30.

    PubMed  PubMed Central  Google Scholar 

  19. 19.

    Qu Y, Niu H, Li L, Li M, Yan S, Li M, et al. Analysis of dose-response relationship between BMI and hypertension in Northeastern China using restricted cubic spline functions. Sci Rep. 2019;9(1):18208.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  20. 20.

    Wu L, Chang W, Song Y, Wang L. Predicting treatment failure risk in a Chinese Drug-Resistant Tuberculosis with surgery therapy: development and assessment of a new predictive nomogram. Int J Infect Dis. 2020;96:88–93.

    PubMed  Article  PubMed Central  Google Scholar 

  21. 21.

    Schomaker M, Heumann C. Bootstrap inference when using multiple imputation. Stat Med. 2018;37(14):2252–66.

    PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    Boddi M, Barbani F, Abbate R, Bonizzoli M, Batacchi S, Lucente E, et al. Reduction in deep vein thrombosis incidence in intensive care after a clinician education program. J Thromb Haemost. 2010;8(1):121–8.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  23. 23.

    Cook D, Crowther M, Meade M, Rabbat C, Griffith L, Schiff D, et al. Deep venous thrombosis in medical-surgical critically ill patients: prevalence, incidence, and risk factors. Crit Care Med. 2005;33(7):1565–71.

    PubMed  Article  PubMed Central  Google Scholar 

  24. 24.

    Spandorfer J, Galanis T. In the clinic. Deep venous thrombosis. Ann Intern Med. 2015;162(9):1.

    Article  Google Scholar 

  25. 25.

    Aujesky D, Obrosky DS, Stone RA, Auble TE, Perrier A, Cornuz J, et al. A prediction rule to identify low-risk patients with pulmonary embolism. Arch Intern Med. 2006;166(2):169–75.

    PubMed  Article  PubMed Central  Google Scholar 

  26. 26.

    Brunstrom M, Carlberg B. Association of blood pressure lowering with mortality and cardiovascular disease across blood pressure levels: a systematic review and meta-analysis. JAMA Intern Med. 2018;178(1):28–36.

    PubMed  Article  PubMed Central  Google Scholar 

  27. 27.

    Weiss JW, Peters D, Yang X, Petrik A, Smith DH, Johnson ES, et al. Systolic BP and mortality in older adults with CKD. Clin J Am Soc Nephrol. 2015;10(9):1553–9.

    PubMed  PubMed Central  Article  Google Scholar 

  28. 28.

    Yang X, Hidru TH, Wang B, Han X, Li H, Wu S, et al. The link between elevated long-term resting heart rate and SBP variability for all-cause mortality. J Hypertens. 2019;37(1):84–91.

    CAS  PubMed  PubMed Central  Google Scholar 

  29. 29.

    Rello J, Valenzuela-Sanchez F, Ruiz-Rodriguez M, Moyano S. Sepsis: a review of advances in management. Adv Ther. 2017;34(11):2393–411.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  30. 30.

    Iba T, Levy JH. Inflammation and thrombosis: roles of neutrophils, platelets and endothelial cells and their interactions in thrombus formation during sepsis. J Thromb Haemost. 2018;16(2):231–41.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  31. 31.

    Levi M, Schultz M, van der Poll T. Sepsis and thrombosis. Semin Thromb Hemost. 2013;39(5):559–66.

    CAS  PubMed  Article  Google Scholar 

  32. 32.

    Regina S, Valentin JB, Lachot S, Lemarie E, Rollin J, Gruel Y. Increased tissue factor expression is associated with reduced survival in non-small cell lung cancer and with mutations of TP53 and PTEN. Clin Chem. 2009;55(10):1834–42.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  33. 33.

    Rong Y, Post DE, Pieper RO, Durden DL, Van Meir EG, Brat DJ. PTEN and hypoxia regulate tissue factor expression and plasma coagulation by glioblastoma. Cancer Res. 2005;65(4):1406–13.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  34. 34.

    Frere C, Debourdeau P, Hij A, Cajfinger F, Nonan MN, Panicot-Dubois L, et al. Therapy for cancer-related thromboembolism. Semin Oncol. 2014;41(3):319–38.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  35. 35.

    Bona RD, Hickey AD, Wallace DM. Warfarin is safe as secondary prophylaxis in patients with cancer and a previous episode of venous thrombosis. Am J Clin Oncol. 2000;23(1):71–3.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  36. 36.

    Hutten BA, Prins MH, Gent M, Ginsberg J, Tijssen JG, Buller HR. Incidence of recurrent thromboembolic and bleeding complications among patients with venous thromboembolism in relation to both malignancy and achieved international normalized ratio: a retrospective analysis. J Clin Oncol. 2000;18(17):3078–83.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  37. 37.

    Boonyawat K, Crowther MA. Venous thromboembolism prophylaxis in critically ill patients. Semin Thromb Hemost. 2015;41(1):68–74.

    PubMed  Article  PubMed Central  Google Scholar 

  38. 38.

    Jia L, Cui S, Yang J, Jia Q, Hao L, Jia R, et al. Red blood cell distribution width predicts long-term mortality in critically ill patients with acute kidney injury: a retrospective database study. Sci Rep. 2020;10(1):4563.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  39. 39.

    Chen Q, Chen Q, Li L, Lin X, Chang SI, Li Y, et al. Serum anion gap on admission predicts intensive care unit mortality in patients with aortic aneurysm. Exp Ther Med. 2018;16(3):1766–77.

    PubMed  PubMed Central  Google Scholar 

  40. 40.

    Filippatos G, Rossi J, Lloyd-Jones DM, Stough WG, Ouyang J, Shin DD, et al. Prognostic value of blood urea nitrogen in patients hospitalized with worsening heart failure: insights from the Acute and Chronic Therapeutic Impact of a Vasopressin Antagonist in Chronic Heart Failure (ACTIV in CHF) study. J Card Fail. 2007;13(5):360–4.

    PubMed  Article  PubMed Central  Google Scholar 

  41. 41.

    Arihan O, Wernly B, Lichtenauer M, Franz M, Kabisch B, Muessig J, et al. Blood Urea Nitrogen (BUN) is independently associated with mortality in critically ill patients admitted to ICU. PLoS ONE. 2018;13(1):e0191697.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  42. 42.

    Ha CE, Bhagavan NV. Novel insights into the pleiotropic effects of human serum albumin in health and disease. Biochim Biophys Acta. 2013;1830(12):5486–93.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  43. 43.

    Artigas A, Wernerman J, Arroyo V, Vincent JL, Levy M. Role of albumin in diseases associated with severe systemic inflammation: pathophysiologic and clinical evidence in sepsis and in decompensated cirrhosis. J Crit Care. 2016;33:62–70.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  44. 44.

    Nichol AD, Egi M, Pettila V, Bellomo R, French C, Hart G, et al. Relative hyperlactatemia and hospital mortality in critically ill patients: a retrospective multi-centre study. Crit Care. 2010;14(1):R25.

    PubMed  PubMed Central  Article  Google Scholar 

  45. 45.

    Singer AJ, Taylor M, Domingo A, Ghazipura S, Khorasonchi A, Thode HC Jr, et al. Diagnostic characteristics of a clinical screening tool in combination with measuring bedside lactate level in emergency department patients with suspected sepsis. Acad Emerg Med. 2014;21(8):853–7.

    PubMed  Article  PubMed Central  Google Scholar 

  46. 46.

    Rabinovich A, Cohen JM, Cushman M, Kahn SR, Bio SOXI. Association between inflammation biomarkers, anatomic extent of deep venous thrombosis, and venous symptoms after deep venous thrombosis. J Vasc Surg Venous Lymphat Disord. 2015;3(4):347-53e1.

    PubMed  Article  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The project is sponsored by National Natural Science Fundation of China (Project Approval Number is 81800420). The funding body played no role in the design of the study and collection, analysis, decision to publish, interpretation of data and in writing the manuscript.

Author information

Affiliations

Authors

Contributions

KH, MG and YGT designed the research study. RNS collected the data and performed analysis. QCC and XSG helped to perform programming. GTW, ZQX, GCY and ZLH helped to write the manuscript. All authors helped to revise the paper and approved the final version. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kai Huang.

Ethics declarations

Ethics approval and consent to participate

The access of the database was approved by the institutional review boards of both Beth Israel Deaconess Medical Center and Massachusetts Institute of Technology Affiliates after completing the CITI (Collaborative Institutional Training Initiative) “Data or Specimens Only Research” course. No informed consent was required since the data are anonymized.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Classification of variables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Shen, R., Gao, M., Tao, Y. et al. Prognostic nomogram for 30-day mortality of deep vein thrombosis patients in intensive care unit. BMC Cardiovasc Disord 21, 11 (2021). https://doi.org/10.1186/s12872-020-01823-4

Download citation

Keywords

  • Prognosis
  • Nomogram
  • Deep vein thrombosis
  • Intensive care unit
\