Skip to main content

Mortality prediction in patients with hyperglycaemic crisis using explainable machine learning: a prospective, multicentre study based on tertiary hospitals

Abstract

Background

Experiencing a hyperglycaemic crisis is associated with a short- and long-term increased risk of mortality. We aimed to develop an explainable machine learning model for predicting 3-year mortality and providing individualized risk factor assessment of patients with hyperglycaemic crisis after admission.

Methods

Based on five representative machine learning algorithms, we trained prediction models on data from patients with hyperglycaemic crisis admitted to two tertiary hospitals between 2016 and 2020. The models were internally validated by tenfold cross-validation and externally validated using previously unseen data from two other tertiary hospitals. A SHapley Additive exPlanations algorithm was used to interpret the predictions of the best performing model, and the relative importance of the features in the model was compared with the traditional statistical test results.

Results

A total of 337 patients with hyperglycaemic crisis were enrolled in the study, 3-year mortality was 13.6% (46 patients). 257 patients were used to train the models, and 80 patients were used for model validation. The Light Gradient Boosting Machine model performed best across testing cohorts (area under the ROC curve 0.89 [95% CI 0.77–0.97]). Advanced age, higher blood glucose and blood urea nitrogen were the three most important predictors for increased mortality.

Conclusion

The developed explainable model can provide estimates of the mortality and visual contribution of the features to the prediction for an individual patient with hyperglycaemic crisis. Advanced age, metabolic disorders, and impaired renal and cardiac function were important factors that predicted non-survival.

Trial Registration Number: ChiCTR1800015981, 2018/05/04.

Introduction

Hyperglycaemic crisis is one of the most serious acute metabolic complications of diabetes and includes three subtypes: diabetic ketoacidosis (DKA), hyperosmolar hyperglycaemic state (HHS), and mixed syndrome (combined DKA-HHS) [1]. Inpatients with DKA or recurrent DKA are all at high risk for all-cause mortality [2]. Among diabetic patients, 10% of deaths are caused by confirmed or possible DKA or coma [3]. HHS is common in elderly patients with diabetes mellitus. Despite a relatively low incidence, the mortality of hospitalized patients with HHS can reach up to 10–20% [4, 5]. Alarmingly, the 30-day mortality in patients with combined features of DKA and HHS is approximately 2.7 times higher than that in patients with isolated hyperglycaemic crisis [6]. In addition to a high risk of short-term mortality, patients with hyperglycaemic crisis episode have a higher long-term mortality after hospital discharge [1, 7]. At present, due to the poor understanding of the pathogenesis of hyperglycaemic crisis and the complexity of treatment, there is a lack of powerful indicators for evaluating the risk of mortality in patients with hyperglycaemic crisis [6]. Predicting the risk of mortality as well as providing personalized analysis of the risk factors in patients with hyperglycaemic crisis at initial diagnosis may help physicians to make correct clinical judgments and select the most appropriate strategy of treatment.

Much effort has been put into the development of prediction models to predict the risk of mortality for patients with hyperglycaemic crisis. Traditionally, linear models, such as logistic regression model and Cox proportional hazard model, have been used to develop such prediction models [8,9,10,11,12]. Nevertheless, modernhigh-dimensional and incomplete medical data present a challenge to traditional statistical models, and the low precision of linear models impedes patient-level use. Lacking adequate prediction tools, physicians mainly rely on subjective judgement, which is prone to errors and biases. Previous studies have applied machine learning to establish models for predicting the clinical outcomes of patients with diabetic complications and achieved promising results [13,14,15]. Compared with linear models, machine learning models can provide more accurate prediction results by fitting high-dimensional and nonlinear relationships in the data [16,17,18]. However, most of the developed prediction models were opaque and unexplainable. The improvement of model performance also brings corresponding disadvantages: these models might be perceived as black-box models due to complex computational processes, meaning that the clinician can only see the input and output of the model, and it is difficult to understand how the predictions are generated, which could reduce their acceptance among clinicians [19]. In our recent study, we developed an explainable machine learning model for predicting amputation rate in patients with diabetic foot [20]. The proposal of algorithms that could provide explanations for black-box models might increase the understanding of the model predictions and facilitate clinicians in making more accurate decisions using machine learning models [21]. There is a lack of tools to predict long-term mortality in patients with hyperglycaemic crisis. In addition, to our knowledge, no study has developed a tool to use the machine learning model for predicting mortality in patients with hyperglycaemic crisis directly interpretable. Of note, the predictions of machine learning models are expected to be transparent to enable physicians to better understand and utilize these tools.

Here, we developed a machine learning model for predicting the 3-year mortality of inpatients with hyperglycaemic crises. In addition, we utilized a tool to interpret the developed black-box machine learning model to obtain a method for individualized mortality prediction and risk factor analysis for patients with hyperglycaemic crisis.

Materials and methods

Study design and participants

For model development and validation, we prospectively collected data from patients with hyperglycaemic crises who were hospitalized at four university-affiliated tertiary teaching hospitals between May 2016 and May 2020. All patients were followed up until May 2021. The 3-year mortality rate was chosen as the prediction target because the study was designed to predict the long-term mortality risk of patients, and most of the patients included in the study were followed up for 3 years. The study was conducted in accordance with the Declaration of Helsinki and protocols were approved by the Ethics Committee of Chongqing University Central Hospital. Inpatients aged 18 or older diagnosed with hyperglycaemic crisis were enrolled in the study. Case definition of hyperglycaemic crisis on admission was: (1) DKA: plasma glucose ≥ 13.9 mmol/L, positive urine ketones or serum ketones, and serum bicarbonate ion concentration (HCO3−) ≤ 18 mmol/L or hydrogen ion concentration index (PH) ≤ 7.3; (2) HHS: plasma glucose ≥ 33.3 mmol/L, small urine ketones or serum ketones, HCO3−  ≥ 15 mmol/L or PH ≥ 7.3, and effective serum osmolality ≥ 320 mOsm/kg; (3) combined DKA-HHS: plasma glucose ≥ 33.3 mmol/L, positive urine ketones or serum ketones, HCO3−  ≤ 18 mmol/L or PH ≤ 7.3, and effective serum osmolality ≥ 320 mOsm/kg. The effective serum osmolality was calculated from the following equation: 2 × [Na+ (mEq/L)] + [plasma glucose (mmol/L)].

The blood glucose, serum sodium, serum potassium, PH, HCO3−, base excess, serum creatinine, blood urea nitrogen, cystatin C, creatine kinase, total cholesterol, low-density lipoprotein cholesterol, triglyceride, C-reactive protein, procalcitonin, creatinine kinase MB isoenzyme (CK-MB), alanine aminotransferase, and aspartate aminotransferase were measured using an automatic biochemical analyzer (AU5821, Beckman Coulter, USA). Hemoglobin A1c was measured by high-performance liquid chromatography (BC-6800, Mindray, Shenzhen, China). Cardiac troponin I was measured by chemiluminescence immunoassay, using DXI800 (Beckman Coulter, USA).β-hydroxybutyrate was measured using colorimetric enzymatic reaction (D-3-hydroxybutyrate kit, Ranbut, Randox Laboratories). White blood cells, neutrophils, lymphocyte, and platelet were determined by an automatic blood cell analyzer (BC-6800, Mindray, Shenzhen, China).

There were 41 input variables incorporated into this study to determine the prediction models, including demographic features, clinical and at-admission laboratory data, and comorbidities. The data were collected by reviewing electronic medical records (EHRs). 9 patients with missing values of variables greater than 30% and 14 patients who were lost to follow-up were excluded. The participants were divided into two groups: data from two tertiary teaching hospitals were used as the training set for model training, and data from the two other tertiary teaching hospitals were used as the test set for external validation.

Statistical analyses

Statistical analysis was applied among the groups. Continuous variables are presented as the mean ± standard deviation when data followed a normal distribution or as the median and interquartile range when the continuous variables were not found to be normal, and categorical variables were expressed as numbers (%). To evaluate significant differences between groups, the t test, Kruskal‒Wallis test, and chi-squared test were used for normal continuous, nonnormal continuous, and categorical variables, respectively. A P value < 0.05 was considered statistically significant.

Model development

The data were preprocessed before training the prediction model. Box diagrams was used to eliminate outliers from the raw dataset, the k-nearest neighbour algorithm was used for filling in the missing values, and the Z Score was utilized to normalize continuous variables.. To construct the prediction model, five algorithms were used: logical regression (LR), support vector machine (SVM), random forest (RF), light gradient boosting machine (LightGBM), and deep neural networks (DNNs). The DNN architecture used in this study was a feed-forward neural network. LR and SVM are classical machine learning algorithms commonly used in previous studies [22, 23]. RF and LightGBM are powerful algorithms in the machine learning area and are currently considered state-of-the-art algorithms for prediction with tabular data [24,25,26]. DNNs belong to an important branch of machine learning algorithms, achieving excellent performance in many fields, such as pattern recognition and natural language processing [18, 27]. Therefore, the above five algorithms were used for model building. Afterwards, tenfold cross-validation and Bayesian hyperparameter optimization were utilized for model training, internal validation and hyperparameter tuning. The generalization capacity of hyperparameter combinations was improved by tenfold cross-validation, and the efficiency of finding the optimal hyperparameter combination was improved by Bayesian hyperparameter optimization. Additional details on hyperparameter setting and model architecture are provided in Additional file 1: Fig. S1 and Tables S1–S6.

After model training was performed, the prediction ability of the models was evaluated and compared in the test set according to the evaluation metrics, including area under the receiver-operating-characteristic curve (AUC), sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV). Confidence intervals (CIs) were obtained by resampling the test set 1000 times (bootstrapping) and averaging the performance.

The best performing model was selected as the prediction model, and Platt scaling was further applied to calibrate the predicted probability of the best performing model to make it close to the observed probabilities. The test set was further divided in a 1:1 ratio into a calibration set for model calibration and a new test set for evaluating the performance of model calibration. The calibration curve and Brier score were used to assess the coherence between the predicted and observed probabilities of the prediction model.

Model explanation

The Shapley additive explanations (SHAP) algorithm was applied to the calibrated model to obtain explanations of the predictions of the model. The SHAP algorithm is one of the most popular model-agnostic algorithms for interpreting black-box model predictions [28, 29]. SHAP values were obtained by the SHAP algorithm, which provides interpretation of individual predictions. A SHAP value represents, given a set of feature values, how much a single feature value influences the difference between the actual prediction and the average prediction in its interaction with other feature values. Therefore, the mean prediction of the model plus the sum of the SHAP values for all features are consistent with the predicted result. Importantly, the SHAP value for a feature is not isolated but obtained by interacting with other features, which makes it different from the feature weight in the traditional generalized linear model.

To verify the rationality of the interpretation of the model predictions acquired by the SHAP algorithm, we first utilized the SHAP algorithm to obtain and visualize the overall effect of features on the predictions, that is, the contribution and relative importance ranking of each feature to the predictions. For further validation and comparison, we divided the patients in the training set into a survival group and a nonsurvival group according to their clinical outcomes and analysed the differences in features between the groups by statistical methods. In addition, based on proving the rationality of the explanations obtained by the SHAP algorithm, we further linearly mapped SHAP values to the probability of increased or decreased mortality and proposed a personalized mortality risk factor analysis method specific to patients with hyperglycaemic crisis, which visualized the contribution of each feature to the prediction in probability.

Results

For model development, 257 patients with hyperglycaemic crisis from two hospitals were enrolled. The baseline characteristics of these patients are depicted in Table 1. In the training set, the median age was 56 years (IQR 40.3–70.0), and 152 (59.1%) were male. Death occurred in 31 (12.1%) patients within the study period. To evaluate the external validity, the models were applied in the external test set, comprising 80 patients with hyperglycaemic crisis from two hospitals that were independent of the training set. In the test set, the receiver operating characteristic curve and AUC of the five models are shown in Fig. 1A (AUC = 1 indicates perfect prediction; AUC = 0 indicates random prediction). The other five evaluation metrics, including accuracy, sensitivity, specificity, NPV and PPV, for the five models are presented in Table 2. Overall, the findings demonstrated that the LightGBM model performed best among the five prediction models, with an AUC of 0.89 (95% CI 0.77, 0.97). The corresponding accuracy was 0.83 (0.74, 0.90), sensitivity was 0.74 (0.47, 0.94), specificity was 0.85 (0.76, 0.93), PPV was 0.52 (0.31, 0.74), and NPV was 0.94 (0.87, 0. 99). Therefore, the LightGBM model was selected as the best predictive model. The prediction probability of the LightGBM model was calibrated to make it close to the observed probability. The calibration plot indicated good agreement between the predicted and observed probabilities of the LightGBM model with a curve close to the 45° line, and the Brier score was 0.10 (0.05, 0.17) (Fig. 1B).

Table 1 Baseline characteristics of patients with hyperglycaemic crisis in the training set and test set
Fig. 1
figure 1

Discrimination and calibration performance of the models. A Receiver operating characteristic curves for the LR, SVM, RF, LightGBM, and DNN models. B Calibration curve for the LightGBM model

Table 2 The values of the evaluation metrics of the models in the test set

The contribution of each of the 41 features in the calibrated LightGBM model is shown in Fig. 2. The features were ranked by their relative importance to mortality prediction according to the SHAP values of the model predictions. It is not surprising that age was ranked as the most important feature for the prediction model, followed by blood glucose and blood urea nitrogen. In addition, taking the effect of age on the prediction as an example, older age was associated with a higher risk of death, and younger age drives the predictions towards survival. A similar explanation can be applied to other features, and most of the interpretation of features was consistent with clinical experience and previous evidence. Of note, features can drive the prediction in either direction (increase or decrease mortality prediction) in our explainable prediction model, which is different from the previous mortality risk scoring system based on a generalized linear model in which features can only drive mortality prediction in a single direction. As shown in Table 3, the results of statistical analysis revealed that the 9 most important features for the LightGBM model were significantly different between the survival group and the nonsurvival group in the training set (P < 0.05). Compared to the survival group, age, blood glucose, serum creatinine, blood urea nitrogen, cystatin C, effective serum osmolality, CK-MB, alanine aminotransferase, serum sodium, PH, HCO3 − and cardiac troponin I were significantly higher in the nonsurvival group (P < 0.05). However, hemoglobin A1c level was surprisingly significantly lower in the nonsurvival group than survival group (P < 0.05). An increasing trend of β-hydroxybutyrate was unexpectedly indicated in the survival group (P = 0.045). Therefore, the traditional statistical test results and the model interpretation results corroborated each other, which proved the rationality and accuracy of the interpretation of features acquired by the SHAP algorithm. Based on this evidence, we mapped SHAP values and proposed a personalized risk factor analysis tool for explaining the mortality prediction for a particular patient with hyperglycaemic crisis, which is a scale from 0 to 1, visualizing the contribution of each feature to the prediction in probability. We showed the application of the personalized risk factor analysis method in one deceased and one surviving patient with hyperglycaemic crisis during the follow-up period in the test set (Fig. 3). In the case of the deceased patient, the patient was an 88-year-old female with a history of septic shock and acute kidney injury. The model predicted that the risk of mortality of the patients was 0.623. Advanced age (88 years) drove a 0.58 increase in the risk of mortality, while relatively low hemoglobin A1c reduced the risk of mortality by 0.32. A similar explanation can be applied to other features. The prediction was driven by 41 features used for model training. The sum of the SHAP values for all features plus the baseline risk equals the predicted risk of mortality. The baseline risk (E[f(X)]) was obtained by calculating the average predicted risk of mortality among all patients in the training set. Thus, SHAP algorithm made our model explainable both in terms of the relative importance of individual features for survival of patient with hyperglycaemic crisis and those at patient level.

Fig. 2
figure 2

The impact of the input features on predictions. Each dot represents the effect of a feature on the prediction for one patient. The redder the colour of the dots, the higher the value of the features, and the bluer the colour of the dots, the lower the value of the features. Dots to the left x-axis represent patients with values of the features decreasing mortality prediction, and dots to the right x-axis represent patients with values of the features increasing mortality prediction

Table 3 Baseline characteristics of patients with hyperglycaemic crisis in the training set by clinical outcomes
Fig. 3
figure 3

Examples of personalized risk factors. A An example of personalized risk factor analysis for a patient in the test set (clinical outcome was death). B An example of personalized risk factor analysis for a patient in the test set (actual clinical outcome was survival)

Discussion

Experiencing a hyperglycaemic crisis is associated with a short- and long-term increased risk of mortality [1, 6, 7]. However, due to the complex pathogenesis of hyperglycaemic crisis, available international guidelines for the diagnosis and treatment of hyperglycaemic crisis are not consistent [4, 30]. In addition, there is a lack of strong indicators to assess the risk of mortality in patients with hyperglycaemic crisis. Therefore, the development of more effective methods to predict the risk of mortality, create individualized risk and benefit evaluations in patients with hyperglycaemic crises at initial diagnosis, which are particularly important to identify the best therapeutic strategies and improve the prognosis.

Here, we developed an explainable risk prediction model providing predictions and individualized risk factor assessment of the 3-year mortality of patients with hyperglycaemic crisis after admission. In the model building process, we selected five representative machine learning algorithms, including LR, SVM, RF, LightGBM, and DNN, to obtain the best prediction model. The LightGBM model performed the best of the five models evaluated in an external test set, with an AUC of 0.89. We further calibrated the LightGBM model to obtain a more reliable model. The SHAP algorithm was used to interpret the calibrated LightGBM model to obtain how each feature drives the prediction of the model. On the basis of verifying the effectiveness of the analytical method by comparing with the statistical test results, we further proposed a personalized mortality risk factor assessment method specific to patients with hyperglycaemic crisis. In the interpretation obtained by SHAP algorithm, the influence of each feature on the predictions is not isolated, but interacts with other features, which is related to the calculation method of SHAP value, and makes it different from the feature weight in the traditional generalized linear model.Thus, the developed explainable model can not only predict mortality but also provide a personalized risk factor assessment tool. Such an explainable model is a more useful tool than scoring systems based on generalized linear models that are currently implemented.

Most of the prediction tools constructed in past studies are based on generalized linear models, such as logistic regression models and Cox proportional hazard models [10, 11, 31]. However, the rapid development of information technology brings high-dimensional and nonlinear data, which challenges the traditional generalized linear model. Machine learning provides a powerful and novel method to extract information from complex medical data and develop more accurate predictions. That is, we can only obtain the input of the model and the output of the predictions. It is difficult to understand the details of how machine learning models analyse data and make decisions, which limited the application of the models at the individual level. A representative score called PHD was developed based on a generalized linear model by Huang et al. [10], which could be used to predict 30-day mortality risk and classify risk and disposition in patients with hyperglycaemic crisis. Since the variables we selected were different from the PHD score, the model we developed predicted the 3-year mortality of patients with hyperglycaemic crisis after admission. Therefore, we could not directly compare our model with the PHD score. However, an external validation study revealed that the AUC of the PHD score ranged from 0.357 to 0.727 [9]. In comparison, the AUC of the models developed in this study ranged from 0.63 to 0.89 in an external validation dataset. In addition, the developed LightGBM model also outperformed the conventional logistic regression model constructed in our study in the external test data (Fig. 1A, AUC of 0.89 vs. 0.63). We thus consider our model superior to traditional methods.

In addition, we used the SHAP algorithm to explain the black-box model to quantify and visualize the features that drive the predictions so that it not only had better prediction ability but also had transparency similar to that of the simple linear model. The tools established in this study combined the advantages of the complex machine learning model and simple linear model, solving the problems of insufficient prediction ability of the generalized linear model and black box nature of the machine learning model. The model we developed provided explanations of the risk factors that drive the model prediction, both in terms of the importance of individual features to the overall mortality prediction and contribution at the patient level. A comprehensible model allows clinicians to combine the predictions with their expertise to facilitate decision-making and assist clinicians in interventions [32, 33].

The effect of most features on the prediction is consistent with clinical experience and previous evidence. For example, advanced age, metabolic disorders, and impaired renal and cardiac function can predict for nonsurvival. Advanced age was the most important risk factor for mortality. There is substantial evidence that the physical function and resistance of patients decrease with age, which is more likely to increase the risk of mortality [12, 34, 35]. Severe metabolic disorders (elevated levels of blood glucose, effective serum osmolality, and serum sodium) may lead to confusion and even coma, which is associated with an increased risk of mortality [5, 36]. Likewise, there is consistent evidence that impaired renal (elevated levels of blood urea nitrogen, cystatin C, and serum creatinine,) and cardiac function (elevated levels of cardiac troponin I) increase the risk of mortality [1, 34, 37,38,39]. In addition, reduced levels of HbA1c drove the prediction towards nonsurvival. The effect of HbA1c on the prediction did not seem to live up to expectations. One reason for this counterintuitive issue might be that patients in the survival group had significantly better renal function than those in the nonsurvival group, and there is evidence that patients with chronic renal failure generally had a lower red blood cell (RBC) survival rate [40]. In addition, after treatment with erythropoietin, the newly generated RBCs lead to a further decrease in HbA1c [41]. An increasing trend of β-hydroxybutyrate was unexpectedly found in the survival group. It seems that it is a protective factor for patients with hyperglycaemic crisis. Previous studies evidence supports that blood β-hydroxybutyrate can reduce renal ischemia and reperfusion injury by increasing the upstream regulator forkhead transcription factor O3 and reducing caspase-1 and pro-inflammatory cytokines, thereby reducing cell death [42, 43].

Age was ranked as the most important feature for the model, followed by features related to metabolic disorders, cardiac and renal dysfunction. In a recent study, acute hyperglycaemic crisis episode impact on survival in individuals with diabetic foot ulcer using a machine learning approach, which also revealed that individual characteristics evaluated by Charlson Comorbidity Index (CCI) and acute organ injury played a vital role in disease prognosis [44]. The nine most important features for the prediction were significantly different between the survival group and nonsurvival group in the training set. Therefore, the effect of features on the predictions is consistent with the traditional statistical test results. Importantly, the developed explainable model can provide the relative importance of individual features for survival of patient and those at patient level, which makes it superior to traditional statistical tests that can only test for significant differences between groups. Admittedly, there are some limitations in our study. First, although multicentre data were used, due to the low morbidity of hyperglycaemic crisis, the amount of data was relatively small, which may lead to bias in the model. Second, in order to enable the models to obtain more comprehensive information and improve the performance of the tree-based models, our models contained up to 41 features. However, due to the limitation of data acquisition, the number of variables selected for the study is limited.. Third, the SHAP algorithm cannot address model bias, and the influence of features on the predictions is not equal to the association in the causal chain. Finally, Although the model is explainable, some features, such as age, cannot be manipulated by physicians. However, these insights into the relationship between features and predictions may guide our search for causality.

Conclusions

In summary, we developed an explainable machine learning model for predicting 3-year mortality and providing individualized risk factor assessment of inpatients with hyperglycaemic crises as well as hospital discharge, and the model was externally validated in an independent dataset. The interpretation results of the model revealed that more attention should be given to the variables related to metabolism and renal and cardiac function in the treatment of hyperglycaemic crisis, which played an important role in mortality through the model prediction. Transparent and explainable model predictions would help gain the trust of clinicians and facilitate decision-making by allowing physicians to evaluate whether the decision-making process of the model is consistent with scientific evidence and clinical experience. However, before this kind of tool used in the clinic, prospective studies are needed to be verified in the future.

Availability of data and materials

All datasets generated during and analyzed during the current study are not publicly available but are available from the corresponding author on reasonable request.

References

  1. Huang C-C, Weng S-F, Tsai K-T, Chen P-J, Lin H-J, Wang J-J, et al. Long-term mortality risk after hyperglycemic crisis episodes in geriatric patients with diabetes: a national population-based cohort study. Diabetes Care. 2015;38:746–51.

    Article  CAS  PubMed  Google Scholar 

  2. French EK, Donihi AC, Korytkowski MT. Diabetic ketoacidosis and hyperosmolar hyperglycemic syndrome: review of acute decompensated diabetes in adult patients. BMJ. 2019;365.

  3. Bragg F, Holmes MV, Iona A, Guo Y, Du H, Chen Y, et al. Association between diabetes and cause-specific mortality in rural and urban areas of China. JAMA. 2017;317:280–9.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Umpierrez G, Korytkowski M. Diabetic emergencies—ketoacidosis, hyperglycaemic hyperosmolar state and hypoglycaemia. Nat Rev Endocrinol. 2016;12:222–32.

    Article  CAS  PubMed  Google Scholar 

  5. Pasquel FJ, Umpierrez GE. Hyperosmolar hyperglycemic state: a historic review of the clinical presentation, diagnosis, and treatment. Diabetes Care. 2014;37:3124–31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Pasquel FJ, Tsegka K, Wang H, Cardona S, Galindo RJ, Fayfman M, et al. Clinical outcomes in patients with isolated or combined diabetic ketoacidosis and hyperosmolar hyperglycemic state: a retrospective, hospital-based cohort study. Diabetes Care. 2020;43:349–57.

    Article  CAS  PubMed  Google Scholar 

  7. Kao Y, Hsu C-C, Weng S-F, Lin H-J, Wang J-J, Su S-B, et al. Subsequent mortality after hyperglycemic crisis episode in the non-elderly: a national population-based cohort study. Endocrine. 2016;51:72–82.

    Article  CAS  PubMed  Google Scholar 

  8. Shaka H, Aguilera M, Aucar M, El-Amir Z, Wani F, Muojieje CC, et al. Rate and predictors of 30-day readmission following diabetic ketoacidosis in type 1 diabetes mellitus: a US analysis. J Clin Endocrinol Metab. 2021;106:2592–9.

    Article  PubMed  Google Scholar 

  9. Elangovan A, Cattamanchi S, Farook AR, Trichur RV. Validation of predicting hyperglycemic crisis death score: a risk stratification tool for appropriate disposition of hyperglycemic crisis patients from the emergency department. J Emerg Trauma Shock. 2018;11:104.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Huang C-C, Kuo S-C, Chien T-W, Lin H-J, Guo H-R, Chen W-L, et al. Predicting the hyperglycemic crisis death (PHD) score: a new decision rule for emergency and critical care. Am J Emerg Med. 2013;31:830–4.

    Article  PubMed  Google Scholar 

  11. Ekpebegh CO, Longo-Mbenza BB-I-S, Nge AO. A clinical score to predict survival from hyperglycemic crisis following general medical wards admission in a resource constrained setting. Int J Diabetes Dev Ctries. 2012;32:7–13.

    Article  Google Scholar 

  12. Ogbera AO, Awobusuyi J, Unachukwu C, Fasanmade O. Clinical features, predictive factors and outcome of hyperglycaemic emergencies in a developing country. BMC Endocr Disord. 2009;9:1–5.

    Article  Google Scholar 

  13. Du C, Li Y, Xie P, Zhang X, Deng B, Wang G, et al. The amputation and mortality of inpatients with diabetic foot ulceration in the COVID-19 pandemic and postpandemic era: a machine learning study. Int Wound J. 2021. https://doi.org/10.1111/iwj.13723.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Cahn A, Zuker I, Eilenberg R, Uziel M, Tsadok MA, Raz I, et al. Machine learning based study of longitudinal HbA1c trends and their association with all-cause mortality: analyses from a National Diabetes Registry. Diabetes Metab Res Rev. 2022;38: e3485.

    Article  CAS  PubMed  Google Scholar 

  15. Aminian A, Zajichek A, Arterburn DE, Wolski KE, Brethauer SA, Schauer PR, et al. Predicting 10-year risk of end-organ complications of type 2 diabetes with and without metabolic surgery: a machine learning approach. Diabetes Care. 2020;43:852–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Mackey TK, Purushothaman V, Haupt M, Nali MC, Li J. Application of unsupervised machine learning to identify and characterise hydroxychloroquine misinformation on Twitter. Lancet Digit Health. 2021;3:e72–5.

    Article  CAS  PubMed  Google Scholar 

  17. Pollard TJ, Chen I, Wiens J, Horng S, Wong D, Ghassemi M, et al. Turning the crank for machine learning: ease, at what expense? Lancet Digit Health. 2019;1:e198–9.

    Article  PubMed  Google Scholar 

  18. Akay A, Hess H. Deep learning: current and emerging applications in medicine and technology. IEEE J Biomed Health Inform. 2019;23:906–20.

    Article  PubMed  Google Scholar 

  19. Smuha NA. The eu approach to ethics guidelines for trustworthy artificial intelligence. Comput Law Rev Int. 2019;20:97–106.

    Article  Google Scholar 

  20. Xie P, Li Y, Deng B, Du C, Rui S, Deng W, et al. An explainable machine learning model for predicting in-hospital amputation rate of patients with diabetic foot ulcer. Int Wound J. 2022;19:910–8.

    Article  PubMed  Google Scholar 

  21. Thorsen-Meyer H-C, Nielsen AB, Nielsen AP, Kaas-Hansen BS, Toft P, Schierbeck J, et al. Dynamic and explainable machine learning prediction of mortality in patients in the intensive care unit: a retrospective study of high-frequency data in electronic patient records. Lancet Digit Health. 2020;2:e179–91.

    Article  PubMed  Google Scholar 

  22. Kumari VA, Chitra R. Classification of diabetes disease using support vector machine. Int J Eng Res Appl. 2013;3:1797–801.

    Google Scholar 

  23. Li C-P, Zhi X-Y, Jun M, Zhuang C, Zhu Z-L, Zhang C, et al. Performance comparison between logistic regression, decision trees, and multilayer perceptron in predicting peripheral neuropathy in type 2 diabetes mellitus. Chin Med J. 2012;125:851–7.

    PubMed  Google Scholar 

  24. Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, et al. Lightgbm: a highly efficient gradient boosting decision tree. Adv Neural Inf Process Syst. 2017;30:3146–54.

    Google Scholar 

  25. Biau G, Scornet E. A random forest guided tour. TEST. 2016;25:197–227.

    Article  Google Scholar 

  26. Gou W, Ling C-W, He Y, Jiang Z, Fu Y, Xu F, et al. Interpretable machine learning framework reveals robust gut microbiome features associated with type 2 diabetes. Diabetes Care. 2021;44:358–66.

    Article  CAS  PubMed  Google Scholar 

  27. Swapna G, Vinayakumar R, Soman K. Diabetes detection using deep learning algorithms. ICT Express. 2018;4:243–6.

    Article  Google Scholar 

  28. Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, et al. From local explanations to global understanding with explainable AI for trees. Nat Mach Intell. 2020;2:56–67.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst. 2017;30.

  30. Dhatariya KK, Umpierrez GE. Guidelines for management of diabetic ketoacidosis: time to revise? Lancet Diabetes Endocrinol. 2017;5:321–3.

    Article  PubMed  Google Scholar 

  31. Nkoke C, Bain LE, Makoge C, Teuwafeu D, Mapina A, Nkouonlack C, et al. Profile and outcomes of patients admitted with hyperglycemic emergencies in the Buea Regional Hospital in Cameroon. Pan Afr Med J. 2021. https://doi.org/10.11604/pamj.2021.39.274.14371.

  32. Tjoa E, Guan C. A survey on explainable artificial intelligence (xai): Toward medical xai. IEEE Trans Neural Netw Learn Syst. 2020;32:4793–813.

    Article  Google Scholar 

  33. Lamy J-B, Sekar B, Guezennec G, Bouaud J, Séroussi B. Explainable artificial intelligence for breast cancer: a visual case-based reasoning approach. Artif Intell Med. 2019;94:42–53.

    Article  PubMed  Google Scholar 

  34. Chen H-F, Wang C-Y, Lee H-Y, See T-T, Chen M-H, Jiang J-Y, et al. Short-term case fatality rate and associated factors among inpatients with diabetic ketoacidosis and hyperglycemic hyperosmolar state: a hospital-based analysis over a 15-year period. Intern Med. 2010;49:729–37.

    Article  PubMed  Google Scholar 

  35. MacIsaac RJ, Lee L, McNeil K, Tsalamandris C, Jerums G. Influence of age on the presentation and outcome of acidotic and hyperosmolar diabetic emergencies. Intern Med J. 2002;32:379–85.

    Article  CAS  PubMed  Google Scholar 

  36. Desai R, Singh S, Syed MH, Dave H, Hasnain M, Zahid D, et al. Temporal trends in the prevalence of diabetes decompensation (diabetic ketoacidosis and hyperosmolar hyperglycemic state) among adult patients hospitalized with diabetes mellitus: a nationwide analysis stratified by age, gender, and race. Cureus. 2019. https://doi.org/10.7759/cureus.4353.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Wu X-Y, She D-M, Wang F, Guo G, Li R, Fang P, et al. Clinical profiles, outcomes and risk factors among type 2 diabetic inpatients with diabetic ketoacidosis and hyperglycemic hyperosmolar state: a hospital-based analysis over a 6-year period. BMC Endocr Disord. 2020;20:1–9.

    Article  Google Scholar 

  38. Huang C-C, Chou W, Lin H-J, Chen S-C, Kuo S-C, Chen W-L, et al. Cancer history, bandemia, and serum creatinine are independent mortality predictors in patients with infection-precipitated hyperglycemic crises. BMC Endocr Disord. 2013;13:1–6.

    Article  Google Scholar 

  39. Reynolds T, Cecconi M, Collinson P, Rhodes A, Grounds R, Hamilton M. Raised serum cardiac troponin I concentrations predict hospital mortality in intensive care unit patients. Br J Anaesth. 2012;109:219–24.

    Article  CAS  PubMed  Google Scholar 

  40. Welsh KJ, Kirkman MS, Sacks DB. Role of glycated proteins in the diagnosis and management of diabetes: research gaps and future directions. Diabetes Care. 2016;39:1299–306.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Little RR, Rohlfing CL, Tennill AL, Hanson SE, Connolly S, Higgins T, et al. Measurement of HbA1c in patients with chronic renal failure. Clin Chim Acta. 2013;418:73–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Youm Y-H, Nguyen KY, Grant RW, Goldberg EL, Bodogai M, Kim D, et al. The ketone metabolite β-hydroxybutyrate blocks NLRP3 inflammasome-mediated inflammatory disease. Nat Med. 2015;21:263–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Lu D, Liu J, Jiao J, Long B, Li Q, Tan W, et al. Transcription factor Foxo3a prevents apoptosis by regulating calcium through the apoptosis repressor with caspase recruitment domain. J Biol Chem. 2013;288:8491–504.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Deng L, Xie P, Chen Y, Rui S, Yang C, Deng B, et al. Impact of acute hyperglycemic crisis episode on survival in individuals with diabetic foot ulcer using a machine learning approach. Front Endocrinol (Lausanne). 2022. https://doi.org/10.3389/fendo.2022.974063.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

None.

Funding

This study was supported by the Chongqing Youth High-end Talent Studio (Grant No. ZQNYXGDRCGZS2021008), the Joint Medical Research Programs of Chongqing Science and Technology Bureau and Health Commission Foundation (No. 2022QNXM018) and the Fundamental Research Funds for the Central Universities (2021CDJYGRH-012) awarded to Dr. Wuquan Deng and Dr. Min Wang. Chongqing medical scientific research project (Joint project of Chongqing Health Commission and Science and Technology Bureau) [2020FYYX241] awarded to Dr. Xiaoyan Jiang. This study is also partially supported by National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases (1R01124789-01A1) and National Science Foundation (NSF) Center to Stream Healthcare in Place (#C2SHiP) CNS (2052578) awarded to Prof. Armstrong DG.

Author information

Authors and Affiliations

Authors

Contributions

PX was responsible for study design, data acquisition, analysis, and interpretation and for preparing the first draft of the manuscript. CY, GY, YJ, MH, XJ, YC, and LD were responsible for recruiting study participants and clinical input in the study design. WD, YM, MW, XJ, and DGA helped write the manuscript. All authors had an opportunity to review the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Yu Ma or Wuquan Deng.

Ethics declarations

Ethics approval and consent to participate

The study was approved by Institutional Review Board at Chongqing University Central Hospital.

Consent for publication

This manuscript has been read and its submission approved by all the coauthors.

Competing interests

The authors report no potential conflicts of interest relevant to this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

The hyperparameter optimization range and results of LR. Table S2. The hyperparameter optimization range and results of SVM. Table S3. The hyperparameter optimization range and results of RF. Table S4. The hyperparameter optimization range and results of LightGBM. Figure S1. Schematic diagram of DNN network structure. Table S5. The hyperparameter of the network structure of DNN. Table S6. The hyperparameter optimization range and results of DNN.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xie, P., Yang, C., Yang, G. et al. Mortality prediction in patients with hyperglycaemic crisis using explainable machine learning: a prospective, multicentre study based on tertiary hospitals. Diabetol Metab Syndr 15, 44 (2023). https://doi.org/10.1186/s13098-023-01020-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13098-023-01020-1

Keywords