Rui Yang, Tao Huang, Renqi Yao, Di Wang, Yang Hu, Longbing Ren, Shaojie Li, Yali Zhao, Zhijun Dai
{"title":"危重急性心肌梗死患者住院死亡率的危险因素和可解释性工具。","authors":"Rui Yang, Tao Huang, Renqi Yao, Di Wang, Yang Hu, Longbing Ren, Shaojie Li, Yali Zhao, Zhijun Dai","doi":"10.1016/j.clinme.2025.100299","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>We aim to develop and validate an interpretable machine-learning model that can provide critical information for the clinical treatment of critically ill patients with acute myocardial infarction (AMI).</p><p><strong>Methods: </strong>All data was extracted from the multi-centre database (training and internal validation cohorts: MIMIC-III/-IV, external validation cohort: eICU). After comparing different machine-learning models and several unbalanced data processing methods, the model with the best performance was selected. Lasso regression was used to build a compact model. Seven evaluation methods, PR, and ROC curves were used to assess the model. The SHapley Additive exPlanations (SHAP) values were calculated to evaluate the feature's importance. The SHAP plots were adopted to explain and interpret the results. A web-based tool was developed to help application.</p><p><strong>Results: </strong>A total of 12,170 critically ill patients with AMI were included. The balance random forest (BRF) model had the best performance in predicting in-hospital mortality. The compact model did not differ from the full variable model in performance (AUC: 0.891 vs 0.885, P = 0.06). The external validation results also demonstrated the stability of the model (AUC: 0.784). All SHAP plots have shown the contribution ranking of all variables in the model, the relationship trend between variables and outcomes, and the interaction mode between variables. A web-based tool is constructed that can provide individualized risk stratification probabilities (https://github.com/huangtao36/BRF-web-tool) .</p><p><strong>Conclusion: </strong>We built the BRF model and the web-based tool by the model algorithm. The model effect has been verified externally. The tool can help clinical decision-making.</p>","PeriodicalId":10492,"journal":{"name":"Clinical Medicine","volume":" ","pages":"100299"},"PeriodicalIF":3.6000,"publicationDate":"2025-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Risk Factors and An Interpretability Tool of In-hospital Mortality in Critically Ill Patients with Acute Myocardial Infarction.\",\"authors\":\"Rui Yang, Tao Huang, Renqi Yao, Di Wang, Yang Hu, Longbing Ren, Shaojie Li, Yali Zhao, Zhijun Dai\",\"doi\":\"10.1016/j.clinme.2025.100299\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>We aim to develop and validate an interpretable machine-learning model that can provide critical information for the clinical treatment of critically ill patients with acute myocardial infarction (AMI).</p><p><strong>Methods: </strong>All data was extracted from the multi-centre database (training and internal validation cohorts: MIMIC-III/-IV, external validation cohort: eICU). After comparing different machine-learning models and several unbalanced data processing methods, the model with the best performance was selected. Lasso regression was used to build a compact model. Seven evaluation methods, PR, and ROC curves were used to assess the model. The SHapley Additive exPlanations (SHAP) values were calculated to evaluate the feature's importance. The SHAP plots were adopted to explain and interpret the results. A web-based tool was developed to help application.</p><p><strong>Results: </strong>A total of 12,170 critically ill patients with AMI were included. The balance random forest (BRF) model had the best performance in predicting in-hospital mortality. The compact model did not differ from the full variable model in performance (AUC: 0.891 vs 0.885, P = 0.06). The external validation results also demonstrated the stability of the model (AUC: 0.784). All SHAP plots have shown the contribution ranking of all variables in the model, the relationship trend between variables and outcomes, and the interaction mode between variables. A web-based tool is constructed that can provide individualized risk stratification probabilities (https://github.com/huangtao36/BRF-web-tool) .</p><p><strong>Conclusion: </strong>We built the BRF model and the web-based tool by the model algorithm. The model effect has been verified externally. The tool can help clinical decision-making.</p>\",\"PeriodicalId\":10492,\"journal\":{\"name\":\"Clinical Medicine\",\"volume\":\" \",\"pages\":\"100299\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2025-02-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical Medicine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.clinme.2025.100299\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.clinme.2025.100299","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
摘要
目的:我们旨在开发和验证一个可解释的机器学习模型,该模型可以为急性心肌梗死(AMI)危重患者的临床治疗提供关键信息。方法:所有数据从多中心数据库中提取(训练和内部验证队列:MIMIC-III/-IV,外部验证队列:eICU)。通过比较不同的机器学习模型和几种不平衡数据处理方法,选择了性能最好的模型。采用Lasso回归建立紧凑模型。采用7种评价方法、PR、ROC曲线对模型进行评价。计算SHapley加性解释(SHAP)值来评估特征的重要性。采用SHAP图来解释和解释结果。开发了一个基于网络的工具来帮助应用程序。结果:共纳入重症AMI患者12170例。平衡随机森林(BRF)模型对住院死亡率的预测效果最好。紧凑模型与全变量模型在性能上没有差异(AUC: 0.891 vs 0.885, P = 0.06)。外部验证结果也证明了模型的稳定性(AUC: 0.784)。所有的SHAP图都显示了模型中所有变量的贡献排名、变量与结果的关系趋势以及变量之间的相互作用模式。构建了基于web的风险分层概率分析工具(https://github.com/huangtao36/BRF-web-tool)。结论:通过模型算法构建了BRF模型和基于web的风险分层概率分析工具。模型效应已得到外部验证。该工具可以帮助临床决策。
Risk Factors and An Interpretability Tool of In-hospital Mortality in Critically Ill Patients with Acute Myocardial Infarction.
Purpose: We aim to develop and validate an interpretable machine-learning model that can provide critical information for the clinical treatment of critically ill patients with acute myocardial infarction (AMI).
Methods: All data was extracted from the multi-centre database (training and internal validation cohorts: MIMIC-III/-IV, external validation cohort: eICU). After comparing different machine-learning models and several unbalanced data processing methods, the model with the best performance was selected. Lasso regression was used to build a compact model. Seven evaluation methods, PR, and ROC curves were used to assess the model. The SHapley Additive exPlanations (SHAP) values were calculated to evaluate the feature's importance. The SHAP plots were adopted to explain and interpret the results. A web-based tool was developed to help application.
Results: A total of 12,170 critically ill patients with AMI were included. The balance random forest (BRF) model had the best performance in predicting in-hospital mortality. The compact model did not differ from the full variable model in performance (AUC: 0.891 vs 0.885, P = 0.06). The external validation results also demonstrated the stability of the model (AUC: 0.784). All SHAP plots have shown the contribution ranking of all variables in the model, the relationship trend between variables and outcomes, and the interaction mode between variables. A web-based tool is constructed that can provide individualized risk stratification probabilities (https://github.com/huangtao36/BRF-web-tool) .
Conclusion: We built the BRF model and the web-based tool by the model algorithm. The model effect has been verified externally. The tool can help clinical decision-making.
期刊介绍:
Clinical Medicine is aimed at practising physicians in the UK and overseas and has relevance to all those managing or working within the healthcare sector.
Available in print and online, the journal seeks to encourage high standards of medical care by promoting good clinical practice through original research, review and comment. The journal also includes a dedicated continuing medical education (CME) section in each issue. This presents the latest advances in a chosen specialty, with self-assessment questions at the end of each topic enabling CPD accreditation to be acquired.
ISSN: 1470-2118 E-ISSN: 1473-4893 Frequency: 6 issues per year