Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches.

Q2 Medicine
JMIR Cardio Pub Date : 2023-06-20 DOI:10.2196/45352
Michael O Killian, Shubo Tian, Aiwen Xing, Dana Hughes, Dipankar Gupta, Xiaoyu Wang, Zhe He
{"title":"Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches.","authors":"Michael O Killian,&nbsp;Shubo Tian,&nbsp;Aiwen Xing,&nbsp;Dana Hughes,&nbsp;Dipankar Gupta,&nbsp;Xiaoyu Wang,&nbsp;Zhe He","doi":"10.2196/45352","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care.</p><p><strong>Objective: </strong>The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients.</p><p><strong>Methods: </strong>Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models-extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)-as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction.</p><p><strong>Results: </strong>RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705).</p><p><strong>Conclusions: </strong>This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.</p>","PeriodicalId":14706,"journal":{"name":"JMIR Cardio","volume":"7 ","pages":"e45352"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10334720/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Cardio","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/45352","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

Abstract

Background: The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care.

Objective: The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients.

Methods: Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models-extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)-as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction.

Results: RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705).

Conclusions: This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.

Abstract Image

Abstract Image

Abstract Image

使用国家注册数据预测儿科患者心脏移植后的预后:机器学习方法的评估。
背景:儿童心脏移植术后健康结果的预测对于风险分层和高质量的移植后护理至关重要。目的:本研究的目的是研究使用机器学习(ML)模型来预测儿童心脏移植受者的排斥反应和死亡率。方法:利用联合器官共享网络1987年至2019年的数据,使用各种ML模型预测儿童心脏移植受者移植后1、3和5年的排斥反应和死亡率。用于预测移植后结果的变量包括供体和受体以及医疗和社会因素。我们评估了7个ML模型——极端梯度增强(XGBoost)、逻辑回归、支持向量机、随机森林(RF)、随机梯度下降、多层感知器和自适应增强(AdaBoost)——以及一个深度学习模型,该模型具有2个隐藏层,包含100个神经元和一个校正线性单元(ReLU)激活函数,然后对每个层进行批归一化,以及一个带有softmax激活函数的分类头。我们使用10倍交叉验证来评估模型的性能。计算Shapley加性解释(SHAP)值来估计每个变量对预测的重要性。结果:RF和AdaBoost模型在不同结果预测窗口中表现最佳。RF在预测6个结果中的5个方面优于其他ML算法(1年和3年排斥反应的受试者工作特征曲线下面积[AUROC]分别为0.664和0.706,1年、3年和5年死亡率的受试者工作特征曲线下面积[AUROC]分别为0.697、0.758和0.763)。AdaBoost在预测5年排斥反应方面表现最佳(AUROC为0.705)。结论:本研究证明了使用注册表数据对移植后健康结果建模的ML方法的比较效用。ML方法可以识别独特的危险因素及其与预后的复杂关系,从而识别被认为处于危险中的患者,并告知移植社区这些创新方法在改善儿童心脏移植后护理方面的潜力。未来的研究需要将来自预测模型的信息转化为优化儿科器官移植中心的咨询、临床护理和决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JMIR Cardio
JMIR Cardio Computer Science-Computer Science Applications
CiteScore
3.50
自引率
0.00%
发文量
25
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信