比较初次全膝关节置换术后30天再入院的预测准确性:ACS-NSQIP风险计算器与新型人工神经网络模型

Q2 Medicine
Anirudh Buddhiraju, Michelle Riyo Shimizu, Tony Lin-Wei Chen, Henry Hojoon Seo, Blake M Bacevich, Pengwei Xiao, Young-Min Kwon
{"title":"比较初次全膝关节置换术后30天再入院的预测准确性:ACS-NSQIP风险计算器与新型人工神经网络模型","authors":"Anirudh Buddhiraju, Michelle Riyo Shimizu, Tony Lin-Wei Chen, Henry Hojoon Seo, Blake M Bacevich, Pengwei Xiao, Young-Min Kwon","doi":"10.1186/s43019-024-00256-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Unplanned readmission, a measure of surgical quality, occurs after 4.8% of primary total knee arthroplasties (TKA). Although the prediction of individualized readmission risk may inform appropriate preoperative interventions, current predictive models, such as the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator (SRC), have limited utility. This study aims to compare the predictive accuracy of the SRC with a novel artificial neural network (ANN) algorithm for 30-day readmission after primary TKA, using the same set of clinical variables from a large national database.</p><p><strong>Methods: </strong>Patients undergoing primary TKA between 2013 and 2020 were identified from the ACS-NSQIP database and randomly stratified into training and validation cohorts. The ANN was developed using data from the training cohort with fivefold cross-validation performed five times. ANN and SRC performance were subsequently evaluated in the distinct validation cohort, and predictive performance was compared on the basis of discrimination, calibration, accuracy, and clinical utility.</p><p><strong>Results: </strong>The overall cohort consisted of 365,394 patients (training<sub>N</sub> = 362,559; validation<sub>N</sub> = 2835), with 11,392 (3.1%) readmitted within 30 days. While the ANN demonstrated good discrimination and calibration (area under the curve (AUC)<sub>ANN</sub> = 0.72, slope = 1.32, intercept = -0.09) in the validation cohort, the SRC demonstrated poor discrimination (AUC<sub>SRC</sub> = 0.55) and underestimated readmission risk (slope = -0.21, intercept = 0.04). Although both models possessed similar accuracy (Brier score: ANN = 0.03; SRC = 0.02), only the ANN demonstrated a higher net benefit than intervening in all or no patients on the decision curve analysis. The strongest predictors of readmission were body mass index (> 33.5 kg/m<sup>2</sup>), age (> 69 years), and male sex.</p><p><strong>Conclusions: </strong>This study demonstrates the superior predictive ability and potential clinical utility of the ANN over the conventional SRC when constrained to the same variables. By identifying the most important predictors of readmission following TKA, our findings may assist in the development of novel clinical decision support tools, potentially improving preoperative counseling and postoperative monitoring practices in at-risk patients.</p>","PeriodicalId":36317,"journal":{"name":"Knee Surgery and Related Research","volume":"37 1","pages":"3"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11727824/pdf/","citationCount":"0","resultStr":"{\"title\":\"Comparing prediction accuracy for 30-day readmission following primary total knee arthroplasty: the ACS-NSQIP risk calculator versus a novel artificial neural network model.\",\"authors\":\"Anirudh Buddhiraju, Michelle Riyo Shimizu, Tony Lin-Wei Chen, Henry Hojoon Seo, Blake M Bacevich, Pengwei Xiao, Young-Min Kwon\",\"doi\":\"10.1186/s43019-024-00256-z\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Unplanned readmission, a measure of surgical quality, occurs after 4.8% of primary total knee arthroplasties (TKA). Although the prediction of individualized readmission risk may inform appropriate preoperative interventions, current predictive models, such as the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator (SRC), have limited utility. This study aims to compare the predictive accuracy of the SRC with a novel artificial neural network (ANN) algorithm for 30-day readmission after primary TKA, using the same set of clinical variables from a large national database.</p><p><strong>Methods: </strong>Patients undergoing primary TKA between 2013 and 2020 were identified from the ACS-NSQIP database and randomly stratified into training and validation cohorts. The ANN was developed using data from the training cohort with fivefold cross-validation performed five times. ANN and SRC performance were subsequently evaluated in the distinct validation cohort, and predictive performance was compared on the basis of discrimination, calibration, accuracy, and clinical utility.</p><p><strong>Results: </strong>The overall cohort consisted of 365,394 patients (training<sub>N</sub> = 362,559; validation<sub>N</sub> = 2835), with 11,392 (3.1%) readmitted within 30 days. While the ANN demonstrated good discrimination and calibration (area under the curve (AUC)<sub>ANN</sub> = 0.72, slope = 1.32, intercept = -0.09) in the validation cohort, the SRC demonstrated poor discrimination (AUC<sub>SRC</sub> = 0.55) and underestimated readmission risk (slope = -0.21, intercept = 0.04). Although both models possessed similar accuracy (Brier score: ANN = 0.03; SRC = 0.02), only the ANN demonstrated a higher net benefit than intervening in all or no patients on the decision curve analysis. The strongest predictors of readmission were body mass index (> 33.5 kg/m<sup>2</sup>), age (> 69 years), and male sex.</p><p><strong>Conclusions: </strong>This study demonstrates the superior predictive ability and potential clinical utility of the ANN over the conventional SRC when constrained to the same variables. By identifying the most important predictors of readmission following TKA, our findings may assist in the development of novel clinical decision support tools, potentially improving preoperative counseling and postoperative monitoring practices in at-risk patients.</p>\",\"PeriodicalId\":36317,\"journal\":{\"name\":\"Knee Surgery and Related Research\",\"volume\":\"37 1\",\"pages\":\"3\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11727824/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knee Surgery and Related Research\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1186/s43019-024-00256-z\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knee Surgery and Related Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s43019-024-00256-z","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

摘要

背景:4.8%的原发性全膝关节置换术(TKA)发生意外再入院,这是衡量手术质量的一个指标。虽然个体化再入院风险的预测可以为适当的术前干预提供信息,但目前的预测模型,如美国外科医师学会国家手术质量改进计划(ACS-NSQIP)手术风险计算器(SRC)的实用性有限。本研究旨在比较SRC与新型人工神经网络(ANN)算法对原发性TKA后30天再入院的预测准确性,使用来自大型国家数据库的相同临床变量集。方法:从ACS-NSQIP数据库中筛选2013年至2020年期间接受原发性TKA的患者,随机分为培训和验证队列。人工神经网络是使用来自训练队列的数据开发的,并进行了五次交叉验证。随后在不同的验证队列中评估ANN和SRC的性能,并在区分、校准、准确性和临床实用性的基础上比较预测性能。结果:整个队列包括365,394名患者(训练n = 362,559;validationN = 2835),其中11,392(3.1%)在30天内再次入院。在验证队列中,人工神经网络表现出良好的识别和校准能力(曲线下面积(AUC)ANN = 0.72,斜率= 1.32,截距= -0.09),而人工神经网络表现出较差的识别能力(AUCSRC = 0.55),低估了再入院风险(斜率= -0.21,截距= 0.04)。虽然两种模型具有相似的准确性(Brier评分:ANN = 0.03;SRC = 0.02),决策曲线分析显示,只有人工神经网络比全部或不干预患者表现出更高的净收益。再入院的最强预测因子是体重指数(33.5 kg/m2)、年龄(69岁)和男性。结论:本研究表明,在相同的变量约束下,人工神经网络的预测能力和潜在的临床应用价值优于传统的SRC。通过确定TKA后再入院的最重要预测因素,我们的研究结果可能有助于开发新的临床决策支持工具,潜在地改善高危患者的术前咨询和术后监测实践。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Comparing prediction accuracy for 30-day readmission following primary total knee arthroplasty: the ACS-NSQIP risk calculator versus a novel artificial neural network model.

Background: Unplanned readmission, a measure of surgical quality, occurs after 4.8% of primary total knee arthroplasties (TKA). Although the prediction of individualized readmission risk may inform appropriate preoperative interventions, current predictive models, such as the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) surgical risk calculator (SRC), have limited utility. This study aims to compare the predictive accuracy of the SRC with a novel artificial neural network (ANN) algorithm for 30-day readmission after primary TKA, using the same set of clinical variables from a large national database.

Methods: Patients undergoing primary TKA between 2013 and 2020 were identified from the ACS-NSQIP database and randomly stratified into training and validation cohorts. The ANN was developed using data from the training cohort with fivefold cross-validation performed five times. ANN and SRC performance were subsequently evaluated in the distinct validation cohort, and predictive performance was compared on the basis of discrimination, calibration, accuracy, and clinical utility.

Results: The overall cohort consisted of 365,394 patients (trainingN = 362,559; validationN = 2835), with 11,392 (3.1%) readmitted within 30 days. While the ANN demonstrated good discrimination and calibration (area under the curve (AUC)ANN = 0.72, slope = 1.32, intercept = -0.09) in the validation cohort, the SRC demonstrated poor discrimination (AUCSRC = 0.55) and underestimated readmission risk (slope = -0.21, intercept = 0.04). Although both models possessed similar accuracy (Brier score: ANN = 0.03; SRC = 0.02), only the ANN demonstrated a higher net benefit than intervening in all or no patients on the decision curve analysis. The strongest predictors of readmission were body mass index (> 33.5 kg/m2), age (> 69 years), and male sex.

Conclusions: This study demonstrates the superior predictive ability and potential clinical utility of the ANN over the conventional SRC when constrained to the same variables. By identifying the most important predictors of readmission following TKA, our findings may assist in the development of novel clinical decision support tools, potentially improving preoperative counseling and postoperative monitoring practices in at-risk patients.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.50
自引率
0.00%
发文量
42
审稿时长
19 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信