改进脊柱外科病例持续时间预测的集成学习方法:算法开发与验证。

Rodney Allanigue Gabriel, Bhavya Harjai, Sierra Simpson, Austin Liu Du, Jeffrey Logan Tully, Olivier George, Ruth Waterman
{"title":"改进脊柱外科病例持续时间预测的集成学习方法:算法开发与验证。","authors":"Rodney Allanigue Gabriel,&nbsp;Bhavya Harjai,&nbsp;Sierra Simpson,&nbsp;Austin Liu Du,&nbsp;Jeffrey Logan Tully,&nbsp;Olivier George,&nbsp;Ruth Waterman","doi":"10.2196/39650","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Estimating surgical case duration accurately is an important operating room efficiency metric. Current predictive techniques in spine surgery include less sophisticated approaches such as classical multivariable statistical models. Machine learning approaches have been used to predict outcomes such as length of stay and time returning to normal work, but have not been focused on case duration.</p><p><strong>Objective: </strong>The primary objective of this 4-year, single-academic-center, retrospective study was to use an ensemble learning approach that may improve the accuracy of scheduled case duration for spine surgery. The primary outcome measure was case duration.</p><p><strong>Methods: </strong>We compared machine learning models using surgical and patient features to our institutional method, which used historic averages and surgeon adjustments as needed. We implemented multivariable linear regression, random forest, bagging, and XGBoost (Extreme Gradient Boosting) and calculated the average R<sup>2</sup>, root-mean-square error (RMSE), explained variance, and mean absolute error (MAE) using k-fold cross-validation. We then used the SHAP (Shapley Additive Explanations) explainer model to determine feature importance.</p><p><strong>Results: </strong>A total of 3189 patients who underwent spine surgery were included. The institution's current method of predicting case times has a very poor coefficient of determination with actual times (R<sup>2</sup>=0.213). On k-fold cross-validation, the linear regression model had an explained variance score of 0.345, an R<sup>2</sup> of 0.34, an RMSE of 162.84 minutes, and an MAE of 127.22 minutes. Among all models, the XGBoost regressor performed the best with an explained variance score of 0.778, an R<sup>2</sup> of 0.770, an RMSE of 92.95 minutes, and an MAE of 44.31 minutes. Based on SHAP analysis of the XGBoost regression, body mass index, spinal fusions, surgical procedure, and number of spine levels involved were the features with the most impact on the model.</p><p><strong>Conclusions: </strong>Using ensemble learning-based predictive models, specifically XGBoost regression, can improve the accuracy of the estimation of spine surgery times.</p>","PeriodicalId":73557,"journal":{"name":"JMIR perioperative medicine","volume":"6 ","pages":"e39650"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9912154/pdf/","citationCount":"5","resultStr":"{\"title\":\"An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation.\",\"authors\":\"Rodney Allanigue Gabriel,&nbsp;Bhavya Harjai,&nbsp;Sierra Simpson,&nbsp;Austin Liu Du,&nbsp;Jeffrey Logan Tully,&nbsp;Olivier George,&nbsp;Ruth Waterman\",\"doi\":\"10.2196/39650\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Estimating surgical case duration accurately is an important operating room efficiency metric. Current predictive techniques in spine surgery include less sophisticated approaches such as classical multivariable statistical models. Machine learning approaches have been used to predict outcomes such as length of stay and time returning to normal work, but have not been focused on case duration.</p><p><strong>Objective: </strong>The primary objective of this 4-year, single-academic-center, retrospective study was to use an ensemble learning approach that may improve the accuracy of scheduled case duration for spine surgery. The primary outcome measure was case duration.</p><p><strong>Methods: </strong>We compared machine learning models using surgical and patient features to our institutional method, which used historic averages and surgeon adjustments as needed. We implemented multivariable linear regression, random forest, bagging, and XGBoost (Extreme Gradient Boosting) and calculated the average R<sup>2</sup>, root-mean-square error (RMSE), explained variance, and mean absolute error (MAE) using k-fold cross-validation. We then used the SHAP (Shapley Additive Explanations) explainer model to determine feature importance.</p><p><strong>Results: </strong>A total of 3189 patients who underwent spine surgery were included. The institution's current method of predicting case times has a very poor coefficient of determination with actual times (R<sup>2</sup>=0.213). On k-fold cross-validation, the linear regression model had an explained variance score of 0.345, an R<sup>2</sup> of 0.34, an RMSE of 162.84 minutes, and an MAE of 127.22 minutes. Among all models, the XGBoost regressor performed the best with an explained variance score of 0.778, an R<sup>2</sup> of 0.770, an RMSE of 92.95 minutes, and an MAE of 44.31 minutes. Based on SHAP analysis of the XGBoost regression, body mass index, spinal fusions, surgical procedure, and number of spine levels involved were the features with the most impact on the model.</p><p><strong>Conclusions: </strong>Using ensemble learning-based predictive models, specifically XGBoost regression, can improve the accuracy of the estimation of spine surgery times.</p>\",\"PeriodicalId\":73557,\"journal\":{\"name\":\"JMIR perioperative medicine\",\"volume\":\"6 \",\"pages\":\"e39650\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9912154/pdf/\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR perioperative medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2196/39650\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR perioperative medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/39650","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5

摘要

背景:准确估计手术病例持续时间是手术室效率的重要指标。目前脊柱外科的预测技术包括不太复杂的方法,如经典的多变量统计模型。机器学习方法已被用于预测住院时间和恢复正常工作的时间等结果,但尚未专注于病例持续时间。目的:这项为期4年的单学术中心回顾性研究的主要目的是使用集成学习方法来提高脊柱外科手术预定病例持续时间的准确性。主要结局指标为病例持续时间。方法:我们将使用手术和患者特征的机器学习模型与我们的机构方法进行了比较,该方法使用历史平均值和外科医生根据需要进行调整。我们实施了多变量线性回归、随机森林、bagging和XGBoost (Extreme Gradient Boosting),并使用k-fold交叉验证计算了平均R2、均方根误差(RMSE)、解释方差和平均绝对误差(MAE)。然后我们使用SHAP (Shapley Additive Explanations)解释器模型来确定特征的重要性。结果:共纳入3189例脊柱手术患者。该机构目前预测病例时间的方法与实际时间的确定系数很差(R2=0.213)。经k-fold交叉验证,线性回归模型的解释方差得分为0.345,R2为0.34,RMSE为162.84 min, MAE为127.22 min。在所有模型中,XGBoost回归因子表现最好,其解释方差得分为0.778,R2为0.770,RMSE为92.95分钟,MAE为44.31分钟。基于XGBoost回归的SHAP分析,体重指数、脊柱融合、手术方式和涉及的脊柱节段数是对模型影响最大的特征。结论:使用基于集成学习的预测模型,特别是XGBoost回归,可以提高脊柱手术次数估计的准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation.

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation.

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation.

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation.

Background: Estimating surgical case duration accurately is an important operating room efficiency metric. Current predictive techniques in spine surgery include less sophisticated approaches such as classical multivariable statistical models. Machine learning approaches have been used to predict outcomes such as length of stay and time returning to normal work, but have not been focused on case duration.

Objective: The primary objective of this 4-year, single-academic-center, retrospective study was to use an ensemble learning approach that may improve the accuracy of scheduled case duration for spine surgery. The primary outcome measure was case duration.

Methods: We compared machine learning models using surgical and patient features to our institutional method, which used historic averages and surgeon adjustments as needed. We implemented multivariable linear regression, random forest, bagging, and XGBoost (Extreme Gradient Boosting) and calculated the average R2, root-mean-square error (RMSE), explained variance, and mean absolute error (MAE) using k-fold cross-validation. We then used the SHAP (Shapley Additive Explanations) explainer model to determine feature importance.

Results: A total of 3189 patients who underwent spine surgery were included. The institution's current method of predicting case times has a very poor coefficient of determination with actual times (R2=0.213). On k-fold cross-validation, the linear regression model had an explained variance score of 0.345, an R2 of 0.34, an RMSE of 162.84 minutes, and an MAE of 127.22 minutes. Among all models, the XGBoost regressor performed the best with an explained variance score of 0.778, an R2 of 0.770, an RMSE of 92.95 minutes, and an MAE of 44.31 minutes. Based on SHAP analysis of the XGBoost regression, body mass index, spinal fusions, surgical procedure, and number of spine levels involved were the features with the most impact on the model.

Conclusions: Using ensemble learning-based predictive models, specifically XGBoost regression, can improve the accuracy of the estimation of spine surgery times.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
0.50
自引率
0.00%
发文量
0
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信