A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.

IF 2.1 2区 医学 Q4 MEDICAL INFORMATICS
Applied Clinical Informatics Pub Date : 2024-05-01 Epub Date: 2024-06-19 DOI:10.1055/s-0044-1787119
Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu
{"title":"A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.","authors":"Tzu-Chun Wu, Abraham Kim, Ching-Tzu Tsai, Andy Gao, Taran Ghuman, Anne Paul, Alexandra Castillo, Joseph Cheng, Owoicho Adogwa, Laura B Ngwenya, Brandon Foreman, Danny T Y Wu","doi":"10.1055/s-0044-1787119","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong> Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.</p><p><strong>Objectives: </strong> Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.</p><p><strong>Methods: </strong> Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.</p><p><strong>Results: </strong> The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.</p><p><strong>Conclusion: </strong> This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.</p>","PeriodicalId":48956,"journal":{"name":"Applied Clinical Informatics","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11186699/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Clinical Informatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1055/s-0044-1787119","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/19 0:00:00","PubModel":"Epub","JCR":"Q4","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background:  Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation.

Objectives:  Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models.

Methods:  Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs.

Results:  The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions.

Conclusion:  This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.

一家学术医院利用机器学习、工作流程分析和仿真技术开展神经外科再入院率降低项目。
背景:预测 30 天的再入院率对于改善患者预后、优化资源分配和实现经济节约至关重要。现有研究报告了预测神经外科再住院率的机器学习(ML)模型的开发情况,但未报告与临床实施相关的因素:目标:训练性能良好的单个预测模型(接收者操作特征曲线下面积或 AUROC > 0.8),通过半结构化访谈确定潜在的干预措施,并展示这些模型的临床和财务影响估计值:利用电子健康记录和五种 ML 方法:梯度提升、决策树、随机森林、脊逻辑回归和线性支持向量机。相关变量由领域专家和文献确定。数据集被随机分成80%用于训练和验证,20%用于测试。临床工作流程分析是通过半结构化访谈来确定可能的干预点。根据之前的一项干预研究,应用校准代理模型(ABM)模拟降低 30 天再入院率和财务成本:数据集涵盖了12334例神经外科重症监护病房(NSICU)住院病例(11029例患者)、1903例脊柱外科住院病例(1641例患者)和2208例创伤性脑损伤(TBI)住院病例(2185例患者),再入院率分别为13.13%、13.93%和23.73%。用于 NSICU 的随机森林模型性能最佳,AUROC 得分为 0.89,有效捕捉了潜在患者。通过针对术前、住院期间、出院阶段和随访阶段的 12 次半结构化访谈,确定了六项干预措施。经过校准的 ABM 模拟了再入院率的中位数,结果是再入院率从 13.13% 降至 10.12%(非重症监护病房)、13.90% 降至 10.98%(脊柱手术)、23.64% 降至 21.20%(创伤性脑损伤)。潜在的干预措施节省了约 1,300,614.28 美元:本研究报告成功开发并模拟了一种基于 ML 的方法,用于预测和减少神经外科 30 天再住院率。该干预措施在改善患者预后和减少经济损失方面具有可行性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Applied Clinical Informatics
Applied Clinical Informatics MEDICAL INFORMATICS-
CiteScore
4.60
自引率
24.10%
发文量
132
期刊介绍: ACI is the third Schattauer journal dealing with biomedical and health informatics. It perfectly complements our other journals Öffnet internen Link im aktuellen FensterMethods of Information in Medicine and the Öffnet internen Link im aktuellen FensterYearbook of Medical Informatics. The Yearbook of Medical Informatics being the “Milestone” or state-of-the-art journal and Methods of Information in Medicine being the “Science and Research” journal of IMIA, ACI intends to be the “Practical” journal of IMIA.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信