Covid-19 triage in the emergency department 2.0: how analytics and AI transform a human-made algorithm for the prediction of clinical pathways.

IF 2.3 3区 医学 Q2 HEALTH POLICY & SERVICES
Health Care Management Science Pub Date : 2023-09-01 Epub Date: 2023-07-10 DOI:10.1007/s10729-023-09647-2
Christina C Bartenschlager, Milena Grieger, Johanna Erber, Tobias Neidel, Stefan Borgmann, Jörg J Vehreschild, Markus Steinbrecher, Siegbert Rieg, Melanie Stecher, Christine Dhillon, Maria M Ruethrich, Carolin E M Jakob, Martin Hower, Axel R Heller, Maria Vehreschild, Christoph Wyen, Helmut Messmann, Christiane Piepel, Jens O Brunner, Frank Hanses, Christoph Römmele
{"title":"Covid-19 triage in the emergency department 2.0: how analytics and AI transform a human-made algorithm for the prediction of clinical pathways.","authors":"Christina C Bartenschlager, Milena Grieger, Johanna Erber, Tobias Neidel, Stefan Borgmann, Jörg J Vehreschild, Markus Steinbrecher, Siegbert Rieg, Melanie Stecher, Christine Dhillon, Maria M Ruethrich, Carolin E M Jakob, Martin Hower, Axel R Heller, Maria Vehreschild, Christoph Wyen, Helmut Messmann, Christiane Piepel, Jens O Brunner, Frank Hanses, Christoph Römmele","doi":"10.1007/s10729-023-09647-2","DOIUrl":null,"url":null,"abstract":"<p><p>The Covid-19 pandemic has pushed many hospitals to their capacity limits. Therefore, a triage of patients has been discussed controversially primarily through an ethical perspective. The term triage contains many aspects such as urgency of treatment, severity of the disease and pre-existing conditions, access to critical care, or the classification of patients regarding subsequent clinical pathways starting from the emergency department. The determination of the pathways is important not only for patient care, but also for capacity planning in hospitals. We examine the performance of a human-made triage algorithm for clinical pathways which is considered a guideline for emergency departments in Germany based on a large multicenter dataset with over 4,000 European Covid-19 patients from the LEOSS registry. We find an accuracy of 28 percent and approximately 15 percent sensitivity for the ward class. The results serve as a benchmark for our extensions including an additional category of palliative care as a new label, analytics, AI, XAI, and interactive techniques. We find significant potential of analytics and AI in Covid-19 triage regarding accuracy, sensitivity, and other performance metrics whilst our interactive human-AI algorithm shows superior performance with approximately 73 percent accuracy and up to 76 percent sensitivity. The results are independent of the data preparation process regarding the imputation of missing values or grouping of comorbidities. In addition, we find that the consideration of an additional label palliative care does not improve the results.</p>","PeriodicalId":12903,"journal":{"name":"Health Care Management Science","volume":"26 3","pages":"412-429"},"PeriodicalIF":2.3000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10485125/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Care Management Science","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s10729-023-09647-2","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/7/10 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"HEALTH POLICY & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

The Covid-19 pandemic has pushed many hospitals to their capacity limits. Therefore, a triage of patients has been discussed controversially primarily through an ethical perspective. The term triage contains many aspects such as urgency of treatment, severity of the disease and pre-existing conditions, access to critical care, or the classification of patients regarding subsequent clinical pathways starting from the emergency department. The determination of the pathways is important not only for patient care, but also for capacity planning in hospitals. We examine the performance of a human-made triage algorithm for clinical pathways which is considered a guideline for emergency departments in Germany based on a large multicenter dataset with over 4,000 European Covid-19 patients from the LEOSS registry. We find an accuracy of 28 percent and approximately 15 percent sensitivity for the ward class. The results serve as a benchmark for our extensions including an additional category of palliative care as a new label, analytics, AI, XAI, and interactive techniques. We find significant potential of analytics and AI in Covid-19 triage regarding accuracy, sensitivity, and other performance metrics whilst our interactive human-AI algorithm shows superior performance with approximately 73 percent accuracy and up to 76 percent sensitivity. The results are independent of the data preparation process regarding the imputation of missing values or grouping of comorbidities. In addition, we find that the consideration of an additional label palliative care does not improve the results.

Abstract Image

Abstract Image

Abstract Image

急诊科新冠肺炎分诊2.0:分析和人工智能如何转变用于预测临床路径的人工算法。
新冠肺炎大流行已将许多医院的容量推向极限。因此,主要从伦理角度对患者的分诊进行了有争议的讨论。“分诊”一词包含许多方面,如治疗的紧迫性、疾病的严重程度和预先存在的疾病、获得重症监护的机会,或从急诊科开始的后续临床路径的患者分类。确定路径不仅对患者护理很重要,对医院的能力规划也很重要。我们基于一个大型多中心数据集,对来自LEOSS注册中心的4000多名欧洲新冠肺炎患者,研究了临床路径的人类分类算法的性能,该算法被视为德国急诊科的指南。我们发现病房类别的准确率为28%,灵敏度约为15%。这些结果是我们扩展的基准,包括作为新标签的姑息治疗、分析、人工智能、XAI和互动技术。我们发现分析和人工智能在新冠肺炎分类中的准确性、敏感性和其他性能指标方面具有巨大潜力,而我们的交互式人工智能算法显示出优异的性能,准确率约为73%,灵敏度高达76%。结果独立于缺失值插补或合并症分组的数据准备过程。此外,我们发现,考虑额外的标签姑息治疗并不能改善结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Health Care Management Science
Health Care Management Science HEALTH POLICY & SERVICES-
CiteScore
7.20
自引率
5.60%
发文量
40
期刊介绍: Health Care Management Science publishes papers dealing with health care delivery, health care management, and health care policy. Papers should have a decision focus and make use of quantitative methods including management science, operations research, analytics, machine learning, and other emerging areas. Articles must clearly articulate the relevance and the realized or potential impact of the work. Applied research will be considered and is of particular interest if there is evidence that it was implemented or informed a decision-making process. Papers describing routine applications of known methods are discouraged. Authors are encouraged to disclose all data and analyses thereof, and to provide computational code when appropriate. Editorial statements for the individual departments are provided below. Health Care Analytics Departmental Editors: Margrét Bjarnadóttir, University of Maryland Nan Kong, Purdue University With the explosion in computing power and available data, we have seen fast changes in the analytics applied in the healthcare space. The Health Care Analytics department welcomes papers applying a broad range of analytical approaches, including those rooted in machine learning, survival analysis, and complex event analysis, that allow healthcare professionals to find opportunities for improvement in health system management, patient engagement, spending, and diagnosis. We especially encourage papers that combine predictive and prescriptive analytics to improve decision making and health care outcomes. The contribution of papers can be across multiple dimensions including new methodology, novel modeling techniques and health care through real-world cohort studies. Papers that are methodologically focused need in addition to show practical relevance. Similarly papers that are application focused should clearly demonstrate improvements over the status quo and available approaches by applying rigorous analytics. Health Care Operations Management Departmental Editors: Nilay Tanik Argon, University of North Carolina at Chapel Hill Bob Batt, University of Wisconsin The department invites high-quality papers on the design, control, and analysis of operations at healthcare systems. We seek papers on classical operations management issues (such as scheduling, routing, queuing, transportation, patient flow, and quality) as well as non-traditional problems driven by everchanging healthcare practice. Empirical, experimental, and analytical (model based) methodologies are all welcome. Papers may draw theory from across disciplines, and should provide insight into improving operations from the perspective of patients, service providers, organizations (municipal/government/industry), and/or society. Health Care Management Science Practice Departmental Editor: Vikram Tiwari, Vanderbilt University Medical Center The department seeks research from academicians and practitioners that highlights Management Science based solutions directly relevant to the practice of healthcare. Relevance is judged by the impact on practice, as well as the degree to which researchers engaged with practitioners in understanding the problem context and in developing the solution. Validity, that is, the extent to which the results presented do or would apply in practice is a key evaluation criterion. In addition to meeting the journal’s standards of originality and substantial contribution to knowledge creation, research that can be replicated in other organizations is encouraged. Papers describing unsuccessful applied research projects may be considered if there are generalizable learning points addressing why the project was unsuccessful. Health Care Productivity Analysis Departmental Editor: Jonas Schreyögg, University of Hamburg The department invites papers with rigorous methods and significant impact for policy and practice. Papers typically apply theory and techniques to measuring productivity in health care organizations and systems. The journal welcomes state-of-the-art parametric as well as non-parametric techniques such as data envelopment analysis, stochastic frontier analysis or partial frontier analysis. The contribution of papers can be manifold including new methodology, novel combination of existing methods or application of existing methods to new contexts. Empirical papers should produce results generalizable beyond a selected set of health care organizations. All papers should include a section on implications for management or policy to enhance productivity. Public Health Policy and Medical Decision Making Departmental Editors: Ebru Bish, University of Alabama Julie L. Higle, University of Southern California The department invites high quality papers that use data-driven methods to address important problems that arise in public health policy and medical decision-making domains. We welcome submissions that develop and apply mathematical and computational models in support of data-driven and model-based analyses for these problems. The Public Health Policy and Medical Decision-Making Department is particularly interested in papers that: Study high-impact problems involving health policy, treatment planning and design, and clinical applications; Develop original data-driven models, including those that integrate disease modeling with screening and/or treatment guidelines; Use model-based analyses as decision making-tools to identify optimal solutions, insights, recommendations. Articles must clearly articulate the relevance of the work to decision and/or policy makers and the potential impact on patients and/or society. Papers will include articulated contributions within the methodological domain, which may include modeling, analytical, or computational methodologies. Emerging Topics Departmental Editor: Alec Morton, University of Strathclyde Emerging Topics will handle papers which use innovative quantitative methods to shed light on frontier issues in healthcare management and policy. Such papers may deal with analytic challenges arising from novel health technologies or new organizational forms. Papers falling under this department may also deal with the analysis of new forms of data which are increasingly captured as health systems become more and more digitized.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信