Orhun Vural, Bunyamin Ozaydin, Khalid Y Aram, James Booth, Brittany Freeman Lindsey, Abdulaziz Ahmed
{"title":"基于人工智能的急诊科过度拥挤预测框架:开发与评价研究。","authors":"Orhun Vural, Bunyamin Ozaydin, Khalid Y Aram, James Booth, Brittany Freeman Lindsey, Abdulaziz Ahmed","doi":"10.2196/73960","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Emergency department (ED) overcrowding remains a critical challenge, leading to delays in patient care and increased operational strain. Current hospital management strategies often rely on reactive decision-making, addressing congestion only after it occurs. However, effective patient flow management requires early identification of overcrowding risks to allow timely interventions. Machine learning (ML)-based predictive modeling offers a solution by forecasting key patient flow measures, such as waiting count, enabling proactive resource allocation and improved hospital efficiency.</p><p><strong>Objective: </strong>The aim of this study is to develop ML models that predict ED waiting room occupancy (waiting count) at 2 temporal resolutions. The first approach is the hourly prediction model, which estimates the waiting count exactly 6 hours ahead at each prediction time (eg, a 1 PM prediction forecasts 7 PM). The second approach is the daily prediction model, which forecasts the average waiting count for the next 24-hour period (eg, a 5 PM prediction estimates the following day's average). These predictive tools support resource allocation and help mitigate overcrowding by enabling proactive interventions before congestion occurs.</p><p><strong>Methods: </strong>Data from a partner hospital's ED in the southeastern United States were used, integrating internal and external sources. Eleven different ML algorithms, ranging from traditional approaches to deep learning architectures, were systematically trained and evaluated on both hourly and daily predictions to determine the models that achieved the lowest prediction error. Experiments optimized feature combinations, and the best models were tested under high patient volume and across different hours to assess temporal accuracy.</p><p><strong>Results: </strong>The best hourly prediction performance was achieved by time series vision transformer plus (TSiTPlus) with a mean absolute error (MAE) of 4.19 and a mean squared error (MSE) of 29.36. The overall hourly waiting count had a mean of 18.11 and a SD (σ) of 9.77. Prediction accuracy varied by time of day, with the lowest MAE at 11 PM (2.45) and the highest at 8 PM (5.45). Extreme case analysis at (mean + 1σ), (mean + 2σ), and (mean + 3σ) resulted in MAEs of 6.16, 10.16, and 15.59, respectively. For daily predictions, an explainable convolutional neural network plus (XCMPlus) achieved the best results with an MAE of 2.00 and a MSE of 6.64. The daily waiting count had a mean of 18.11 and a SD of 4.51. Both models outperformed traditional forecasting approaches across multiple evaluation metrics.</p><p><strong>Conclusions: </strong>The proposed prediction models effectively forecast ED waiting count at both hourly and daily intervals. The results demonstrate the value of integrating diverse data sources and applying advanced modeling techniques to support proactive resource allocation decisions. The implementation of these forecasting tools within hospital management systems has the potential to improve patient flow and reduce overcrowding in emergency care settings. The code is available in our GitHub repository.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"13 ","pages":"e73960"},"PeriodicalIF":3.8000,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12489414/pdf/","citationCount":"0","resultStr":"{\"title\":\"An Artificial Intelligence-Based Framework for Predicting Emergency Department Overcrowding: Development and Evaluation Study.\",\"authors\":\"Orhun Vural, Bunyamin Ozaydin, Khalid Y Aram, James Booth, Brittany Freeman Lindsey, Abdulaziz Ahmed\",\"doi\":\"10.2196/73960\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Emergency department (ED) overcrowding remains a critical challenge, leading to delays in patient care and increased operational strain. Current hospital management strategies often rely on reactive decision-making, addressing congestion only after it occurs. However, effective patient flow management requires early identification of overcrowding risks to allow timely interventions. Machine learning (ML)-based predictive modeling offers a solution by forecasting key patient flow measures, such as waiting count, enabling proactive resource allocation and improved hospital efficiency.</p><p><strong>Objective: </strong>The aim of this study is to develop ML models that predict ED waiting room occupancy (waiting count) at 2 temporal resolutions. The first approach is the hourly prediction model, which estimates the waiting count exactly 6 hours ahead at each prediction time (eg, a 1 PM prediction forecasts 7 PM). The second approach is the daily prediction model, which forecasts the average waiting count for the next 24-hour period (eg, a 5 PM prediction estimates the following day's average). These predictive tools support resource allocation and help mitigate overcrowding by enabling proactive interventions before congestion occurs.</p><p><strong>Methods: </strong>Data from a partner hospital's ED in the southeastern United States were used, integrating internal and external sources. Eleven different ML algorithms, ranging from traditional approaches to deep learning architectures, were systematically trained and evaluated on both hourly and daily predictions to determine the models that achieved the lowest prediction error. Experiments optimized feature combinations, and the best models were tested under high patient volume and across different hours to assess temporal accuracy.</p><p><strong>Results: </strong>The best hourly prediction performance was achieved by time series vision transformer plus (TSiTPlus) with a mean absolute error (MAE) of 4.19 and a mean squared error (MSE) of 29.36. The overall hourly waiting count had a mean of 18.11 and a SD (σ) of 9.77. Prediction accuracy varied by time of day, with the lowest MAE at 11 PM (2.45) and the highest at 8 PM (5.45). Extreme case analysis at (mean + 1σ), (mean + 2σ), and (mean + 3σ) resulted in MAEs of 6.16, 10.16, and 15.59, respectively. For daily predictions, an explainable convolutional neural network plus (XCMPlus) achieved the best results with an MAE of 2.00 and a MSE of 6.64. The daily waiting count had a mean of 18.11 and a SD of 4.51. Both models outperformed traditional forecasting approaches across multiple evaluation metrics.</p><p><strong>Conclusions: </strong>The proposed prediction models effectively forecast ED waiting count at both hourly and daily intervals. The results demonstrate the value of integrating diverse data sources and applying advanced modeling techniques to support proactive resource allocation decisions. The implementation of these forecasting tools within hospital management systems has the potential to improve patient flow and reduce overcrowding in emergency care settings. The code is available in our GitHub repository.</p>\",\"PeriodicalId\":56334,\"journal\":{\"name\":\"JMIR Medical Informatics\",\"volume\":\"13 \",\"pages\":\"e73960\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2025-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12489414/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR Medical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2196/73960\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MEDICAL INFORMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/73960","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
摘要
背景:急诊科(ED)过度拥挤仍然是一个严峻的挑战,导致患者护理延误和操作压力增加。目前的医院管理策略往往依赖于反应性决策,仅在拥堵发生后才解决。然而,有效的病人流量管理需要及早发现过度拥挤的风险,以便及时采取干预措施。基于机器学习(ML)的预测建模提供了一种解决方案,通过预测关键的患者流量指标(如等待次数),实现主动资源分配并提高医院效率。目的:本研究的目的是建立两种时间分辨率下预测急诊科候诊室占用率(候诊数)的ML模型。第一种方法是每小时预测模型,它在每个预测时间准确地提前6小时估计等待人数(例如,下午1点的预测预测晚上7点)。第二种方法是每日预测模型,它预测未来24小时内的平均等候人数(例如,下午5点的预测估计第二天的平均等候人数)。这些预测工具支持资源分配,并通过在拥堵发生之前进行主动干预,帮助缓解过度拥挤。方法:采用来自美国东南部一家合作医院急诊科的数据,整合内部和外部来源。11种不同的机器学习算法,从传统方法到深度学习架构,在每小时和每天的预测中进行了系统的训练和评估,以确定实现最低预测误差的模型。实验优化了特征组合,并在高患者量和不同小时的情况下对最佳模型进行了测试,以评估时间准确性。结果:time series vision transformer plus (TSiTPlus)逐小时预测效果最佳,平均绝对误差(MAE)为4.19,均方误差(MSE)为29.36。候诊时数平均值为18.11,标准差(σ)为9.77。预测精度随时间的变化而变化,MAE在晚上11点(2.45)最低,在晚上8点(5.45)最高。在(mean + 1σ)、(mean + 2σ)和(mean + 3σ)的极端情况下,MAEs分别为6.16、10.16和15.59。对于日常预测,可解释卷积神经网络plus (XCMPlus)获得了最好的结果,MAE为2.00,MSE为6.64。平均每日等候次数为18.11次,标准差为4.51次。这两种模型在多个评估指标上都优于传统的预测方法。结论:所建立的预测模型能有效预测每小时和每天的急诊科候诊次数。结果证明了集成不同数据源和应用高级建模技术来支持主动资源分配决策的价值。在医院管理系统中实施这些预测工具有可能改善患者流量并减少急诊环境中的过度拥挤。代码可以在我们的GitHub存储库中获得。
An Artificial Intelligence-Based Framework for Predicting Emergency Department Overcrowding: Development and Evaluation Study.
Background: Emergency department (ED) overcrowding remains a critical challenge, leading to delays in patient care and increased operational strain. Current hospital management strategies often rely on reactive decision-making, addressing congestion only after it occurs. However, effective patient flow management requires early identification of overcrowding risks to allow timely interventions. Machine learning (ML)-based predictive modeling offers a solution by forecasting key patient flow measures, such as waiting count, enabling proactive resource allocation and improved hospital efficiency.
Objective: The aim of this study is to develop ML models that predict ED waiting room occupancy (waiting count) at 2 temporal resolutions. The first approach is the hourly prediction model, which estimates the waiting count exactly 6 hours ahead at each prediction time (eg, a 1 PM prediction forecasts 7 PM). The second approach is the daily prediction model, which forecasts the average waiting count for the next 24-hour period (eg, a 5 PM prediction estimates the following day's average). These predictive tools support resource allocation and help mitigate overcrowding by enabling proactive interventions before congestion occurs.
Methods: Data from a partner hospital's ED in the southeastern United States were used, integrating internal and external sources. Eleven different ML algorithms, ranging from traditional approaches to deep learning architectures, were systematically trained and evaluated on both hourly and daily predictions to determine the models that achieved the lowest prediction error. Experiments optimized feature combinations, and the best models were tested under high patient volume and across different hours to assess temporal accuracy.
Results: The best hourly prediction performance was achieved by time series vision transformer plus (TSiTPlus) with a mean absolute error (MAE) of 4.19 and a mean squared error (MSE) of 29.36. The overall hourly waiting count had a mean of 18.11 and a SD (σ) of 9.77. Prediction accuracy varied by time of day, with the lowest MAE at 11 PM (2.45) and the highest at 8 PM (5.45). Extreme case analysis at (mean + 1σ), (mean + 2σ), and (mean + 3σ) resulted in MAEs of 6.16, 10.16, and 15.59, respectively. For daily predictions, an explainable convolutional neural network plus (XCMPlus) achieved the best results with an MAE of 2.00 and a MSE of 6.64. The daily waiting count had a mean of 18.11 and a SD of 4.51. Both models outperformed traditional forecasting approaches across multiple evaluation metrics.
Conclusions: The proposed prediction models effectively forecast ED waiting count at both hourly and daily intervals. The results demonstrate the value of integrating diverse data sources and applying advanced modeling techniques to support proactive resource allocation decisions. The implementation of these forecasting tools within hospital management systems has the potential to improve patient flow and reduce overcrowding in emergency care settings. The code is available in our GitHub repository.
期刊介绍:
JMIR Medical Informatics (JMI, ISSN 2291-9694) is a top-rated, tier A journal which focuses on clinical informatics, big data in health and health care, decision support for health professionals, electronic health records, ehealth infrastructures and implementation. It has a focus on applied, translational research, with a broad readership including clinicians, CIOs, engineers, industry and health informatics professionals.
Published by JMIR Publications, publisher of the Journal of Medical Internet Research (JMIR), the leading eHealth/mHealth journal (Impact Factor 2016: 5.175), JMIR Med Inform has a slightly different scope (emphasizing more on applications for clinicians and health professionals rather than consumers/citizens, which is the focus of JMIR), publishes even faster, and also allows papers which are more technical or more formative than what would be published in the Journal of Medical Internet Research.