Katie Walker, Jirayus Jiarpakdee, Anne Loupis, Chakkrit Tantithamthavorn, Keith Joe, Michael Ben-Meir, Hamed Akhlaghi, Jennie Hutton, Wei Wang, Michael Stephenson, Gabriel Blecher, Buntine Paul, Amy Sweeny, Burak Turhan
{"title":"急诊病人等待时间多变量预测模型:多中心推导与验证研究。","authors":"Katie Walker, Jirayus Jiarpakdee, Anne Loupis, Chakkrit Tantithamthavorn, Keith Joe, Michael Ben-Meir, Hamed Akhlaghi, Jennie Hutton, Wei Wang, Michael Stephenson, Gabriel Blecher, Buntine Paul, Amy Sweeny, Burak Turhan","doi":"10.1136/emermed-2020-211000","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Patients, families and community members would like emergency department wait time visibility. This would improve patient journeys through emergency medicine. The study objective was to derive, internally and externally validate machine learning models to predict emergency patient wait times that are applicable to a wide variety of emergency departments.</p><p><strong>Methods: </strong>Twelve emergency departments provided 3 years of retrospective administrative data from Australia (2017-2019). Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine learning models were developed to predict wait times at each site and were internally and externally validated. Model performance was tested on COVID-19 period data (January to June 2020).</p><p><strong>Results: </strong>There were 1 930 609 patient episodes analysed and median site wait times varied from 24 to 54 min. Individual site model prediction median absolute errors varied from±22.6 min (95% CI 22.4 to 22.9) to ±44.0 min (95% CI 43.4 to 44.4). Global model prediction median absolute errors varied from ±33.9 min (95% CI 33.4 to 34.0) to ±43.8 min (95% CI 43.7 to 43.9). Random forest and linear regression models performed the best, rolling average models underestimated wait times. Important variables were triage category, last-k patient average wait time and arrival time. Wait time prediction models are not transferable across hospitals. Models performed well during the COVID-19 lockdown period.</p><p><strong>Conclusions: </strong>Electronic emergency demographic and flow information can be used to approximate emergency patient wait times. A general model is less accurate if applied without site-specific factors.</p>","PeriodicalId":410922,"journal":{"name":"Emergency medicine journal : EMJ","volume":" ","pages":"386-393"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Emergency medicine patient wait time multivariable prediction models: a multicentre derivation and validation study.\",\"authors\":\"Katie Walker, Jirayus Jiarpakdee, Anne Loupis, Chakkrit Tantithamthavorn, Keith Joe, Michael Ben-Meir, Hamed Akhlaghi, Jennie Hutton, Wei Wang, Michael Stephenson, Gabriel Blecher, Buntine Paul, Amy Sweeny, Burak Turhan\",\"doi\":\"10.1136/emermed-2020-211000\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Patients, families and community members would like emergency department wait time visibility. This would improve patient journeys through emergency medicine. The study objective was to derive, internally and externally validate machine learning models to predict emergency patient wait times that are applicable to a wide variety of emergency departments.</p><p><strong>Methods: </strong>Twelve emergency departments provided 3 years of retrospective administrative data from Australia (2017-2019). Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine learning models were developed to predict wait times at each site and were internally and externally validated. Model performance was tested on COVID-19 period data (January to June 2020).</p><p><strong>Results: </strong>There were 1 930 609 patient episodes analysed and median site wait times varied from 24 to 54 min. Individual site model prediction median absolute errors varied from±22.6 min (95% CI 22.4 to 22.9) to ±44.0 min (95% CI 43.4 to 44.4). Global model prediction median absolute errors varied from ±33.9 min (95% CI 33.4 to 34.0) to ±43.8 min (95% CI 43.7 to 43.9). Random forest and linear regression models performed the best, rolling average models underestimated wait times. Important variables were triage category, last-k patient average wait time and arrival time. Wait time prediction models are not transferable across hospitals. Models performed well during the COVID-19 lockdown period.</p><p><strong>Conclusions: </strong>Electronic emergency demographic and flow information can be used to approximate emergency patient wait times. A general model is less accurate if applied without site-specific factors.</p>\",\"PeriodicalId\":410922,\"journal\":{\"name\":\"Emergency medicine journal : EMJ\",\"volume\":\" \",\"pages\":\"386-393\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Emergency medicine journal : EMJ\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1136/emermed-2020-211000\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2021/8/25 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Emergency medicine journal : EMJ","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/emermed-2020-211000","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/8/25 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6
摘要
目的:了解患者、家属和社区成员对急诊科等待时间的期望。这将改善病人通过急诊就医的路程。研究目的是推导内部和外部验证机器学习模型,以预测适用于各种急诊科的急诊患者等待时间。方法:12个急诊科提供了澳大利亚(2017-2019)3年的回顾性行政数据。对数据集进行了描述性和探索性分析。开发了统计和机器学习模型来预测每个站点的等待时间,并进行了内部和外部验证。在2019冠状病毒病疫情期间(2020年1月至6月)对模型性能进行了测试。结果:共分析了1930609例患者,中位等待时间从24到54分钟不等。单个站点模型预测的中位绝对误差从±22.6 min (95% CI 22.4 ~ 22.9)到±44.0 min (95% CI 43.4 ~ 44.4)不等。全球模型预测中位绝对误差从±33.9 min (95% CI 33.4 ~ 34.0)到±43.8 min (95% CI 43.7 ~ 43.9)不等。随机森林和线性回归模型表现最好,滚动平均模型低估了等待时间。重要的变量是分诊类别、最后一位患者的平均等待时间和到达时间。等待时间预测模型不能在医院间转移。模型在COVID-19封锁期间表现良好。结论:电子急诊人口统计和流量信息可用于估计急诊患者等待时间。如果不考虑具体地点因素,一般模型的准确性就会降低。
Emergency medicine patient wait time multivariable prediction models: a multicentre derivation and validation study.
Objective: Patients, families and community members would like emergency department wait time visibility. This would improve patient journeys through emergency medicine. The study objective was to derive, internally and externally validate machine learning models to predict emergency patient wait times that are applicable to a wide variety of emergency departments.
Methods: Twelve emergency departments provided 3 years of retrospective administrative data from Australia (2017-2019). Descriptive and exploratory analyses were undertaken on the datasets. Statistical and machine learning models were developed to predict wait times at each site and were internally and externally validated. Model performance was tested on COVID-19 period data (January to June 2020).
Results: There were 1 930 609 patient episodes analysed and median site wait times varied from 24 to 54 min. Individual site model prediction median absolute errors varied from±22.6 min (95% CI 22.4 to 22.9) to ±44.0 min (95% CI 43.4 to 44.4). Global model prediction median absolute errors varied from ±33.9 min (95% CI 33.4 to 34.0) to ±43.8 min (95% CI 43.7 to 43.9). Random forest and linear regression models performed the best, rolling average models underestimated wait times. Important variables were triage category, last-k patient average wait time and arrival time. Wait time prediction models are not transferable across hospitals. Models performed well during the COVID-19 lockdown period.
Conclusions: Electronic emergency demographic and flow information can be used to approximate emergency patient wait times. A general model is less accurate if applied without site-specific factors.