Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model

Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu
{"title":"Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model","authors":"Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu","doi":"10.1177/10848223241253839","DOIUrl":null,"url":null,"abstract":"Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.","PeriodicalId":512411,"journal":{"name":"Home Health Care Management &amp; Practice","volume":"53 14","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Home Health Care Management &amp; Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/10848223241253839","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.
预测英国家庭护理居民的住院风险:基于机器学习的预测模型的开发与验证
老年居家护理居民可预防的入院治疗是一项重大的社会经济负担,而及早发现病情恶化可能会改善治疗效果。我们的目标是开发并验证一种基于机器学习的算法,用于预测居家养老用户的住院风险。我们的主要结果是住院。我们评估了现有风险评分(1-5 分)在一段时间内的判别能力。随后,我们利用护理人员的关注点、服务使用者的人口统计数据以及 2021 年 1 月至 7 月期间的其他家庭护理数据,开发了一个新的机器学习模型。我们随机选取了 150 份服务用户记录进行验证,由模型和 10 名临床医生(9 名医生和 1 名护士)对这些记录进行评估,将预测时间和准确性与人类专家进行比较。模型和人类专家之间的比较是通过接收者操作特征曲线下面积(AUC)进行的。与评分为 1 的人相比,评分为 5 的人在随后 7 天内住院的可能性要高出 8 倍(15.4% vs 1.8%,p < .05)。模型的AUC明显高于临床医生(分别为0.87 vs 0.41-0.57; p < .05)。该模型耗时小于 1 分钟,而临床医生通常需要 40 分钟以上。风险预测模型使用了护理人员的关注点和其他家庭护理数据特征,检测到的住院率是概率的 3.7 倍。该模型比人类临床医生更快、更准确,可实现低成本扩展。这项研究支持将该模型与分诊和干预服务联系起来,以减少家庭护理领域可预防的住院治疗。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信