Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu
{"title":"预测英国家庭护理居民的住院风险:基于机器学习的预测模型的开发与验证","authors":"Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu","doi":"10.1177/10848223241253839","DOIUrl":null,"url":null,"abstract":"Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.","PeriodicalId":512411,"journal":{"name":"Home Health Care Management & Practice","volume":"53 14","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model\",\"authors\":\"Nathan Windle, Azeem Alam, Horus Patel, Jonathan M. Street, Megan Lathwood, Tessa Farrington, M. Maruthappu\",\"doi\":\"10.1177/10848223241253839\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.\",\"PeriodicalId\":512411,\"journal\":{\"name\":\"Home Health Care Management & Practice\",\"volume\":\"53 14\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Home Health Care Management & Practice\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/10848223241253839\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Home Health Care Management & Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/10848223241253839","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Predicting Hospitalization Risk Among Home Care Residents in the United Kingdom: Development and Validation of a Machine Learning-Based Predictive Model
Preventable hospital admissions in elderly home care residents are a major socioeconomic burden, whilst early detection of deterioration may improve outcomes. Our goal was to develop and validate a machine learning-based algorithm to predict hospitalization risk among home care users. Our primary outcome was hospitalization. An existing risk score (1-5) was assessed for its discriminatory capacity over time. We subsequently developed a new machine learning model using carer concerns, service user demographics, and other home care data between January and July 2021. We randomly selected 150 service user records for validation, which were evaluated by both the model and 10 clinicians (9 doctors and 1 nurse) to compare prediction time and accuracy to human experts. Comparison between model and human was via area under the receiver operating characteristic curve (AUC). A score of 5 conferred an 8x higher likelihood of hospitalization in the subsequent 7 days (15.4% vs 1.8%, p < .05), compared to a score of 1. The new model and risk score increased performance, detecting 182 hospitalizations/month (3.7x chance). The AUC for the model was significantly higher than for clinicians (0.87 vs 0.41-0.57, respectively; p < .05). The model took <1 minute, while clinicians typically took over 40 minutes. A risk prediction model using carer concerns and other home care data features detects 3.7x more hospitalizations than chance. The model is faster and more accurate than human clinicians, enabling low-cost scale-up. This study supports linking the model to a triage and intervention service to reduce preventable hospitalizations in the home care sector.