Ben Kandel PhD , Cheryl Field MSN, RN , Jasmeet Kaur MS , Dean Slawson BS , Joseph G. Ouslander MD
{"title":"为专业护理机构患者开发住院预测模型。","authors":"Ben Kandel PhD , Cheryl Field MSN, RN , Jasmeet Kaur MS , Dean Slawson BS , Joseph G. Ouslander MD","doi":"10.1016/j.jamda.2024.105288","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>Identifying skilled nursing facility (SNF) patients at risk for hospitalization or death is of interest to SNFs, patients, and patients' families because of quality measures, financial penalties, and limited clinical staffing. We aimed to develop a predictive model that identifies SNF patients likely to be hospitalized or die within the next 7 days and validate the model's performance against clinician judgment.</div></div><div><h3>Design</h3><div>Retrospective multivariate prognostic model development study.</div></div><div><h3>Setting and Participants</h3><div>Patients in US SNFs that use the PointClickCare electronic health record (EHR) system. We used data from the first 100 days of skilled stays for 5,642,474 patients in 8440 SNFs, from January 1, 2019, through March 31, 2023.</div></div><div><h3>Methods</h3><div>We used data collected in the course of clinical care to develop a machine learning model to predict the likelihood of patient hospitalization or death within the next 7 days. The data included vital signs, diagnoses, laboratory results, food intake, and clinical notes. We also asked SNF nurses and hospital case managers to make their own predictions as a comparison. The EHR was used as the source of information on whether the patient died or was hospitalized.</div></div><div><h3>Results</h3><div>The model had sensitivity of 35%, specificity of 92%, positive predictive value (PPV) of 18%, and area under the receiver operator curve (AUC) of 0.75. A variation of the model in which we did not include progress notes and food intake achieved an AUC of 0.70. Nurse raters achieved a sensitivity of 61%, specificity of 73%, and PPV of 10%.</div></div><div><h3>Conclusions and Implications</h3><div>Machine learning models can accurately predict the likelihood of hospitalization or death within the next 7 days among SNF patients. These models do not require additional SNF staff time and may be useful in readmission reduction programs by targeting more frequent monitoring proactively to those at highest risk.</div></div>","PeriodicalId":17180,"journal":{"name":"Journal of the American Medical Directors Association","volume":"26 1","pages":"Article 105288"},"PeriodicalIF":4.2000,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of a Predictive Hospitalization Model for Skilled Nursing Facility Patients\",\"authors\":\"Ben Kandel PhD , Cheryl Field MSN, RN , Jasmeet Kaur MS , Dean Slawson BS , Joseph G. Ouslander MD\",\"doi\":\"10.1016/j.jamda.2024.105288\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objectives</h3><div>Identifying skilled nursing facility (SNF) patients at risk for hospitalization or death is of interest to SNFs, patients, and patients' families because of quality measures, financial penalties, and limited clinical staffing. We aimed to develop a predictive model that identifies SNF patients likely to be hospitalized or die within the next 7 days and validate the model's performance against clinician judgment.</div></div><div><h3>Design</h3><div>Retrospective multivariate prognostic model development study.</div></div><div><h3>Setting and Participants</h3><div>Patients in US SNFs that use the PointClickCare electronic health record (EHR) system. We used data from the first 100 days of skilled stays for 5,642,474 patients in 8440 SNFs, from January 1, 2019, through March 31, 2023.</div></div><div><h3>Methods</h3><div>We used data collected in the course of clinical care to develop a machine learning model to predict the likelihood of patient hospitalization or death within the next 7 days. The data included vital signs, diagnoses, laboratory results, food intake, and clinical notes. We also asked SNF nurses and hospital case managers to make their own predictions as a comparison. The EHR was used as the source of information on whether the patient died or was hospitalized.</div></div><div><h3>Results</h3><div>The model had sensitivity of 35%, specificity of 92%, positive predictive value (PPV) of 18%, and area under the receiver operator curve (AUC) of 0.75. A variation of the model in which we did not include progress notes and food intake achieved an AUC of 0.70. Nurse raters achieved a sensitivity of 61%, specificity of 73%, and PPV of 10%.</div></div><div><h3>Conclusions and Implications</h3><div>Machine learning models can accurately predict the likelihood of hospitalization or death within the next 7 days among SNF patients. These models do not require additional SNF staff time and may be useful in readmission reduction programs by targeting more frequent monitoring proactively to those at highest risk.</div></div>\",\"PeriodicalId\":17180,\"journal\":{\"name\":\"Journal of the American Medical Directors Association\",\"volume\":\"26 1\",\"pages\":\"Article 105288\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the American Medical Directors Association\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1525861024007102\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"GERIATRICS & GERONTOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Medical Directors Association","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1525861024007102","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
Development of a Predictive Hospitalization Model for Skilled Nursing Facility Patients
Objectives
Identifying skilled nursing facility (SNF) patients at risk for hospitalization or death is of interest to SNFs, patients, and patients' families because of quality measures, financial penalties, and limited clinical staffing. We aimed to develop a predictive model that identifies SNF patients likely to be hospitalized or die within the next 7 days and validate the model's performance against clinician judgment.
Design
Retrospective multivariate prognostic model development study.
Setting and Participants
Patients in US SNFs that use the PointClickCare electronic health record (EHR) system. We used data from the first 100 days of skilled stays for 5,642,474 patients in 8440 SNFs, from January 1, 2019, through March 31, 2023.
Methods
We used data collected in the course of clinical care to develop a machine learning model to predict the likelihood of patient hospitalization or death within the next 7 days. The data included vital signs, diagnoses, laboratory results, food intake, and clinical notes. We also asked SNF nurses and hospital case managers to make their own predictions as a comparison. The EHR was used as the source of information on whether the patient died or was hospitalized.
Results
The model had sensitivity of 35%, specificity of 92%, positive predictive value (PPV) of 18%, and area under the receiver operator curve (AUC) of 0.75. A variation of the model in which we did not include progress notes and food intake achieved an AUC of 0.70. Nurse raters achieved a sensitivity of 61%, specificity of 73%, and PPV of 10%.
Conclusions and Implications
Machine learning models can accurately predict the likelihood of hospitalization or death within the next 7 days among SNF patients. These models do not require additional SNF staff time and may be useful in readmission reduction programs by targeting more frequent monitoring proactively to those at highest risk.
期刊介绍:
JAMDA, the official journal of AMDA - The Society for Post-Acute and Long-Term Care Medicine, is a leading peer-reviewed publication that offers practical information and research geared towards healthcare professionals in the post-acute and long-term care fields. It is also a valuable resource for policy-makers, organizational leaders, educators, and advocates.
The journal provides essential information for various healthcare professionals such as medical directors, attending physicians, nurses, consultant pharmacists, geriatric psychiatrists, nurse practitioners, physician assistants, physical and occupational therapists, social workers, and others involved in providing, overseeing, and promoting quality