Xu‐Hua Zhou, Di‐Fei Duan, Meng Zhang, Shuang Liu, Jing Lv, Yi Wang, Lin Chen, Ying‐Jun Zhang, Bo Gu, Qian Chen
{"title":"基于机器学习的老年住院患者谵妄风险预测模型的开发和验证:一项前瞻性队列研究","authors":"Xu‐Hua Zhou, Di‐Fei Duan, Meng Zhang, Shuang Liu, Jing Lv, Yi Wang, Lin Chen, Ying‐Jun Zhang, Bo Gu, Qian Chen","doi":"10.1111/jan.70154","DOIUrl":null,"url":null,"abstract":"AimsTo develop and validate a machine learning‐based risk prediction model for delirium in older inpatients.DesignA prospective cohort study.MethodsA prospective cohort study was conducted. Eighteen clinical features were prospectively collected from electronic medical records during hospitalisation to inform the model. Four machine learning algorithms were employed to develop and validate risk prediction models. The performance of all models in the training and test sets was evaluated using a combination of the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, Brier score, and other metrics before selecting the best model for SHAP interpretation.ResultsA total of 973 older inpatient data were utilised for model construction and validation. The AUC of four machine learning models in the training and test sets ranged from 0.869 to 0.992; the accuracy ranged from 0.931 to 0.962; and the sensitivity ranged from 0.564 to 0.997. Compared to other models, the Random Forest model exhibited the best overall performance with an AUC of 0.908 (95% CI, 0.848, 0.968), an accuracy of 0.935, a sensitivity of 0.992, and a Brier score of 0.053.ConclusionThe machine learning model we developed and validated for predicting delirium in older inpatients demonstrated excellent predictive performance. This model has the potential to assist healthcare professionals in early diagnosis and support informed clinical decision‐making.ImpactBy identifying patients at risk of delirium early, healthcare professionals can implement preventive measures and timely interventions, potentially reducing the incidence and severity of delirium. The model's ability to support informed clinical decision‐making can lead to more personalised and effective care strategies, ultimately benefiting both patients and healthcare providers.Reporting MethodThis study was reported in accordance with the TRIPOD statement.Patient or Public ContributionNo patient or public contribution.","PeriodicalId":54897,"journal":{"name":"Journal of Advanced Nursing","volume":"122 1","pages":""},"PeriodicalIF":3.4000,"publicationDate":"2025-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and Validation of a Machine Learning‐Based Risk Prediction Model for Delirium in Older Inpatients: A Prospective Cohort Study\",\"authors\":\"Xu‐Hua Zhou, Di‐Fei Duan, Meng Zhang, Shuang Liu, Jing Lv, Yi Wang, Lin Chen, Ying‐Jun Zhang, Bo Gu, Qian Chen\",\"doi\":\"10.1111/jan.70154\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"AimsTo develop and validate a machine learning‐based risk prediction model for delirium in older inpatients.DesignA prospective cohort study.MethodsA prospective cohort study was conducted. Eighteen clinical features were prospectively collected from electronic medical records during hospitalisation to inform the model. Four machine learning algorithms were employed to develop and validate risk prediction models. The performance of all models in the training and test sets was evaluated using a combination of the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, Brier score, and other metrics before selecting the best model for SHAP interpretation.ResultsA total of 973 older inpatient data were utilised for model construction and validation. The AUC of four machine learning models in the training and test sets ranged from 0.869 to 0.992; the accuracy ranged from 0.931 to 0.962; and the sensitivity ranged from 0.564 to 0.997. Compared to other models, the Random Forest model exhibited the best overall performance with an AUC of 0.908 (95% CI, 0.848, 0.968), an accuracy of 0.935, a sensitivity of 0.992, and a Brier score of 0.053.ConclusionThe machine learning model we developed and validated for predicting delirium in older inpatients demonstrated excellent predictive performance. This model has the potential to assist healthcare professionals in early diagnosis and support informed clinical decision‐making.ImpactBy identifying patients at risk of delirium early, healthcare professionals can implement preventive measures and timely interventions, potentially reducing the incidence and severity of delirium. The model's ability to support informed clinical decision‐making can lead to more personalised and effective care strategies, ultimately benefiting both patients and healthcare providers.Reporting MethodThis study was reported in accordance with the TRIPOD statement.Patient or Public ContributionNo patient or public contribution.\",\"PeriodicalId\":54897,\"journal\":{\"name\":\"Journal of Advanced Nursing\",\"volume\":\"122 1\",\"pages\":\"\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-09-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Advanced Nursing\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/jan.70154\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"NURSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Advanced Nursing","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/jan.70154","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NURSING","Score":null,"Total":0}
Development and Validation of a Machine Learning‐Based Risk Prediction Model for Delirium in Older Inpatients: A Prospective Cohort Study
AimsTo develop and validate a machine learning‐based risk prediction model for delirium in older inpatients.DesignA prospective cohort study.MethodsA prospective cohort study was conducted. Eighteen clinical features were prospectively collected from electronic medical records during hospitalisation to inform the model. Four machine learning algorithms were employed to develop and validate risk prediction models. The performance of all models in the training and test sets was evaluated using a combination of the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, Brier score, and other metrics before selecting the best model for SHAP interpretation.ResultsA total of 973 older inpatient data were utilised for model construction and validation. The AUC of four machine learning models in the training and test sets ranged from 0.869 to 0.992; the accuracy ranged from 0.931 to 0.962; and the sensitivity ranged from 0.564 to 0.997. Compared to other models, the Random Forest model exhibited the best overall performance with an AUC of 0.908 (95% CI, 0.848, 0.968), an accuracy of 0.935, a sensitivity of 0.992, and a Brier score of 0.053.ConclusionThe machine learning model we developed and validated for predicting delirium in older inpatients demonstrated excellent predictive performance. This model has the potential to assist healthcare professionals in early diagnosis and support informed clinical decision‐making.ImpactBy identifying patients at risk of delirium early, healthcare professionals can implement preventive measures and timely interventions, potentially reducing the incidence and severity of delirium. The model's ability to support informed clinical decision‐making can lead to more personalised and effective care strategies, ultimately benefiting both patients and healthcare providers.Reporting MethodThis study was reported in accordance with the TRIPOD statement.Patient or Public ContributionNo patient or public contribution.
期刊介绍:
The Journal of Advanced Nursing (JAN) contributes to the advancement of evidence-based nursing, midwifery and healthcare by disseminating high quality research and scholarship of contemporary relevance and with potential to advance knowledge for practice, education, management or policy.
All JAN papers are required to have a sound scientific, evidential, theoretical or philosophical base and to be critical, questioning and scholarly in approach. As an international journal, JAN promotes diversity of research and scholarship in terms of culture, paradigm and healthcare context. For JAN’s worldwide readership, authors are expected to make clear the wider international relevance of their work and to demonstrate sensitivity to cultural considerations and differences.