Herdiantri Sufriyana, Chieh Chen, Hua-Sheng Chiu, Pavel Sumazin, Po-Yu Yang, Jiunn-Horng Kang, Emily Chia-Yu Su
{"title":"在临床数据上使用可解释人工智能估算导尿管相关尿路感染的个人风险。","authors":"Herdiantri Sufriyana, Chieh Chen, Hua-Sheng Chiu, Pavel Sumazin, Po-Yu Yang, Jiunn-Horng Kang, Emily Chia-Yu Su","doi":"10.1016/j.ajic.2024.10.027","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Catheter-associated urinary tract infections (CAUTIs) increase clinical burdens. Identifying the high-risk patients is crucial. We aimed to develop and externally validate an explainable, prognostic prediction model of CAUTIs among hospitalized individuals receiving urinary catheterization.</p><p><strong>Methods: </strong>A retrospective cohort paradigm was applied for model development and validation using data from two hospitals and used the third hospital's data for external validation. Machine learning algorithms were applied for predictive modeling. We evaluated the calibration, clinical utility, and discrimination ability to choose the best model by the validation set. The best model was assessed for the explainability.</p><p><strong>Results: </strong>We included 122,417 instances from 20-to-75-year-old subjects. Fourteen predictors were selected from 20 candidates. The best model was the RF for prediction within 6 days. It detected 97.63% (95% confidence interval [CI]: ±0.06%) CAUTI positive, and 97.36% (95% CI: ±0.07%) of individuals that were predicted to be CAUTI negative were true negatives. Among those predicted to be CAUTI positives, we expected 22.85% (95% CI: ±0.07%) of them to truly be high-risk individuals. We provide a web-based application and a paper-based nomogram for using this model.</p><p><strong>Conclusions: </strong>Our prediction model accurately detected most CAUTI positive cases, while most predicted negative individuals were correctly ruled out.</p>","PeriodicalId":7621,"journal":{"name":"American journal of infection control","volume":null,"pages":null},"PeriodicalIF":3.8000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Estimating individual risk of catheter-associated urinary tract infections using explainable artificial intelligence on clinical data.\",\"authors\":\"Herdiantri Sufriyana, Chieh Chen, Hua-Sheng Chiu, Pavel Sumazin, Po-Yu Yang, Jiunn-Horng Kang, Emily Chia-Yu Su\",\"doi\":\"10.1016/j.ajic.2024.10.027\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Catheter-associated urinary tract infections (CAUTIs) increase clinical burdens. Identifying the high-risk patients is crucial. We aimed to develop and externally validate an explainable, prognostic prediction model of CAUTIs among hospitalized individuals receiving urinary catheterization.</p><p><strong>Methods: </strong>A retrospective cohort paradigm was applied for model development and validation using data from two hospitals and used the third hospital's data for external validation. Machine learning algorithms were applied for predictive modeling. We evaluated the calibration, clinical utility, and discrimination ability to choose the best model by the validation set. The best model was assessed for the explainability.</p><p><strong>Results: </strong>We included 122,417 instances from 20-to-75-year-old subjects. Fourteen predictors were selected from 20 candidates. The best model was the RF for prediction within 6 days. It detected 97.63% (95% confidence interval [CI]: ±0.06%) CAUTI positive, and 97.36% (95% CI: ±0.07%) of individuals that were predicted to be CAUTI negative were true negatives. Among those predicted to be CAUTI positives, we expected 22.85% (95% CI: ±0.07%) of them to truly be high-risk individuals. We provide a web-based application and a paper-based nomogram for using this model.</p><p><strong>Conclusions: </strong>Our prediction model accurately detected most CAUTI positive cases, while most predicted negative individuals were correctly ruled out.</p>\",\"PeriodicalId\":7621,\"journal\":{\"name\":\"American journal of infection control\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2024-10-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"American journal of infection control\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.ajic.2024.10.027\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INFECTIOUS DISEASES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"American journal of infection control","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ajic.2024.10.027","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
Estimating individual risk of catheter-associated urinary tract infections using explainable artificial intelligence on clinical data.
Background: Catheter-associated urinary tract infections (CAUTIs) increase clinical burdens. Identifying the high-risk patients is crucial. We aimed to develop and externally validate an explainable, prognostic prediction model of CAUTIs among hospitalized individuals receiving urinary catheterization.
Methods: A retrospective cohort paradigm was applied for model development and validation using data from two hospitals and used the third hospital's data for external validation. Machine learning algorithms were applied for predictive modeling. We evaluated the calibration, clinical utility, and discrimination ability to choose the best model by the validation set. The best model was assessed for the explainability.
Results: We included 122,417 instances from 20-to-75-year-old subjects. Fourteen predictors were selected from 20 candidates. The best model was the RF for prediction within 6 days. It detected 97.63% (95% confidence interval [CI]: ±0.06%) CAUTI positive, and 97.36% (95% CI: ±0.07%) of individuals that were predicted to be CAUTI negative were true negatives. Among those predicted to be CAUTI positives, we expected 22.85% (95% CI: ±0.07%) of them to truly be high-risk individuals. We provide a web-based application and a paper-based nomogram for using this model.
Conclusions: Our prediction model accurately detected most CAUTI positive cases, while most predicted negative individuals were correctly ruled out.
期刊介绍:
AJIC covers key topics and issues in infection control and epidemiology. Infection control professionals, including physicians, nurses, and epidemiologists, rely on AJIC for peer-reviewed articles covering clinical topics as well as original research. As the official publication of the Association for Professionals in Infection Control and Epidemiology (APIC)