Construction and validation of a machine learning-based nomogram model for predicting pneumonia risk in patients with catatonia: a retrospective observational study.
Yi-Chao Wang, Qian He, Yue-Jing Wu, Li Zhang, Sha Wu, Xiao-Jia Fang, Shao-Shen Jia, Fu-Gang Luo
{"title":"Construction and validation of a machine learning-based nomogram model for predicting pneumonia risk in patients with catatonia: a retrospective observational study.","authors":"Yi-Chao Wang, Qian He, Yue-Jing Wu, Li Zhang, Sha Wu, Xiao-Jia Fang, Shao-Shen Jia, Fu-Gang Luo","doi":"10.3389/fpsyt.2025.1557659","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Catatonia was often complicated by pneumonia, and the development of severe pneumonia after admission posed significant challenges to its treatment. This study aimed to develop a Nomogram Model based on pre-admission characteristics of patients with catatonia to predict the risk of pneumonia after admission.</p><p><strong>Methods: </strong>This retrospective observational study reviewed catatonia patients hospitalized at Hangzhou Seventh People's Hospital from September 2019 to November 2024. Data included demographic characteristics, medical history, maintenance medications, and pre-admission clinical presentations. Patients were divided into catatonia with and without pneumonia groups. The LASSO Algorithm was used for feature selection, and seven machine learning models: Decision Tree(DT), Logistic Regression(LR), Naive Bayes(NB), Random Forest(RF), K Nearest Neighbors(KNN), Gradient Boosting Machine(GBM), Support Vector Machine(SVM) were trained. Model performance was evaluated using AUC, Accuracy, Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value, F1 Score, Cohen's Kappa, and Brier Score, and Brier score. The best-performing model was selected for multivariable analysis to determine the variables included in the final Nomogram Model. The Nomogram Model was further validated through ROC Curves, Calibration Curves, Decision Curve Analysis (DCA), and Bootstrapping to ensure discrimination, calibration, and clinical applicability.</p><p><strong>Results: </strong>Among 156 patients, 79 had no pneumonia, and 77 had pneumonia. LASSO Algorithm identified 15 non-zero coefficient variables (LASSO 1-SEλ=0.076). The GBM showed the best performance (AUC = 0.954, 95% CI: 0.924-0.983, <i>vs</i> other models by DeLong's test: <i>P</i> < 0.05). Five key variables: Age, Clozapine, Diaphoresis, Intake Refusal, and Waxy Flexibility were used to construct the Nomogram Model. Validation showed good discrimination (AUC = 0.803, 95% CI: 0.735-0.870), calibration, and clinical applicability. Internal validation (Bootstrapping, n=500) confirmed model stability (AUC = 0.814, 95% CI: 0.743-0.878; Hosmer-Lemeshow <i>P</i> = 0.525).</p><p><strong>Conclusion: </strong>This study developed a Nomogram Model based on five key factors, demonstrating significant clinical value in predicting the risk of pneumonia in hospitalized patients with catatonia.</p>","PeriodicalId":12605,"journal":{"name":"Frontiers in Psychiatry","volume":"16 ","pages":"1557659"},"PeriodicalIF":3.2000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11951867/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Psychiatry","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fpsyt.2025.1557659","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Catatonia was often complicated by pneumonia, and the development of severe pneumonia after admission posed significant challenges to its treatment. This study aimed to develop a Nomogram Model based on pre-admission characteristics of patients with catatonia to predict the risk of pneumonia after admission.
Methods: This retrospective observational study reviewed catatonia patients hospitalized at Hangzhou Seventh People's Hospital from September 2019 to November 2024. Data included demographic characteristics, medical history, maintenance medications, and pre-admission clinical presentations. Patients were divided into catatonia with and without pneumonia groups. The LASSO Algorithm was used for feature selection, and seven machine learning models: Decision Tree(DT), Logistic Regression(LR), Naive Bayes(NB), Random Forest(RF), K Nearest Neighbors(KNN), Gradient Boosting Machine(GBM), Support Vector Machine(SVM) were trained. Model performance was evaluated using AUC, Accuracy, Sensitivity, Specificity, Positive Predictive Value, Negative Predictive Value, F1 Score, Cohen's Kappa, and Brier Score, and Brier score. The best-performing model was selected for multivariable analysis to determine the variables included in the final Nomogram Model. The Nomogram Model was further validated through ROC Curves, Calibration Curves, Decision Curve Analysis (DCA), and Bootstrapping to ensure discrimination, calibration, and clinical applicability.
Results: Among 156 patients, 79 had no pneumonia, and 77 had pneumonia. LASSO Algorithm identified 15 non-zero coefficient variables (LASSO 1-SEλ=0.076). The GBM showed the best performance (AUC = 0.954, 95% CI: 0.924-0.983, vs other models by DeLong's test: P < 0.05). Five key variables: Age, Clozapine, Diaphoresis, Intake Refusal, and Waxy Flexibility were used to construct the Nomogram Model. Validation showed good discrimination (AUC = 0.803, 95% CI: 0.735-0.870), calibration, and clinical applicability. Internal validation (Bootstrapping, n=500) confirmed model stability (AUC = 0.814, 95% CI: 0.743-0.878; Hosmer-Lemeshow P = 0.525).
Conclusion: This study developed a Nomogram Model based on five key factors, demonstrating significant clinical value in predicting the risk of pneumonia in hospitalized patients with catatonia.
期刊介绍:
Frontiers in Psychiatry publishes rigorously peer-reviewed research across a wide spectrum of translational, basic and clinical research. Field Chief Editor Stefan Borgwardt at the University of Basel is supported by an outstanding Editorial Board of international researchers. This multidisciplinary open-access journal is at the forefront of disseminating and communicating scientific knowledge and impactful discoveries to researchers, academics, clinicians and the public worldwide.
The journal''s mission is to use translational approaches to improve therapeutic options for mental illness and consequently to improve patient treatment outcomes.