Development and Validation of an Explainable Prediction Model for Postoperative Recurrence in Pediatric Chronic Rhinosinusitis.

IF 2.6 3区医学 Q1 OTORHINOLARYNGOLOGY

Otolaryngology- Head and Neck Surgery Pub Date : 2024-12-17 DOI:10.1002/ohn.1092

Sijie Jiang, Bo Qi, Shaobing Xie, Zhihai Xie, Hua Zhang, Weihong Jiang

{"title":"Development and Validation of an Explainable Prediction Model for Postoperative Recurrence in Pediatric Chronic Rhinosinusitis.","authors":"Sijie Jiang, Bo Qi, Shaobing Xie, Zhihai Xie, Hua Zhang, Weihong Jiang","doi":"10.1002/ohn.1092","DOIUrl":null,"url":null,"abstract":"Objective: This study aims to develop an interpretable machine learning (ML) predictive model to assess its efficacy in predicting postoperative recurrence in pediatric chronic rhinosinusitis (CRS).Study design: A decision analysis was performed with retrospective clinical data.Setting: Recurrent group and nonrecurrent group.Methods: This retrospective study included 148 pediatric CRS treated with functional endoscopic sinus surgery from January 2015 to January 2022. We collected demographic characteristics and peripheral blood inflammatory indices, and calculated inflammation indices. Models were trained with 3 ML algorithms and compared their predictive performance using the area under the receiver operating characteristic (AUC) curve. Shapley Additive Explanations and Ceteris Paribus profiles were used for model interpretation. The final model was transformed into a web for interactive visualization.Results: Among the 3 ML models, the Random Forest (RF) model demonstrated the best discriminative ability (AUC = 0.728). After reducing features based on importance and tuning parameters, the final RF model, including 4 features (systemic immune inflammation index (SII), pan-immune-inflammation value (PIV) and percentage of eosinophils (E%) and lymphocytes (L%)), showed good predictive performance in internal validation (AUC = 0.779). Global interpretation of the model suggested that L% and E% substantially contribute to the overall model. Local interpretation revealed a nonlinear relationship between the included features and model predictions. To enhance its clinical utility, the model was converted into a web (https://juice153.shinyapps.io/CRSRecurrencePrediction/).Conclusion: Our ML model demonstrated promising accuracy in predicting postoperative recurrence in pediatric CRS, revealing a complex nonlinear relationship between postoperative recurrence and the features SII, PIV, L%, and E%.","PeriodicalId":19707,"journal":{"name":"Otolaryngology- Head and Neck Surgery","volume":" ","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Otolaryngology- Head and Neck Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1002/ohn.1092","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OTORHINOLARYNGOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Objective: This study aims to develop an interpretable machine learning (ML) predictive model to assess its efficacy in predicting postoperative recurrence in pediatric chronic rhinosinusitis (CRS).

Study design: A decision analysis was performed with retrospective clinical data.

Setting: Recurrent group and nonrecurrent group.

Methods: This retrospective study included 148 pediatric CRS treated with functional endoscopic sinus surgery from January 2015 to January 2022. We collected demographic characteristics and peripheral blood inflammatory indices, and calculated inflammation indices. Models were trained with 3 ML algorithms and compared their predictive performance using the area under the receiver operating characteristic (AUC) curve. Shapley Additive Explanations and Ceteris Paribus profiles were used for model interpretation. The final model was transformed into a web for interactive visualization.

Results: Among the 3 ML models, the Random Forest (RF) model demonstrated the best discriminative ability (AUC = 0.728). After reducing features based on importance and tuning parameters, the final RF model, including 4 features (systemic immune inflammation index (SII), pan-immune-inflammation value (PIV) and percentage of eosinophils (E%) and lymphocytes (L%)), showed good predictive performance in internal validation (AUC = 0.779). Global interpretation of the model suggested that L% and E% substantially contribute to the overall model. Local interpretation revealed a nonlinear relationship between the included features and model predictions. To enhance its clinical utility, the model was converted into a web (https://juice153.shinyapps.io/CRSRecurrencePrediction/).

Conclusion: Our ML model demonstrated promising accuracy in predicting postoperative recurrence in pediatric CRS, revealing a complex nonlinear relationship between postoperative recurrence and the features SII, PIV, L%, and E%.

查看原文本刊更多论文

开发并验证小儿慢性鼻炎术后复发的可解释预测模型

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Otolaryngology- Head and Neck Surgery 医学-耳鼻喉科学

CiteScore

6.70

自引率

2.90%

发文量

250

审稿时长

2-4 weeks

期刊介绍： Otolaryngology–Head and Neck Surgery (OTO-HNS) is the official peer-reviewed publication of the American Academy of Otolaryngology–Head and Neck Surgery Foundation. The mission of Otolaryngology–Head and Neck Surgery is to publish contemporary, ethical, clinically relevant information in otolaryngology, head and neck surgery (ear, nose, throat, head, and neck disorders) that can be used by otolaryngologists, clinicians, scientists, and specialists to improve patient care and public health.