Danai Khemasuwan, Candice Wilshire, Chakravathy Reddy, Christopher Gilbert, Jed Gordon, Akshu Balwan, Trinidad M Sanchez, Billie Bixby, Jeffrey S Sorensen, Samira Shojaee
{"title":"机器学习模型预测胸膜腔内 tPA 和 DNase 在胸膜感染中的失败:一项多中心研究。","authors":"Danai Khemasuwan, Candice Wilshire, Chakravathy Reddy, Christopher Gilbert, Jed Gordon, Akshu Balwan, Trinidad M Sanchez, Billie Bixby, Jeffrey S Sorensen, Samira Shojaee","doi":"10.1513/AnnalsATS.202402-151OC","DOIUrl":null,"url":null,"abstract":"<p><strong>Rationale: </strong>Intrapleural enzyme therapy (IET) with tissue plasminogen activator (tPA) and deoxyribonuclease (DNase) has been shown to reduce the need for surgical intervention for complicated parapneumonic effusion/empyema (CPPE/empyema). Failure of IET may lead to delayed care, and increased length of stay.</p><p><strong>Objective: </strong>The goal of this study was to identify risk factors for failure of IET.</p><p><strong>Methods: </strong>We performed a multicenter, retrospective study of patients who received IET for the treatment of CPPE/empyema. Clinical and radiological variables at the time of diagnosis were included. We compared four different machine learning classifiers (L1-penalized logistic regression, support vector machine (SVM), XGBoost and LightGBM) by multiple bootstrap-validated metrics, including F-beta to demonstrate model performances.</p><p><strong>Results: </strong>466 participants who received IET for pleural infection were included from five institutions across the United States. Resolution of CPPE/empyema with IET was achieved in 78% (n=365). SVM performed superior with median F-beta of 56%, followed by L1-penalized logistic regression, LGBM and XGBoost. Clinical and radiological variables were graded based on their ranked variable importance. The top two significant predictors of IET failure using SVM were the presence of an abscess/necrotizing pneumonia (17%) and pleural thickening (13%). Similarly, LightGBM identified abscess/necrotizing pneumonia (35%) and pleural thickening (26%) and XGBoost indicated pleural thickening (36%) and abscess/necrotizing pneumonia (17%) as the most significant predictors of treatment failure. Predictors identified by L1-penalized logistic regression model were pleural thickening (18%) and pleural fluid LDH (9%).</p><p><strong>Conclusions: </strong>The presence of abscess/necrotizing pneumonia and pleural thickening consistently ranked among the strongest predictors of IET failure in all machine learning models. The difference in rankings between models may be a consequence of the different algorithms used by each model. These results indicate that the presence of abscess/necrotizing pneumonia, and pleural thickening may predict IET failure. These results should be confirmed in larger studies.</p>","PeriodicalId":93876,"journal":{"name":"Annals of the American Thoracic Society","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Machine Learning Model Predictors of Intrapleural tPA and DNase Failure in Pleural Infection: A Multicenter Study.\",\"authors\":\"Danai Khemasuwan, Candice Wilshire, Chakravathy Reddy, Christopher Gilbert, Jed Gordon, Akshu Balwan, Trinidad M Sanchez, Billie Bixby, Jeffrey S Sorensen, Samira Shojaee\",\"doi\":\"10.1513/AnnalsATS.202402-151OC\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Rationale: </strong>Intrapleural enzyme therapy (IET) with tissue plasminogen activator (tPA) and deoxyribonuclease (DNase) has been shown to reduce the need for surgical intervention for complicated parapneumonic effusion/empyema (CPPE/empyema). Failure of IET may lead to delayed care, and increased length of stay.</p><p><strong>Objective: </strong>The goal of this study was to identify risk factors for failure of IET.</p><p><strong>Methods: </strong>We performed a multicenter, retrospective study of patients who received IET for the treatment of CPPE/empyema. Clinical and radiological variables at the time of diagnosis were included. We compared four different machine learning classifiers (L1-penalized logistic regression, support vector machine (SVM), XGBoost and LightGBM) by multiple bootstrap-validated metrics, including F-beta to demonstrate model performances.</p><p><strong>Results: </strong>466 participants who received IET for pleural infection were included from five institutions across the United States. Resolution of CPPE/empyema with IET was achieved in 78% (n=365). SVM performed superior with median F-beta of 56%, followed by L1-penalized logistic regression, LGBM and XGBoost. Clinical and radiological variables were graded based on their ranked variable importance. The top two significant predictors of IET failure using SVM were the presence of an abscess/necrotizing pneumonia (17%) and pleural thickening (13%). Similarly, LightGBM identified abscess/necrotizing pneumonia (35%) and pleural thickening (26%) and XGBoost indicated pleural thickening (36%) and abscess/necrotizing pneumonia (17%) as the most significant predictors of treatment failure. Predictors identified by L1-penalized logistic regression model were pleural thickening (18%) and pleural fluid LDH (9%).</p><p><strong>Conclusions: </strong>The presence of abscess/necrotizing pneumonia and pleural thickening consistently ranked among the strongest predictors of IET failure in all machine learning models. The difference in rankings between models may be a consequence of the different algorithms used by each model. These results indicate that the presence of abscess/necrotizing pneumonia, and pleural thickening may predict IET failure. These results should be confirmed in larger studies.</p>\",\"PeriodicalId\":93876,\"journal\":{\"name\":\"Annals of the American Thoracic Society\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-10-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of the American Thoracic Society\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1513/AnnalsATS.202402-151OC\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of the American Thoracic Society","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1513/AnnalsATS.202402-151OC","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
理由:使用组织纤溶酶原激活剂(tPA)和脱氧核糖核酸酶(DNase)进行胸膜腔内酶疗法(IET)已被证明可减少并发症性肺旁积液/水肿(CPPE/水肿)手术干预的需要。IET失败可能会导致治疗延误和住院时间延长:本研究旨在确定 IET 失败的风险因素:我们对接受 IET 治疗 CPPE/水肿的患者进行了一项多中心回顾性研究。研究纳入了诊断时的临床和放射学变量。我们通过多重引导验证指标(包括 F-beta)比较了四种不同的机器学习分类器(L1-惩罚逻辑回归、支持向量机(SVM)、XGBoost 和 LightGBM),以证明模型的性能:来自美国五家医疗机构的466名因胸膜感染而接受IET治疗的患者被纳入研究。78%的患者(n=365)通过 IET 解决了 CPPE/水肿问题。SVM 的中位 F-beta 值为 56%,表现优异,其次是 L1 惩罚逻辑回归、LGBM 和 XGBoost。临床和放射学变量根据其重要性进行了分级。使用 SVM 预测 IET 失败的前两个重要因素是存在脓毒症/坏死性肺炎(17%)和胸膜增厚(13%)。同样,LightGBM 发现脓毒症/坏死性肺炎(35%)和胸膜增厚(26%),XGBoost 发现胸膜增厚(36%)和脓毒症/坏死性肺炎(17%)是最重要的治疗失败预测因素。L1-惩罚性逻辑回归模型确定的预测因素是胸膜增厚(18%)和胸腔积液 LDH(9%):结论:在所有机器学习模型中,脓毒症/坏死性肺炎和胸膜增厚一直是预测 IET 治疗失败的最有力因素。不同模型之间的排名差异可能是每个模型使用的算法不同造成的。这些结果表明,脓毒症/坏死性肺炎和胸膜增厚可预测 IET 失败。这些结果应在更大规模的研究中得到证实。
Machine Learning Model Predictors of Intrapleural tPA and DNase Failure in Pleural Infection: A Multicenter Study.
Rationale: Intrapleural enzyme therapy (IET) with tissue plasminogen activator (tPA) and deoxyribonuclease (DNase) has been shown to reduce the need for surgical intervention for complicated parapneumonic effusion/empyema (CPPE/empyema). Failure of IET may lead to delayed care, and increased length of stay.
Objective: The goal of this study was to identify risk factors for failure of IET.
Methods: We performed a multicenter, retrospective study of patients who received IET for the treatment of CPPE/empyema. Clinical and radiological variables at the time of diagnosis were included. We compared four different machine learning classifiers (L1-penalized logistic regression, support vector machine (SVM), XGBoost and LightGBM) by multiple bootstrap-validated metrics, including F-beta to demonstrate model performances.
Results: 466 participants who received IET for pleural infection were included from five institutions across the United States. Resolution of CPPE/empyema with IET was achieved in 78% (n=365). SVM performed superior with median F-beta of 56%, followed by L1-penalized logistic regression, LGBM and XGBoost. Clinical and radiological variables were graded based on their ranked variable importance. The top two significant predictors of IET failure using SVM were the presence of an abscess/necrotizing pneumonia (17%) and pleural thickening (13%). Similarly, LightGBM identified abscess/necrotizing pneumonia (35%) and pleural thickening (26%) and XGBoost indicated pleural thickening (36%) and abscess/necrotizing pneumonia (17%) as the most significant predictors of treatment failure. Predictors identified by L1-penalized logistic regression model were pleural thickening (18%) and pleural fluid LDH (9%).
Conclusions: The presence of abscess/necrotizing pneumonia and pleural thickening consistently ranked among the strongest predictors of IET failure in all machine learning models. The difference in rankings between models may be a consequence of the different algorithms used by each model. These results indicate that the presence of abscess/necrotizing pneumonia, and pleural thickening may predict IET failure. These results should be confirmed in larger studies.