{"title":"利用机器学习和多模态特征预测肺癌放射性肺炎:诊断准确性的系统回顾和荟萃分析。","authors":"Zhi Chen, GuangMing Yi, XinYan Li, Bo Yi, XiaoHui Bao, Yin Zhang, XiaoYue Zhang, ZhenZhou Yang, Zhengjun Guo","doi":"10.1186/s12885-024-13098-5","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>To evaluate the diagnostic accuracy of machine learning models incorporating multimodal features for predicting radiation pneumonitis in lung cancer through a systematic review and meta-analysis.</p><p><strong>Methods: </strong>Relevant studies were identified through a systematic search of PubMed, Web of Science, Embase, and the Cochrane Library from October 2003 to December 2023. Additional studies were located by reviewing bibliographies and relevant websites. Two independent researchers screened titles, abstracts, and full-text articles according to predefined inclusion and exclusion criteria. Data extraction was performed using standardized forms, and study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. The primary outcomes, including combined sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC), were calculated using STATA MP-64 software(Stata Corporation LLC, College Station, USA) with a random-effects model. Meta-analysis was conducted to synthesize diagnostic accuracy measures, and analyses of heterogeneity and publication bias were performed.</p><p><strong>Results: </strong>A total of 1,406 patients with primary lung cancer were included in this systematic review, drawing data from 9 studies. The pooled analysis revealed a sensitivity of 0.74 [0.58-0.85] and a specificity of 0.91 [0.87-0.95] for machine learning models in diagnosing radiation pneumonitis. The positive likelihood ratio (PLR) was 8.69 [5.21-14.50], the negative likelihood ratio (NLR) was 0.28 [0.16-0.49], and the diagnostic odds ratio (DOR) was 30.73 [11.96-78.97]. The area under the curve (AUC) was 0.93 [0.90-0.95], indicating excellent diagnostic performance. Meta-regression analysis identified that the number of machine learning models, year of publication, and study design contributed to heterogeneity among studies. No evidence of publication bias was found. Overall, machine learning models incorporating multimodal characteristics demonstrated 75% accuracy in predicting moderate to severe radiation pneumonitis.</p><p><strong>Conclusion: </strong>In conclusion, by integrating the current machine learning (ML) algorithm's ability in big data mining, a predictive model can be constructed by combining multi-modal features such as genetics, imaging, and cell factors. By selecting multiple machine learning algorithm frameworks and competing for the best combination model based on research goals, the reliability and accuracy of the radiation pneumonitis prediction model can be greatly improved.</p><p><strong>Trial registration: </strong>PROSPERO (CRD42024497599).</p>","PeriodicalId":9131,"journal":{"name":"BMC Cancer","volume":"24 1","pages":"1355"},"PeriodicalIF":3.4000,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11539622/pdf/","citationCount":"0","resultStr":"{\"title\":\"Predicting radiation pneumonitis in lung cancer using machine learning and multimodal features: a systematic review and meta-analysis of diagnostic accuracy.\",\"authors\":\"Zhi Chen, GuangMing Yi, XinYan Li, Bo Yi, XiaoHui Bao, Yin Zhang, XiaoYue Zhang, ZhenZhou Yang, Zhengjun Guo\",\"doi\":\"10.1186/s12885-024-13098-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>To evaluate the diagnostic accuracy of machine learning models incorporating multimodal features for predicting radiation pneumonitis in lung cancer through a systematic review and meta-analysis.</p><p><strong>Methods: </strong>Relevant studies were identified through a systematic search of PubMed, Web of Science, Embase, and the Cochrane Library from October 2003 to December 2023. Additional studies were located by reviewing bibliographies and relevant websites. Two independent researchers screened titles, abstracts, and full-text articles according to predefined inclusion and exclusion criteria. Data extraction was performed using standardized forms, and study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. The primary outcomes, including combined sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC), were calculated using STATA MP-64 software(Stata Corporation LLC, College Station, USA) with a random-effects model. Meta-analysis was conducted to synthesize diagnostic accuracy measures, and analyses of heterogeneity and publication bias were performed.</p><p><strong>Results: </strong>A total of 1,406 patients with primary lung cancer were included in this systematic review, drawing data from 9 studies. The pooled analysis revealed a sensitivity of 0.74 [0.58-0.85] and a specificity of 0.91 [0.87-0.95] for machine learning models in diagnosing radiation pneumonitis. The positive likelihood ratio (PLR) was 8.69 [5.21-14.50], the negative likelihood ratio (NLR) was 0.28 [0.16-0.49], and the diagnostic odds ratio (DOR) was 30.73 [11.96-78.97]. The area under the curve (AUC) was 0.93 [0.90-0.95], indicating excellent diagnostic performance. Meta-regression analysis identified that the number of machine learning models, year of publication, and study design contributed to heterogeneity among studies. No evidence of publication bias was found. Overall, machine learning models incorporating multimodal characteristics demonstrated 75% accuracy in predicting moderate to severe radiation pneumonitis.</p><p><strong>Conclusion: </strong>In conclusion, by integrating the current machine learning (ML) algorithm's ability in big data mining, a predictive model can be constructed by combining multi-modal features such as genetics, imaging, and cell factors. By selecting multiple machine learning algorithm frameworks and competing for the best combination model based on research goals, the reliability and accuracy of the radiation pneumonitis prediction model can be greatly improved.</p><p><strong>Trial registration: </strong>PROSPERO (CRD42024497599).</p>\",\"PeriodicalId\":9131,\"journal\":{\"name\":\"BMC Cancer\",\"volume\":\"24 1\",\"pages\":\"1355\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-11-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11539622/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BMC Cancer\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s12885-024-13098-5\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ONCOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Cancer","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12885-024-13098-5","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的通过系统综述和荟萃分析,评估包含多模态特征的机器学习模型在预测肺癌放射性肺炎方面的诊断准确性:通过对2003年10月至2023年12月期间的PubMed、Web of Science、Embase和Cochrane图书馆进行系统检索,确定了相关研究。此外,还通过查阅参考书目和相关网站找到了其他研究。两名独立研究人员根据预先定义的纳入和排除标准筛选了标题、摘要和全文文章。数据提取采用标准化表格,研究质量采用诊断准确性研究质量评估-2工具进行评估。主要结果包括综合灵敏度、特异性、阳性似然比(PLR)、阴性似然比(NLR)、诊断几率比(DOR)和曲线下面积(AUC),使用 STATA MP-64 软件(Stata Corporation LLC, College Station, USA)和随机效应模型进行计算。进行了元分析以综合诊断准确性指标,并对异质性和发表偏倚进行了分析:本系统综述共纳入了 1,406 名原发性肺癌患者,数据来自 9 项研究。汇总分析显示,机器学习模型诊断放射性肺炎的灵敏度为 0.74 [0.58-0.85],特异度为 0.91 [0.87-0.95]。阳性似然比(PLR)为 8.69 [5.21-14.50],阴性似然比(NLR)为 0.28 [0.16-0.49],诊断几率比(DOR)为 30.73 [11.96-78.97]。曲线下面积(AUC)为 0.93 [0.90-0.95],表明诊断效果极佳。元回归分析发现,机器学习模型的数量、发表年份和研究设计导致了研究之间的异质性。没有发现发表偏倚的证据。总体而言,包含多模态特征的机器学习模型在预测中度至重度放射性肺炎方面的准确率为 75%:总之,通过整合当前机器学习(ML)算法在大数据挖掘中的能力,可以结合遗传学、影像学和细胞因素等多模态特征构建预测模型。根据研究目标,选择多种机器学习算法框架,竞争最佳组合模型,可以大大提高放射性肺炎预测模型的可靠性和准确性:prospero(CRD42024497599)。
Predicting radiation pneumonitis in lung cancer using machine learning and multimodal features: a systematic review and meta-analysis of diagnostic accuracy.
Objectives: To evaluate the diagnostic accuracy of machine learning models incorporating multimodal features for predicting radiation pneumonitis in lung cancer through a systematic review and meta-analysis.
Methods: Relevant studies were identified through a systematic search of PubMed, Web of Science, Embase, and the Cochrane Library from October 2003 to December 2023. Additional studies were located by reviewing bibliographies and relevant websites. Two independent researchers screened titles, abstracts, and full-text articles according to predefined inclusion and exclusion criteria. Data extraction was performed using standardized forms, and study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. The primary outcomes, including combined sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC), were calculated using STATA MP-64 software(Stata Corporation LLC, College Station, USA) with a random-effects model. Meta-analysis was conducted to synthesize diagnostic accuracy measures, and analyses of heterogeneity and publication bias were performed.
Results: A total of 1,406 patients with primary lung cancer were included in this systematic review, drawing data from 9 studies. The pooled analysis revealed a sensitivity of 0.74 [0.58-0.85] and a specificity of 0.91 [0.87-0.95] for machine learning models in diagnosing radiation pneumonitis. The positive likelihood ratio (PLR) was 8.69 [5.21-14.50], the negative likelihood ratio (NLR) was 0.28 [0.16-0.49], and the diagnostic odds ratio (DOR) was 30.73 [11.96-78.97]. The area under the curve (AUC) was 0.93 [0.90-0.95], indicating excellent diagnostic performance. Meta-regression analysis identified that the number of machine learning models, year of publication, and study design contributed to heterogeneity among studies. No evidence of publication bias was found. Overall, machine learning models incorporating multimodal characteristics demonstrated 75% accuracy in predicting moderate to severe radiation pneumonitis.
Conclusion: In conclusion, by integrating the current machine learning (ML) algorithm's ability in big data mining, a predictive model can be constructed by combining multi-modal features such as genetics, imaging, and cell factors. By selecting multiple machine learning algorithm frameworks and competing for the best combination model based on research goals, the reliability and accuracy of the radiation pneumonitis prediction model can be greatly improved.
期刊介绍:
BMC Cancer is an open access, peer-reviewed journal that considers articles on all aspects of cancer research, including the pathophysiology, prevention, diagnosis and treatment of cancers. The journal welcomes submissions concerning molecular and cellular biology, genetics, epidemiology, and clinical trials.