{"title":"Accuracy of artificial intelligence algorithms in predicting acute respiratory distress syndrome: a systematic review and meta-analysis.","authors":"Yaxin Xiong, Yuan Gao, Yucheng Qi, Yingfei Zhi, Jia Xu, Kuo Wang, Qiuyue Yang, Changsong Wang, Mingyan Zhao, Xianglin Meng","doi":"10.1186/s12911-025-02869-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Acute respiratory distress syndrome (ARDS) is a serious threat to human life. Hence, early and accurate diagnosis and treatment are crucial for patient survival. This meta-analysis evaluates the accuracy of artificial intelligence in the early diagnosis of ARDS and provides guidance for future research and applications.</p><p><strong>Methods: </strong>A search on PubMed, Embase, Cochrane, Web of Science, CNKI, Wanfang, Chinese Biomedical Literature (CBM), and VIP databases was systematically conducted, from their establishment to November 2023, to obtain eligible studies for the analysis and evaluation of the predictive effect of AI on ARDS. The retrieved literature was screened according to inclusion and exclusion criteria, the quality of the included studies was assessed using QUADAS-2, and the included studies were statistically analyzed.</p><p><strong>Results: </strong>Among the 2, 996 studies, 33 were included in this meta-analysis, which showed that the pooled sensitivity of AI in predicting ARDS was 0.81 (0.76-0.85), the pooled specificity was 0.88 (0.84-0.91), and the area under the receiver operating characteristic curve (AUC) was 0.91 (0.88-0.93). The analyzed studies included 28 models, with a pooled sensitivity of 0.79 (0.76-0.82), a pooled specificity of 0.85 (0.83-0.88), and an AUC of 0.89 (0.86-0.91). In the subgroup analysis, the pooled AUC of the AI models ANN, CNN, LR, RF, SVM, and XGB were 0.86 (0.83-0.89), 0.91 (0.88-0.93), 0.86 (0.83-0.89), and 0.89 (0.86-0.91), 0.90 (0.87-0.92), 0.93 (0.90-0.95), respectively. In an additional subgroup analysis, we evaluated the predictive performance of the AI models trained using different predictors. This meta-analysis was registered in PROSPERO (CRD42023491546).</p><p><strong>Conclusion: </strong>AI has good sensitivity and specificity for predicting ARDS, indicating a high clinical application value. Algorithmic models such as CNN, SVM, and XGB have improved prediction performance. The subgroup analysis revealed that the model trained using images combined with other predictors had the best predictive performance.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":"25 1","pages":"44"},"PeriodicalIF":3.3000,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11776246/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Informatics and Decision Making","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12911-025-02869-0","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Acute respiratory distress syndrome (ARDS) is a serious threat to human life. Hence, early and accurate diagnosis and treatment are crucial for patient survival. This meta-analysis evaluates the accuracy of artificial intelligence in the early diagnosis of ARDS and provides guidance for future research and applications.
Methods: A search on PubMed, Embase, Cochrane, Web of Science, CNKI, Wanfang, Chinese Biomedical Literature (CBM), and VIP databases was systematically conducted, from their establishment to November 2023, to obtain eligible studies for the analysis and evaluation of the predictive effect of AI on ARDS. The retrieved literature was screened according to inclusion and exclusion criteria, the quality of the included studies was assessed using QUADAS-2, and the included studies were statistically analyzed.
Results: Among the 2, 996 studies, 33 were included in this meta-analysis, which showed that the pooled sensitivity of AI in predicting ARDS was 0.81 (0.76-0.85), the pooled specificity was 0.88 (0.84-0.91), and the area under the receiver operating characteristic curve (AUC) was 0.91 (0.88-0.93). The analyzed studies included 28 models, with a pooled sensitivity of 0.79 (0.76-0.82), a pooled specificity of 0.85 (0.83-0.88), and an AUC of 0.89 (0.86-0.91). In the subgroup analysis, the pooled AUC of the AI models ANN, CNN, LR, RF, SVM, and XGB were 0.86 (0.83-0.89), 0.91 (0.88-0.93), 0.86 (0.83-0.89), and 0.89 (0.86-0.91), 0.90 (0.87-0.92), 0.93 (0.90-0.95), respectively. In an additional subgroup analysis, we evaluated the predictive performance of the AI models trained using different predictors. This meta-analysis was registered in PROSPERO (CRD42023491546).
Conclusion: AI has good sensitivity and specificity for predicting ARDS, indicating a high clinical application value. Algorithmic models such as CNN, SVM, and XGB have improved prediction performance. The subgroup analysis revealed that the model trained using images combined with other predictors had the best predictive performance.
期刊介绍:
BMC Medical Informatics and Decision Making is an open access journal publishing original peer-reviewed research articles in relation to the design, development, implementation, use, and evaluation of health information technologies and decision-making for human health.