Martina Votto, Annalisa De Silvestri, Lorenzo Postiglione, Maria De Filippo, Sara Manti, Stefania La Grutta, Gian Luigi Marseglia, Amelia Licari
{"title":"Predicting paediatric asthma exacerbations with machine learning: a systematic review with meta-analysis.","authors":"Martina Votto, Annalisa De Silvestri, Lorenzo Postiglione, Maria De Filippo, Sara Manti, Stefania La Grutta, Gian Luigi Marseglia, Amelia Licari","doi":"10.1183/16000617.0118-2024","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Asthma exacerbations in children pose a significant burden on healthcare systems and families. While traditional risk assessment tools exist, artificial intelligence (AI) offers the potential for enhanced prediction models.</p><p><strong>Objective: </strong>This study aims to systematically evaluate and quantify the performance of machine learning (ML) algorithms in predicting the risk of hospitalisation and emergency department (ED) admission for acute asthma exacerbations in children.</p><p><strong>Methods: </strong>We performed a systematic review with meta-analysis, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The risk of bias and applicability for eligible studies was assessed according to the prediction model study risk of bias assessment tool (PROBAST). The protocol of our systematic review was registered in the International Prospective Register of Systematic Reviews.</p><p><strong>Results: </strong>Our meta-analysis included seven articles encompassing a total of 17 ML-based prediction models. We found a pooled area under the curve (AUC) of 0.67 (95% CI 0.61-0.73; I<sup>2</sup>=99%; p<0.0001 for heterogeneity) for models predicting ED admission, indicating moderate accuracy. Notably, models predicting child hospitalisation demonstrated a higher pooled AUC of 0.79 (95% CI 0.76-0.82; I<sup>2</sup>=95%; p<0.0001 for heterogeneity), suggesting good discriminatory power.</p><p><strong>Conclusion: </strong>This study provides the most comprehensive assessment of AI-based algorithms in predicting paediatric asthma exacerbations to date. While these models show promise and ML-based hospitalisation prediction models, in particular, demonstrate good accuracy, further external validation is needed before these models can be reliably implemented in real-life clinical practice.</p>","PeriodicalId":12166,"journal":{"name":"European Respiratory Review","volume":"33 174","pages":""},"PeriodicalIF":9.0000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11558535/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Respiratory Review","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1183/16000617.0118-2024","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/1 0:00:00","PubModel":"Print","JCR":"Q1","JCRName":"RESPIRATORY SYSTEM","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Asthma exacerbations in children pose a significant burden on healthcare systems and families. While traditional risk assessment tools exist, artificial intelligence (AI) offers the potential for enhanced prediction models.
Objective: This study aims to systematically evaluate and quantify the performance of machine learning (ML) algorithms in predicting the risk of hospitalisation and emergency department (ED) admission for acute asthma exacerbations in children.
Methods: We performed a systematic review with meta-analysis, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The risk of bias and applicability for eligible studies was assessed according to the prediction model study risk of bias assessment tool (PROBAST). The protocol of our systematic review was registered in the International Prospective Register of Systematic Reviews.
Results: Our meta-analysis included seven articles encompassing a total of 17 ML-based prediction models. We found a pooled area under the curve (AUC) of 0.67 (95% CI 0.61-0.73; I2=99%; p<0.0001 for heterogeneity) for models predicting ED admission, indicating moderate accuracy. Notably, models predicting child hospitalisation demonstrated a higher pooled AUC of 0.79 (95% CI 0.76-0.82; I2=95%; p<0.0001 for heterogeneity), suggesting good discriminatory power.
Conclusion: This study provides the most comprehensive assessment of AI-based algorithms in predicting paediatric asthma exacerbations to date. While these models show promise and ML-based hospitalisation prediction models, in particular, demonstrate good accuracy, further external validation is needed before these models can be reliably implemented in real-life clinical practice.
背景:儿童哮喘加重给医疗系统和家庭带来了沉重负担。虽然存在传统的风险评估工具,但人工智能(AI)为增强预测模型提供了潜力:本研究旨在系统评估和量化机器学习(ML)算法在预测儿童哮喘急性加重住院和急诊科(ED)入院风险方面的性能:我们按照系统综述和荟萃分析首选报告项目(PRISMA)指南进行了系统综述和荟萃分析。根据预测模型研究偏倚风险评估工具(PROBAST)评估了符合条件的研究的偏倚风险和适用性。我们的系统综述方案已在国际系统综述前瞻性注册中心注册:我们的荟萃分析包括 7 篇文章,共涉及 17 个基于 ML 的预测模型。我们发现汇总的曲线下面积(AUC)为 0.67(95% CI 0.61-0.73;I2=99%;p2=95%;pConclusion):本研究对基于人工智能的算法预测儿科哮喘恶化进行了迄今为止最全面的评估。虽然这些模型显示出了良好的前景,尤其是基于 ML 的住院预测模型显示出了良好的准确性,但在将这些模型可靠地应用于实际临床实践之前,还需要进一步的外部验证。
期刊介绍:
The European Respiratory Review (ERR) is an open-access journal published by the European Respiratory Society (ERS), serving as a vital resource for respiratory professionals by delivering updates on medicine, science, and surgery in the field. ERR features state-of-the-art review articles, editorials, correspondence, and summaries of recent research findings and studies covering a wide range of topics including COPD, asthma, pulmonary hypertension, interstitial lung disease, lung cancer, tuberculosis, and pulmonary infections. Articles are published continuously and compiled into quarterly issues within a single annual volume.