Michael Xie, Justin Jy Kim, James Hb Im, Liz Dennett, Abhilash Hareendranathan, Jacob L Jaremko
{"title":"Diagnostic performance of artificial intelligence in fracture detection with ultrasound: A systematic review and meta-analysis.","authors":"Michael Xie, Justin Jy Kim, James Hb Im, Liz Dennett, Abhilash Hareendranathan, Jacob L Jaremko","doi":"10.5826/tuj.2026.18778","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Bone fractures are common in acute care, and point-of-care ultrasound (POCUS) is an emerging diagnostic tool that can be complementary to or even in some cases an alternative to X-ray imaging. With the rise of artificial intelligence (AI) model incorporation in diagnostic interpretations, this systematic review and meta-analysis aimed to evaluate the diagnostic performance of deep learning models for detecting bone fractures on ultrasound images, using radiographic imaging with expert interpretation as the reference standard.</p><p><strong>Methods: </strong>Comprehensive literature searches were conducted from inception to 15 August 2025, in databases including MEDLINE (Ovid interface), Embase (Ovid interface), CINAHL Plus with Full Text (EBSCOhost interface), Web of Science, ACM Digital Library, Scopus, and Google Scholar. We included studies evaluating deep learning models applied to ultrasound images or sweeps for fracture classification. The included studies predominantly evaluated pediatric cohorts presenting to emergency departments with suspected upper extremity fractures. Sensitivity and specificity were pooled using a bivariate random-effects model on the logit scale, and summary receiver operating characteristic (sROC) curve was constructed. Risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool.</p><p><strong>Results: </strong>A total of 580 papers were identified in the preliminary literature search, and 333 studies were screened after duplicate removal. Screening 27 full-text articles resulted in eight studies that were included in the review. Across 21 reported model evaluations from five studies with extractable diagnostic data, pooled sensitivity was 0.77 (95% CI: 0.69-0.83) and pooled specificity was 0.90 (95% CI: 0.86-0.94), with an overall sROC AUC of 0.91. Patient-level evaluations yielded higher pooled sensitivity (0.89; 95% CI: 0.81-0.94) and specificity (0.94; 95% CI: 0.81-0.98) compared to video-level analyses.</p><p><strong>Conclusions: </strong>AI-assisted ultrasound demonstrates promising diagnostic performance for fracture detection with generally high specificity and variable sensitivity across architectures and anatomic targets. Future work should prioritize prospective, externally validated studies with standardized acquisition protocols and clinically meaningful reporting at the patient level.</p>","PeriodicalId":36911,"journal":{"name":"Ultrasound Journal","volume":"18 1","pages":"18778"},"PeriodicalIF":3.6000,"publicationDate":"2026-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13552460/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ultrasound Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5826/tuj.2026.18778","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Bone fractures are common in acute care, and point-of-care ultrasound (POCUS) is an emerging diagnostic tool that can be complementary to or even in some cases an alternative to X-ray imaging. With the rise of artificial intelligence (AI) model incorporation in diagnostic interpretations, this systematic review and meta-analysis aimed to evaluate the diagnostic performance of deep learning models for detecting bone fractures on ultrasound images, using radiographic imaging with expert interpretation as the reference standard.
Methods: Comprehensive literature searches were conducted from inception to 15 August 2025, in databases including MEDLINE (Ovid interface), Embase (Ovid interface), CINAHL Plus with Full Text (EBSCOhost interface), Web of Science, ACM Digital Library, Scopus, and Google Scholar. We included studies evaluating deep learning models applied to ultrasound images or sweeps for fracture classification. The included studies predominantly evaluated pediatric cohorts presenting to emergency departments with suspected upper extremity fractures. Sensitivity and specificity were pooled using a bivariate random-effects model on the logit scale, and summary receiver operating characteristic (sROC) curve was constructed. Risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool.
Results: A total of 580 papers were identified in the preliminary literature search, and 333 studies were screened after duplicate removal. Screening 27 full-text articles resulted in eight studies that were included in the review. Across 21 reported model evaluations from five studies with extractable diagnostic data, pooled sensitivity was 0.77 (95% CI: 0.69-0.83) and pooled specificity was 0.90 (95% CI: 0.86-0.94), with an overall sROC AUC of 0.91. Patient-level evaluations yielded higher pooled sensitivity (0.89; 95% CI: 0.81-0.94) and specificity (0.94; 95% CI: 0.81-0.98) compared to video-level analyses.
Conclusions: AI-assisted ultrasound demonstrates promising diagnostic performance for fracture detection with generally high specificity and variable sensitivity across architectures and anatomic targets. Future work should prioritize prospective, externally validated studies with standardized acquisition protocols and clinically meaningful reporting at the patient level.
背景:骨折在急性护理中很常见,而即时超声(POCUS)是一种新兴的诊断工具,可以补充甚至在某些情况下替代x射线成像。随着人工智能(AI)模型在诊断解释中的应用的兴起,本系统综述和荟萃分析旨在评估深度学习模型在超声图像上检测骨折的诊断性能,以专家解释的放射成像为参考标准。方法:在MEDLINE (Ovid接口)、Embase (Ovid接口)、CINAHL Plus with Full Text (EBSCOhost接口)、Web of Science、ACM数字图书馆、Scopus、谷歌Scholar等数据库中进行自成立至2025年8月15日的综合文献检索。我们纳入了评估应用于超声图像或扫描的深度学习模型进行骨折分类的研究。纳入的研究主要评估了到急诊科就诊的疑似上肢骨折的儿科队列。采用logit量表的双变量随机效应模型对敏感性和特异性进行合并,并构建综合受试者工作特征(sROC)曲线。使用诊断准确性研究质量评估2 (QUADAS-2)工具评估偏倚风险。结果:初步文献检索共纳入580篇文献,剔除重复后筛选出333篇研究。筛选了27篇全文文章,结果有8项研究被纳入综述。在5项具有可提取诊断数据的研究中,21项已报道的模型评估中,合并敏感性为0.77 (95% CI: 0.69-0.83),合并特异性为0.90 (95% CI: 0.86-0.94),总体sROC AUC为0.91。与视频水平的分析相比,患者水平的评估产生了更高的综合敏感性(0.89;95% CI: 0.81-0.94)和特异性(0.94;95% CI: 0.81-0.98)。结论:人工智能辅助超声在骨折检测中具有良好的诊断性能,在不同的结构和解剖目标上具有较高的特异性和可变的灵敏度。未来的工作应优先考虑前瞻性、外部验证的研究,并采用标准化的获取协议和患者水平的临床有意义的报告。