Cross-Vendor Robustness of a Hybrid Deep Learning Framework for Four-Stage Periodontitis Classification on Panoramic Radiographs.

IF 4 2区 医学 Q1 DENTISTRY, ORAL SURGERY & MEDICINE
Sang-Jeong Lee, Su Yang, Ji Yong Han, Kyung-Hoe Huh, Min-Suk Heo, Sam-Sun Lee, Jo-Eun Kim, Won-Jin Yi
{"title":"Cross-Vendor Robustness of a Hybrid Deep Learning Framework for Four-Stage Periodontitis Classification on Panoramic Radiographs.","authors":"Sang-Jeong Lee, Su Yang, Ji Yong Han, Kyung-Hoe Huh, Min-Suk Heo, Sam-Sun Lee, Jo-Eun Kim, Won-Jin Yi","doi":"10.1093/dmfr/twag055","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Although deep learning for periodontitis diagnosis on panoramic radiographs has advanced rapidly, most studies use single-vendor data and cross-vendor generalization is rarely evaluated. Therefore, we evaluate the cross-vendor robustness of a hybrid CNN-CAD framework for automated four-stage periodontitis classification.</p><p><strong>Methods: </strong>Five hundred panoramic radiographs were retrospectively collected from three vendors (Instrumentarium, n=400; Vatech, n=50; PointNix, n=50). The framework extends a previously published hybrid pipeline by adding a YOLO-based CNN for missing-teeth quantification, enabling four-stage classification according to the 2017 World Workshop criteria. Three dataset configurations were evaluated: pooled multi-vendor training and two leave-one-device-out (LODO) splits. We compared segmentation backbones (U-Net, Dense U-Net, SegNet, Mask R-CNN) and YOLO detector variants. Agreement with three oral and maxillofacial radiologists (3, 5 and 10 years of experience) was assessed using mean absolute difference (MAD), Pearson and intraclass correlation, Bland-Altman, and Passing-Bablok analyses.</p><p><strong>Results: </strong>Under pooled multi-vendor training, Mask R-CNN achieved Dice coefficients of 0.96, 0.92 and 0.94 for periodontal bone level, cemento-enamel junction level and teeth/implants respectively; CNNv4-tiny reached a mean AP of 0.86 for missing teeth. The MAD between automated and expert staging was 0.31, overall image-level ICC was 0.93 (95% CI 0.86-0.97; p<0.01), and Bland-Altman bias against the most experienced radiologist was 0.007. Under LODO, Dice coefficient dropped to 0.75-0.86 (all p<0.001 versus pooled), quantifying substantial vendor-induced domain shift.</p><p><strong>Conclusions: </strong>The hybrid framework achieves expert-level agreement under pooled multi-vendor training but degrades in held-out vendors, providing a quantitative reference for vendor-induced domain shift in panoramic radiograph AI and motivating vendor-aware training or domain adaptation in future clinical deployments.</p><p><strong>Advances in knowledge: </strong>This work provides, to our knowledge, the first cross-vendor benchmark for deep-learning-based periodontitis staging on panoramic radiographs and quantifies vendor-induced domain shift directly addressing the external-validation gap recently identified in this journal.</p>","PeriodicalId":11261,"journal":{"name":"Dento maxillo facial radiology","volume":" ","pages":""},"PeriodicalIF":4.0000,"publicationDate":"2026-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Dento maxillo facial radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1093/dmfr/twag055","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: Although deep learning for periodontitis diagnosis on panoramic radiographs has advanced rapidly, most studies use single-vendor data and cross-vendor generalization is rarely evaluated. Therefore, we evaluate the cross-vendor robustness of a hybrid CNN-CAD framework for automated four-stage periodontitis classification.

Methods: Five hundred panoramic radiographs were retrospectively collected from three vendors (Instrumentarium, n=400; Vatech, n=50; PointNix, n=50). The framework extends a previously published hybrid pipeline by adding a YOLO-based CNN for missing-teeth quantification, enabling four-stage classification according to the 2017 World Workshop criteria. Three dataset configurations were evaluated: pooled multi-vendor training and two leave-one-device-out (LODO) splits. We compared segmentation backbones (U-Net, Dense U-Net, SegNet, Mask R-CNN) and YOLO detector variants. Agreement with three oral and maxillofacial radiologists (3, 5 and 10 years of experience) was assessed using mean absolute difference (MAD), Pearson and intraclass correlation, Bland-Altman, and Passing-Bablok analyses.

Results: Under pooled multi-vendor training, Mask R-CNN achieved Dice coefficients of 0.96, 0.92 and 0.94 for periodontal bone level, cemento-enamel junction level and teeth/implants respectively; CNNv4-tiny reached a mean AP of 0.86 for missing teeth. The MAD between automated and expert staging was 0.31, overall image-level ICC was 0.93 (95% CI 0.86-0.97; p<0.01), and Bland-Altman bias against the most experienced radiologist was 0.007. Under LODO, Dice coefficient dropped to 0.75-0.86 (all p<0.001 versus pooled), quantifying substantial vendor-induced domain shift.

Conclusions: The hybrid framework achieves expert-level agreement under pooled multi-vendor training but degrades in held-out vendors, providing a quantitative reference for vendor-induced domain shift in panoramic radiograph AI and motivating vendor-aware training or domain adaptation in future clinical deployments.

Advances in knowledge: This work provides, to our knowledge, the first cross-vendor benchmark for deep-learning-based periodontitis staging on panoramic radiographs and quantifies vendor-induced domain shift directly addressing the external-validation gap recently identified in this journal.

全景x光片牙周炎四阶段分类的混合深度学习框架的跨厂商鲁棒性。
目的:尽管深度学习在全景x线片上诊断牙周炎的进展很快,但大多数研究使用单一供应商的数据,而跨供应商的泛化很少得到评估。因此,我们评估了用于牙周炎自动四阶段分类的混合CNN-CAD框架的跨供应商鲁棒性。方法:回顾性收集三家供应商(instrumarium, n=400; Vatech, n=50; PointNix, n=50)的500张全景x线片。该框架扩展了先前发布的混合管道,增加了基于yolo的CNN用于缺失牙齿量化,根据2017年世界研讨会的标准实现了四阶段分类。评估了三种数据集配置:池式多供应商训练和两次留下一个设备(LODO)分割。我们比较了分割骨干网(U-Net, Dense U-Net, SegNet, Mask R-CNN)和YOLO检测器变体。使用平均绝对差(MAD)、Pearson和类内相关、Bland-Altman和passin - bablok分析评估与三位口腔颌面放射科医师(3年、5年和10年经验)的一致性。结果:在多厂商联合训练下,Mask R-CNN在牙周骨水平、牙髓-牙釉质连接水平和牙体/种植体方面的Dice系数分别达到0.96、0.92和0.94;CNNv4-tiny对缺牙的平均AP为0.86。结论:混合框架在多厂商联合训练下达到了专家水平的一致性,但在无供应商的情况下却有所下降,为全景x光片人工智能中供应商诱导的领域转移提供了定量参考,并激励了未来临床部署中供应商感知的培训或领域适应。知识进展:据我们所知,这项工作为基于深度学习的牙周炎全景x线片分期提供了第一个跨供应商基准,并量化了供应商引起的领域转移,直接解决了本杂志最近发现的外部验证差距。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.60
自引率
9.10%
发文量
65
审稿时长
4-8 weeks
期刊介绍: Dentomaxillofacial Radiology (DMFR) is the journal of the International Association of Dentomaxillofacial Radiology (IADMFR) and covers the closely related fields of oral radiology and head and neck imaging. Established in 1972, DMFR is a key resource keeping dentists, radiologists and clinicians and scientists with an interest in Head and Neck imaging abreast of important research and developments in oral and maxillofacial radiology. The DMFR editorial board features a panel of international experts including Editor-in-Chief Professor Ralf Schulze. Our editorial board provide their expertise and guidance in shaping the content and direction of the journal. Quick Facts: - 2015 Impact Factor - 1.919 - Receipt to first decision - average of 3 weeks - Acceptance to online publication - average of 3 weeks - Open access option - ISSN: 0250-832X - eISSN: 1476-542X
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书