Assessing the reliability of CBCT-based AI-generated STL files in diagnosing osseous changes of the mandibular condyle: a comparative study with ground truth diagnosis.
Kaan Orhan, Alex Sanders, Gürkan Ünsal, Matvey Ezhov, Melis Mısırlı, Maxim Gusarev, Murat İçen, Mamat Shamshiev, Gaye Keser, Filiz Namdar Pekiner, Maria Golitsyna, Merve Önder, David Manulis, Cemal Atakan
{"title":"Assessing the reliability of CBCT-based AI-generated STL files in diagnosing osseous changes of the mandibular condyle: a comparative study with ground truth diagnosis.","authors":"Kaan Orhan, Alex Sanders, Gürkan Ünsal, Matvey Ezhov, Melis Mısırlı, Maxim Gusarev, Murat İçen, Mamat Shamshiev, Gaye Keser, Filiz Namdar Pekiner, Maria Golitsyna, Merve Önder, David Manulis, Cemal Atakan","doi":"10.1259/dmfr.20230141","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>This study aims to evaluate the reliability of AI-generated STL files in diagnosing osseous changes of the mandibular condyle and compare them to a ground truth (GT) diagnosis made by six radiologists.</p><p><strong>Methods: </strong>A total of 432 retrospective CBCT images from four universities were evaluated by six dentomaxillofacial radiologists who identified osseous changes such as flattening, erosion, osteophyte formation, bifid condyle formation, and osteosclerosis. All images were evaluated by each radiologist blindly and recorded on a spreadsheet. All evaluations were compared and for the disagreements, a consensus meeting was held online to create a uniform GT diagnosis spreadsheet. A web-based dental AI software was used to generate STL files of the CBCT images, which were then evaluated by two dentomaxillofacial radiologists. The new observer, GT, was compared to this new STL file evaluation, and the interclass correlation (ICC) value was calculated for each pathology.</p><p><strong>Results: </strong>Out of the 864 condyles assessed, the ground truth diagnosis identified 372 cases of flattening, 185 cases of erosion, 70 cases of osteophyte formation, 117 cases of osteosclerosis, and 15 cases of bifid condyle formation. The ICC values for flattening, erosion, osteophyte formation, osteosclerosis, and bifid condyle formation were 1.000, 0.782, 1.000, 0.000, and 1.000, respectively, when comparing diagnoses made using STL files with the ground truth.</p><p><strong>Conclusions: </strong>AI-generated STL files are reliable in diagnosing bifid condyle formation, osteophyte formation, and flattening of the condyle. However, the diagnosis of osteosclerosis using AI-generated STL files is not reliable, and the accuracy of diagnosis is affected by the erosion grade.</p>","PeriodicalId":11261,"journal":{"name":"Dento maxillo facial radiology","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10552125/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Dento maxillo facial radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1259/dmfr.20230141","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/9/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: This study aims to evaluate the reliability of AI-generated STL files in diagnosing osseous changes of the mandibular condyle and compare them to a ground truth (GT) diagnosis made by six radiologists.
Methods: A total of 432 retrospective CBCT images from four universities were evaluated by six dentomaxillofacial radiologists who identified osseous changes such as flattening, erosion, osteophyte formation, bifid condyle formation, and osteosclerosis. All images were evaluated by each radiologist blindly and recorded on a spreadsheet. All evaluations were compared and for the disagreements, a consensus meeting was held online to create a uniform GT diagnosis spreadsheet. A web-based dental AI software was used to generate STL files of the CBCT images, which were then evaluated by two dentomaxillofacial radiologists. The new observer, GT, was compared to this new STL file evaluation, and the interclass correlation (ICC) value was calculated for each pathology.
Results: Out of the 864 condyles assessed, the ground truth diagnosis identified 372 cases of flattening, 185 cases of erosion, 70 cases of osteophyte formation, 117 cases of osteosclerosis, and 15 cases of bifid condyle formation. The ICC values for flattening, erosion, osteophyte formation, osteosclerosis, and bifid condyle formation were 1.000, 0.782, 1.000, 0.000, and 1.000, respectively, when comparing diagnoses made using STL files with the ground truth.
Conclusions: AI-generated STL files are reliable in diagnosing bifid condyle formation, osteophyte formation, and flattening of the condyle. However, the diagnosis of osteosclerosis using AI-generated STL files is not reliable, and the accuracy of diagnosis is affected by the erosion grade.
期刊介绍：
Dentomaxillofacial Radiology (DMFR) is the journal of the International Association of Dentomaxillofacial Radiology (IADMFR) and covers the closely related fields of oral radiology and head and neck imaging.
Established in 1972, DMFR is a key resource keeping dentists, radiologists and clinicians and scientists with an interest in Head and Neck imaging abreast of important research and developments in oral and maxillofacial radiology.
The DMFR editorial board features a panel of international experts including Editor-in-Chief Professor Ralf Schulze. Our editorial board provide their expertise and guidance in shaping the content and direction of the journal.
Quick Facts:
- 2015 Impact Factor - 1.919
- Receipt to first decision - average of 3 weeks
- Acceptance to online publication - average of 3 weeks
- Open access option
- ISSN: 0250-832X
- eISSN: 1476-542X
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
