Sang Won Lee, Kateryna Huz, Kayla Gorelick, Jackie Li, Thomas Bina, Satoko Matsumura, Noah Yin, Nicholas Zhang, Yvonne Naa Ardua Anang, Sanam Sachadava, Helena I Servin-DeMarrais, Donald J McMahon, Helen H Lu, Michael T Yin, Sunil Wadhwa
{"title":"Evaluation by dental professionals of an artificial intelligence-based application to measure alveolar bone loss.","authors":"Sang Won Lee, Kateryna Huz, Kayla Gorelick, Jackie Li, Thomas Bina, Satoko Matsumura, Noah Yin, Nicholas Zhang, Yvonne Naa Ardua Anang, Sanam Sachadava, Helena I Servin-DeMarrais, Donald J McMahon, Helen H Lu, Michael T Yin, Sunil Wadhwa","doi":"10.1186/s12903-025-05677-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Several commercial programs incorporate artificial intelligence in diagnosis, but very few dental professionals have been surveyed regarding its acceptability and usability. Furthermore, few have explored how these advances might be incorporated into routine practice.</p><p><strong>Methods: </strong>Our team developed and implemented a deep learning (DL) model employing semantic segmentation neural networks and object detection networks to precisely identify alveolar bone crestal levels (ABCLs) and cemento-enamel junctions (CEJs) to measure change in alveolar crestal height (ACH). The model was trained and validated using a 550 bitewing radiograph dataset curated by an oral radiologist, setting a gold standard for ACH measurements. A twenty-question survey was created to compare the accuracy and efficiency of manual X-ray examination versus the application and to assess the acceptability and usability of the application.</p><p><strong>Results: </strong>In total, 56 different dental professionals classified severe (ACH > 5 mm) vs. non-severe (ACH ≤ 5 mm) periodontal bone loss on 35 calculable ACH measures. Dental professionals accurately identified between 35-87% of teeth with severe periodontal disease, whereas the artificial intelligence (AI) application achieved an 82-87% accuracy rate. Among the 65 participants who completed the acceptability and usability survey, more than half the participants (52%) were from an academic setting. Only 21% of participants reported that they already used automated or AI-based software in their practice to assist in reading of X-rays. The majority, 57%, stated that they only approximate when measuring bone levels and only 9% stated that they measure with a ruler. The survey indicated that 84% of participants agreed or strongly agreed with the AI application measurement of ACH. Furthermore, 56% of participants agreed that AI would be helpful in their professional setting.</p><p><strong>Conclusion: </strong>Overall, the study demonstrates that an AI application for detecting alveolar bone has high acceptability among dental professionals and may provide benefits in time saving and increased clinical accuracy.</p>","PeriodicalId":9072,"journal":{"name":"BMC Oral Health","volume":"25 1","pages":"329"},"PeriodicalIF":2.6000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11872301/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Oral Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12903-025-05677-0","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
摘要
背景:一些商业程序将人工智能应用于诊断,但很少有牙科专业人士接受过关于其可接受性和可用性的调查。此外,很少有人探讨过如何将这些进步融入日常实践中:我们的团队开发并实施了一个深度学习(DL)模型,该模型采用语义分割神经网络和对象检测网络来精确识别牙槽骨嵴水平(ABCL)和牙槽骨-釉质连接点(CEJ),以测量牙槽骨嵴高度(ACH)的变化。该模型由一名口腔放射科医生策划,使用 550 张咬合X光片数据集进行训练和验证,为 ACH 测量设定了黄金标准。为了比较人工 X 射线检查与应用软件的准确性和效率,并评估应用软件的可接受性和可用性,我们制作了一份包含 20 个问题的调查问卷:共有 56 位不同的牙科专业人员根据 35 项可计算的 ACH 指标对严重牙周骨质流失(ACH > 5 毫米)和非严重牙周骨质流失(ACH ≤ 5 毫米)进行了分类。牙科专业人员准确识别出了35%-87%的严重牙周病牙齿,而人工智能(AI)应用的准确率达到了82%-87%。在完成可接受性和可用性调查的 65 名参与者中,超过一半(52%)来自学术机构。只有 21% 的参与者表示他们已经在工作中使用了自动或人工智能软件来辅助阅读 X 光片。大多数参与者(57%)表示,他们在测量骨水平时只用近似值,只有 9% 表示他们用尺子测量。调查显示,84% 的参与者同意或非常同意应用人工智能测量 ACH。此外,56% 的参与者同意人工智能将有助于他们的专业工作:总之,这项研究表明,牙科专业人员对用于检测牙槽骨的人工智能应用软件的接受度很高,并可能在节省时间和提高临床准确性方面带来益处。
Evaluation by dental professionals of an artificial intelligence-based application to measure alveolar bone loss.
Background: Several commercial programs incorporate artificial intelligence in diagnosis, but very few dental professionals have been surveyed regarding its acceptability and usability. Furthermore, few have explored how these advances might be incorporated into routine practice.
Methods: Our team developed and implemented a deep learning (DL) model employing semantic segmentation neural networks and object detection networks to precisely identify alveolar bone crestal levels (ABCLs) and cemento-enamel junctions (CEJs) to measure change in alveolar crestal height (ACH). The model was trained and validated using a 550 bitewing radiograph dataset curated by an oral radiologist, setting a gold standard for ACH measurements. A twenty-question survey was created to compare the accuracy and efficiency of manual X-ray examination versus the application and to assess the acceptability and usability of the application.
Results: In total, 56 different dental professionals classified severe (ACH > 5 mm) vs. non-severe (ACH ≤ 5 mm) periodontal bone loss on 35 calculable ACH measures. Dental professionals accurately identified between 35-87% of teeth with severe periodontal disease, whereas the artificial intelligence (AI) application achieved an 82-87% accuracy rate. Among the 65 participants who completed the acceptability and usability survey, more than half the participants (52%) were from an academic setting. Only 21% of participants reported that they already used automated or AI-based software in their practice to assist in reading of X-rays. The majority, 57%, stated that they only approximate when measuring bone levels and only 9% stated that they measure with a ruler. The survey indicated that 84% of participants agreed or strongly agreed with the AI application measurement of ACH. Furthermore, 56% of participants agreed that AI would be helpful in their professional setting.
Conclusion: Overall, the study demonstrates that an AI application for detecting alveolar bone has high acceptability among dental professionals and may provide benefits in time saving and increased clinical accuracy.
期刊介绍:
BMC Oral Health is an open access, peer-reviewed journal that considers articles on all aspects of the prevention, diagnosis and management of disorders of the mouth, teeth and gums, as well as related molecular genetics, pathophysiology, and epidemiology.