Diagnostic accuracy of an artificial intelligence-based platform in detecting periapical radiolucencies on cone-beam computed tomography scans of molars
Marwa Allihaibi , Garrit Koller , Francesco Mannocci
{"title":"Diagnostic accuracy of an artificial intelligence-based platform in detecting periapical radiolucencies on cone-beam computed tomography scans of molars","authors":"Marwa Allihaibi , Garrit Koller , Francesco Mannocci","doi":"10.1016/j.jdent.2025.105854","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>This study aimed to evaluate the diagnostic performance of an artificial intelligence (AI)-based platform (Diagnocat) in detecting periapical radiolucencies (PARLs) in cone-beam computed tomography (CBCT) scans of molars. Specifically, we assessed Diagnocat’s performance in detecting PARLs in non-root-filled molars and compared its diagnostic performance between preoperative and postoperative scans.</div></div><div><h3>Methods</h3><div>This retrospective study analyzed preoperative and postoperative CBCT scans of 134 molars (327 roots). PARLs detected by Diagnocat were compared with assessments independently performed by two experienced endodontists, serving as the reference standard. Diagnostic performance was assessed at both tooth and root levels using sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), F1 score, and the area under the receiver operating characteristic curve (AUC-ROC).</div></div><div><h3>Results</h3><div>In preoperative scans of non-root-filled molars, Diagnocat demonstrated high sensitivity (teeth: 93.9 %, roots: 86.2 %), moderate specificity (teeth: 65.2 %, roots: 79.9 %), accuracy (teeth: 79.1 %, roots: 82.6 %), PPV (teeth: 71.8 %, roots: 75.8 %), NPV (teeth: 91.8 %, roots: 88.8 %), and F1 score (teeth: 81.3 %, roots: 80.7 %) for PARL detection. The AUC was 0.76 at the tooth level and 0.79 at the root level. Postoperative scans showed significantly lower PPV (teeth: 54.2 %; roots: 46.9 %) and F1 scores (teeth: 67.2 %; roots: 59.2 %).</div></div><div><h3>Conclusion</h3><div>Diagnocat shows promise in detecting PARLs in CBCT scans of non-root-filled molars, demonstrating high sensitivity but moderate specificity, highlighting the need for human oversight to prevent overdiagnosis. However, diagnostic performance declined significantly in postoperative scans of root-filled molars. Further research is needed to optimize the platform’s performance and support its integration into clinical practice.</div></div><div><h3>Clinical significance</h3><div>AI-based platforms such as Diagnocat can assist clinicians in detecting PARLs in CBCT scans, enhancing diagnostic efficiency and supporting decision-making. However, human expertise remains essential to minimize the risk of overdiagnosis and avoid unnecessary treatment.</div></div>","PeriodicalId":15585,"journal":{"name":"Journal of dentistry","volume":"160 ","pages":"Article 105854"},"PeriodicalIF":4.8000,"publicationDate":"2025-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of dentistry","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0300571225002982","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Objective
This study aimed to evaluate the diagnostic performance of an artificial intelligence (AI)-based platform (Diagnocat) in detecting periapical radiolucencies (PARLs) in cone-beam computed tomography (CBCT) scans of molars. Specifically, we assessed Diagnocat’s performance in detecting PARLs in non-root-filled molars and compared its diagnostic performance between preoperative and postoperative scans.
Methods
This retrospective study analyzed preoperative and postoperative CBCT scans of 134 molars (327 roots). PARLs detected by Diagnocat were compared with assessments independently performed by two experienced endodontists, serving as the reference standard. Diagnostic performance was assessed at both tooth and root levels using sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), F1 score, and the area under the receiver operating characteristic curve (AUC-ROC).
Results
In preoperative scans of non-root-filled molars, Diagnocat demonstrated high sensitivity (teeth: 93.9 %, roots: 86.2 %), moderate specificity (teeth: 65.2 %, roots: 79.9 %), accuracy (teeth: 79.1 %, roots: 82.6 %), PPV (teeth: 71.8 %, roots: 75.8 %), NPV (teeth: 91.8 %, roots: 88.8 %), and F1 score (teeth: 81.3 %, roots: 80.7 %) for PARL detection. The AUC was 0.76 at the tooth level and 0.79 at the root level. Postoperative scans showed significantly lower PPV (teeth: 54.2 %; roots: 46.9 %) and F1 scores (teeth: 67.2 %; roots: 59.2 %).
Conclusion
Diagnocat shows promise in detecting PARLs in CBCT scans of non-root-filled molars, demonstrating high sensitivity but moderate specificity, highlighting the need for human oversight to prevent overdiagnosis. However, diagnostic performance declined significantly in postoperative scans of root-filled molars. Further research is needed to optimize the platform’s performance and support its integration into clinical practice.
Clinical significance
AI-based platforms such as Diagnocat can assist clinicians in detecting PARLs in CBCT scans, enhancing diagnostic efficiency and supporting decision-making. However, human expertise remains essential to minimize the risk of overdiagnosis and avoid unnecessary treatment.
期刊介绍:
The Journal of Dentistry has an open access mirror journal The Journal of Dentistry: X, sharing the same aims and scope, editorial team, submission system and rigorous peer review.
The Journal of Dentistry is the leading international dental journal within the field of Restorative Dentistry. Placing an emphasis on publishing novel and high-quality research papers, the Journal aims to influence the practice of dentistry at clinician, research, industry and policy-maker level on an international basis.
Topics covered include the management of dental disease, periodontology, endodontology, operative dentistry, fixed and removable prosthodontics, dental biomaterials science, long-term clinical trials including epidemiology and oral health, technology transfer of new scientific instrumentation or procedures, as well as clinically relevant oral biology and translational research.
The Journal of Dentistry will publish original scientific research papers including short communications. It is also interested in publishing review articles and leaders in themed areas which will be linked to new scientific research. Conference proceedings are also welcome and expressions of interest should be communicated to the Editor.