{"title":"A comparative analysis of deep learning models for assisting in the diagnosis of periapical lesions in periapical radiographs.","authors":"Jian Liu, Chaoran Jin, Xiaolan Wang, Kexu Pan, Zhuoyang Li, Xinxuan Yi, Yu Shao, Xiaodong Sun, Xijiao Yu","doi":"10.1186/s12903-025-06104-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Numerous studies have investigated the use of convolutional neural network (CNN) models for detecting periapical lesions(PLs). However, limited research has focused on evaluating their potential in assisting clinicians with diagnosis. This study aims to utilize two deep learning(DL) models, ConvNeXt and ResNet34, to aid novice dentists in the detection of PLs on periapical radiographs (PRs). By assessing the diagnostic support provided by these models, this research seeks to promote the clinical application of DL in dentistry.</p><p><strong>Materials and methods: </strong>In this study, 1,305 PRs were gathered and then split into a training set of 1,044 images and a validation set of 261 images, following an 80/20 ratio. The model's effectiveness was assessed using various measures, including precision, sensitivity, F1 score, specificity, accuracy, and the area under the curve (AUC). To evaluate the impact of the model on diagnostic performance by novice dentists, we used an additional set of 800 individual teeth PRs, which were not included in the training or validation sets. The diagnostic performance and time of three novice dentists were measured both with and without model assistance.</p><p><strong>Results: </strong>The precision of ConvNeXt was 85.93%, with an F1 score of 0.92, accuracy of 91.25%, sensitivity of 98.49%, specificity of 84.11%, and an AUC of 0.9693, outperforming ResNet34 across all metrics. In comparison, ResNet34 achieved a precision of 83.08%, an F1 score of 0.84, accuracy of 81.63%, sensitivity of 84.38%, specificity of 78.13%, and an AUC of 0.8988. In the model-assisted diagnosis phase, both ConvNeXt and ResNet34 improved the diagnostic performance of novice dentists. With the help of ConvNeXt, the average AUC of three dentists increased from 0.88 to 0.94, while with ResNet34, the average AUC of the three dentists improved from 0.88 to 0.91. ConvNeXt performed better than ResNet34 (p < 0.05). Additionally, ConvNeXt reduced the average diagnostic time of the three dentists from 178.8 min to 141.9 min, while ResNet34 reduced the average diagnostic time from 178.8 min to 153.6 min.</p><p><strong>Conclusion: </strong>ConvNeXt significantly improved the diagnostic performance of novice dentists and reduced the time required for diagnosis, thereby enhancing clinical efficiency in both diagnosis and treatment. This model shows potential for application in dental clinics or educational institutions where experienced specialists are limited, but there is a large presence of novice, less-experienced dentists.</p>","PeriodicalId":9072,"journal":{"name":"BMC Oral Health","volume":"25 1","pages":"801"},"PeriodicalIF":2.6000,"publicationDate":"2025-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Oral Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12903-025-06104-0","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"DENTISTRY, ORAL SURGERY & MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Numerous studies have investigated the use of convolutional neural network (CNN) models for detecting periapical lesions(PLs). However, limited research has focused on evaluating their potential in assisting clinicians with diagnosis. This study aims to utilize two deep learning(DL) models, ConvNeXt and ResNet34, to aid novice dentists in the detection of PLs on periapical radiographs (PRs). By assessing the diagnostic support provided by these models, this research seeks to promote the clinical application of DL in dentistry.
Materials and methods: In this study, 1,305 PRs were gathered and then split into a training set of 1,044 images and a validation set of 261 images, following an 80/20 ratio. The model's effectiveness was assessed using various measures, including precision, sensitivity, F1 score, specificity, accuracy, and the area under the curve (AUC). To evaluate the impact of the model on diagnostic performance by novice dentists, we used an additional set of 800 individual teeth PRs, which were not included in the training or validation sets. The diagnostic performance and time of three novice dentists were measured both with and without model assistance.
Results: The precision of ConvNeXt was 85.93%, with an F1 score of 0.92, accuracy of 91.25%, sensitivity of 98.49%, specificity of 84.11%, and an AUC of 0.9693, outperforming ResNet34 across all metrics. In comparison, ResNet34 achieved a precision of 83.08%, an F1 score of 0.84, accuracy of 81.63%, sensitivity of 84.38%, specificity of 78.13%, and an AUC of 0.8988. In the model-assisted diagnosis phase, both ConvNeXt and ResNet34 improved the diagnostic performance of novice dentists. With the help of ConvNeXt, the average AUC of three dentists increased from 0.88 to 0.94, while with ResNet34, the average AUC of the three dentists improved from 0.88 to 0.91. ConvNeXt performed better than ResNet34 (p < 0.05). Additionally, ConvNeXt reduced the average diagnostic time of the three dentists from 178.8 min to 141.9 min, while ResNet34 reduced the average diagnostic time from 178.8 min to 153.6 min.
Conclusion: ConvNeXt significantly improved the diagnostic performance of novice dentists and reduced the time required for diagnosis, thereby enhancing clinical efficiency in both diagnosis and treatment. This model shows potential for application in dental clinics or educational institutions where experienced specialists are limited, but there is a large presence of novice, less-experienced dentists.
期刊介绍:
BMC Oral Health is an open access, peer-reviewed journal that considers articles on all aspects of the prevention, diagnosis and management of disorders of the mouth, teeth and gums, as well as related molecular genetics, pathophysiology, and epidemiology.