Development and validation of a deep learning algorithm for the classification of the level of surgical difficulty in impacted mandibular third molar surgery.
T Chindanuruks, T Jindanil, C Cumpim, P Sinpitaksakul, S Arunjaroensuk, N Mattheos, A Pimkhaokham
{"title":"Development and validation of a deep learning algorithm for the classification of the level of surgical difficulty in impacted mandibular third molar surgery.","authors":"T Chindanuruks, T Jindanil, C Cumpim, P Sinpitaksakul, S Arunjaroensuk, N Mattheos, A Pimkhaokham","doi":"10.1016/j.ijom.2024.11.008","DOIUrl":null,"url":null,"abstract":"<p><p>The aim of this study was to develop and validate a convolutional neural network (CNN) algorithm for the detection of impacted mandibular third molars in panoramic radiographs and the classification of the surgical extraction difficulty level. A dataset of 1730 panoramic radiographs was collected; 1300 images were allocated to training and 430 to testing. The performance of the model was evaluated using the confusion matrix for multiclass classification, and the actual scores were compared to those of two human experts. The area under the precision-recall curve of the YOLOv5 model ranged from 72% to 89% across the variables in the surgical difficulty index. The area under the receiver operating characteristic curve showed promising results of the YOLOv5 model for classifying third molars into three surgical difficulty levels (micro-average AUC 87%). Furthermore, the algorithm scores demonstrated good agreement with the human experts. In conclusion, the YOLOv5 model has the potential to accurately detect and classify the position of mandibular third molars, with high performance for every criterion in radiographic images. The proposed model could serve as an aid in improving clinician performance and could be integrated into a screening system.</p>","PeriodicalId":94053,"journal":{"name":"International journal of oral and maxillofacial surgery","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of oral and maxillofacial surgery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.ijom.2024.11.008","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The aim of this study was to develop and validate a convolutional neural network (CNN) algorithm for the detection of impacted mandibular third molars in panoramic radiographs and the classification of the surgical extraction difficulty level. A dataset of 1730 panoramic radiographs was collected; 1300 images were allocated to training and 430 to testing. The performance of the model was evaluated using the confusion matrix for multiclass classification, and the actual scores were compared to those of two human experts. The area under the precision-recall curve of the YOLOv5 model ranged from 72% to 89% across the variables in the surgical difficulty index. The area under the receiver operating characteristic curve showed promising results of the YOLOv5 model for classifying third molars into three surgical difficulty levels (micro-average AUC 87%). Furthermore, the algorithm scores demonstrated good agreement with the human experts. In conclusion, the YOLOv5 model has the potential to accurately detect and classify the position of mandibular third molars, with high performance for every criterion in radiographic images. The proposed model could serve as an aid in improving clinician performance and could be integrated into a screening system.