Surong Chen, Yan Yang, Weiwei Wu, Ruonan Wei, Zezhou Wang, Franklin R Tay, Jingyu Hu, Jingzhi Ma
{"title":"基于 CBCT 的龋齿分类:深度学习网络可解释性研究。","authors":"Surong Chen, Yan Yang, Weiwei Wu, Ruonan Wei, Zezhou Wang, Franklin R Tay, Jingyu Hu, Jingzhi Ma","doi":"10.1007/s10278-024-01143-5","DOIUrl":null,"url":null,"abstract":"<p><p>This study aimed to create a caries classification scheme based on cone-beam computed tomography (CBCT) and develop two deep learning models to improve caries classification accuracy. A total of 2713 axial slices were obtained from CBCT images of 204 carious teeth. Both classification models were trained and tested using the same pretrained classification networks on the dataset, including ResNet50_vd, MobileNetV3_large_ssld, and ResNet50_vd_ssld. The first model was used directly to classify the original images (direct classification model). The second model incorporated a presegmentation step for interpretation (interpretable classification model). Performance evaluation metrics including accuracy, precision, recall, and F1 score were calculated. The Local Interpretable Model-agnostic Explanations (LIME) method was employed to elucidate the decision-making process of the two models. In addition, a minimum distance between caries and pulp was introduced for determining the treatment strategies for type II carious teeth. The direct model that utilized the ResNet50_vd_ssld network achieved top accuracy, precision, recall, and F1 score of 0.700, 0.786, 0.606, and 0.616, respectively. Conversely, the interpretable model consistently yielded metrics surpassing 0.917, irrespective of the network employed. The LIME algorithm confirmed the interpretability of the classification models by identifying key image features for caries classification. Evaluation of treatment strategies for type II carious teeth revealed a significant negative correlation (p < 0.01) with the minimum distance. These results demonstrated that the CBCT-based caries classification scheme and the two classification models appeared to be acceptable tools for the diagnosis and categorization of dental caries.</p>","PeriodicalId":516858,"journal":{"name":"Journal of imaging informatics in medicine","volume":" ","pages":"3160-3173"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11612060/pdf/","citationCount":"0","resultStr":"{\"title\":\"Classification of Caries Based on CBCT: A Deep Learning Network Interpretability Study.\",\"authors\":\"Surong Chen, Yan Yang, Weiwei Wu, Ruonan Wei, Zezhou Wang, Franklin R Tay, Jingyu Hu, Jingzhi Ma\",\"doi\":\"10.1007/s10278-024-01143-5\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This study aimed to create a caries classification scheme based on cone-beam computed tomography (CBCT) and develop two deep learning models to improve caries classification accuracy. A total of 2713 axial slices were obtained from CBCT images of 204 carious teeth. Both classification models were trained and tested using the same pretrained classification networks on the dataset, including ResNet50_vd, MobileNetV3_large_ssld, and ResNet50_vd_ssld. The first model was used directly to classify the original images (direct classification model). The second model incorporated a presegmentation step for interpretation (interpretable classification model). Performance evaluation metrics including accuracy, precision, recall, and F1 score were calculated. The Local Interpretable Model-agnostic Explanations (LIME) method was employed to elucidate the decision-making process of the two models. In addition, a minimum distance between caries and pulp was introduced for determining the treatment strategies for type II carious teeth. The direct model that utilized the ResNet50_vd_ssld network achieved top accuracy, precision, recall, and F1 score of 0.700, 0.786, 0.606, and 0.616, respectively. Conversely, the interpretable model consistently yielded metrics surpassing 0.917, irrespective of the network employed. The LIME algorithm confirmed the interpretability of the classification models by identifying key image features for caries classification. Evaluation of treatment strategies for type II carious teeth revealed a significant negative correlation (p < 0.01) with the minimum distance. These results demonstrated that the CBCT-based caries classification scheme and the two classification models appeared to be acceptable tools for the diagnosis and categorization of dental caries.</p>\",\"PeriodicalId\":516858,\"journal\":{\"name\":\"Journal of imaging informatics in medicine\",\"volume\":\" \",\"pages\":\"3160-3173\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11612060/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of imaging informatics in medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/s10278-024-01143-5\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/5/28 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of imaging informatics in medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s10278-024-01143-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/5/28 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
本研究旨在创建一种基于锥束计算机断层扫描(CBCT)的龋齿分类方案,并开发两种深度学习模型来提高龋齿分类的准确性。共从 204 颗龋齿的 CBCT 图像中获取了 2713 张轴向切片。两个分类模型均使用相同的预训练分类网络在数据集上进行训练和测试,包括 ResNet50_vd、MobileNetV3_large_ssld 和 ResNet50_vd_ssld。第一个模型直接用于对原始图像进行分类(直接分类模型)。第二个模型包含一个用于解释的预分割步骤(可解释分类模型)。性能评估指标包括准确率、精确度、召回率和 F1 分数。采用局部可解释模型解释(LIME)方法来阐明两个模型的决策过程。此外,还引入了龋齿与牙髓之间的最小距离,以确定 II 型龋齿的治疗策略。使用 ResNet50_vd_ssld 网络的直接模型在准确度、精确度、召回率和 F1 分数上分别达到了 0.700、0.786、0.606 和 0.616。相反,无论采用哪种网络,可解释模型的指标始终超过 0.917。LIME 算法通过识别龋齿分类的关键图像特征,证实了分类模型的可解释性。对 II 类龋齿治疗策略的评估显示,龋齿治疗策略与龋病治疗策略之间存在显著的负相关(p
Classification of Caries Based on CBCT: A Deep Learning Network Interpretability Study.
This study aimed to create a caries classification scheme based on cone-beam computed tomography (CBCT) and develop two deep learning models to improve caries classification accuracy. A total of 2713 axial slices were obtained from CBCT images of 204 carious teeth. Both classification models were trained and tested using the same pretrained classification networks on the dataset, including ResNet50_vd, MobileNetV3_large_ssld, and ResNet50_vd_ssld. The first model was used directly to classify the original images (direct classification model). The second model incorporated a presegmentation step for interpretation (interpretable classification model). Performance evaluation metrics including accuracy, precision, recall, and F1 score were calculated. The Local Interpretable Model-agnostic Explanations (LIME) method was employed to elucidate the decision-making process of the two models. In addition, a minimum distance between caries and pulp was introduced for determining the treatment strategies for type II carious teeth. The direct model that utilized the ResNet50_vd_ssld network achieved top accuracy, precision, recall, and F1 score of 0.700, 0.786, 0.606, and 0.616, respectively. Conversely, the interpretable model consistently yielded metrics surpassing 0.917, irrespective of the network employed. The LIME algorithm confirmed the interpretability of the classification models by identifying key image features for caries classification. Evaluation of treatment strategies for type II carious teeth revealed a significant negative correlation (p < 0.01) with the minimum distance. These results demonstrated that the CBCT-based caries classification scheme and the two classification models appeared to be acceptable tools for the diagnosis and categorization of dental caries.