Template-based semantic-guided orthodontic teeth alignment previewer

IF 11.8 1区 医学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Qianwen Ji , Yizhou Chen , Xiaojun Chen
{"title":"Template-based semantic-guided orthodontic teeth alignment previewer","authors":"Qianwen Ji ,&nbsp;Yizhou Chen ,&nbsp;Xiaojun Chen","doi":"10.1016/j.media.2025.103802","DOIUrl":null,"url":null,"abstract":"<div><div>Intuitive visualization of orthodontic prediction results is of great significance in helping patients make up their minds about orthodontics and maintain an optimistic attitude during treatment. To address this, we propose a semantically guided orthodontic simulation prediction framework that predicts orthodontic outcomes using only a frontal photograph. Our method comprises four key steps. Firstly, we perform semantic segmentation of oral and the teeth cavity, enabling the extraction of category-specific tooth contours from frontal images with misaligned teeth. Secondly, these extracted contours are employed to adapt the predefined teeth templates to reconstruct 3D models of the teeth. Thirdly, using the reconstructed tooth positions, sizes, and postures, we fit the dental arch curve to guide tooth movement, producing a 3D model of the teeth after simulated orthodontic adjustments. Ultimately, we apply a semantically guided diffusion model for structural control and generate orthodontic prediction images which are consistent with the style of input images by applying texture transformation. Notably, our tooth semantic segmentation model attains an average intersection of union of 0.834 for 24 tooth classes excluding the second and third molars. The average Chamfer distance between our reconstructed teeth models and their corresponding ground-truth counterparts measures at 1.272 mm<span><math><msup><mrow></mrow><mrow><mn>2</mn></mrow></msup></math></span> in test cases. The teeth alignment, as predicted by our approach, exhibits a high degree of consistency with the actual post-orthodontic results in frontal images. This comprehensive qualitative and quantitative evaluation indicates the practicality and effectiveness of our framework in orthodontics and facial beautification.</div></div>","PeriodicalId":18328,"journal":{"name":"Medical image analysis","volume":"107 ","pages":"Article 103802"},"PeriodicalIF":11.8000,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image analysis","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1361841525003482","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Intuitive visualization of orthodontic prediction results is of great significance in helping patients make up their minds about orthodontics and maintain an optimistic attitude during treatment. To address this, we propose a semantically guided orthodontic simulation prediction framework that predicts orthodontic outcomes using only a frontal photograph. Our method comprises four key steps. Firstly, we perform semantic segmentation of oral and the teeth cavity, enabling the extraction of category-specific tooth contours from frontal images with misaligned teeth. Secondly, these extracted contours are employed to adapt the predefined teeth templates to reconstruct 3D models of the teeth. Thirdly, using the reconstructed tooth positions, sizes, and postures, we fit the dental arch curve to guide tooth movement, producing a 3D model of the teeth after simulated orthodontic adjustments. Ultimately, we apply a semantically guided diffusion model for structural control and generate orthodontic prediction images which are consistent with the style of input images by applying texture transformation. Notably, our tooth semantic segmentation model attains an average intersection of union of 0.834 for 24 tooth classes excluding the second and third molars. The average Chamfer distance between our reconstructed teeth models and their corresponding ground-truth counterparts measures at 1.272 mm2 in test cases. The teeth alignment, as predicted by our approach, exhibits a high degree of consistency with the actual post-orthodontic results in frontal images. This comprehensive qualitative and quantitative evaluation indicates the practicality and effectiveness of our framework in orthodontics and facial beautification.
基于模板的语义引导正畸牙齿对齐预览器
正畸预测结果的直观可视化,对帮助患者在治疗过程中树立正畸观念、保持乐观态度具有重要意义。为了解决这个问题,我们提出了一个语义引导的正畸模拟预测框架,该框架仅使用正面照片来预测正畸结果。我们的方法包括四个关键步骤。首先,我们对口腔和牙腔进行语义分割,从牙齿错位的正面图像中提取特定类别的牙齿轮廓。其次,利用提取的轮廓对预定义的牙齿模板进行适配,重建牙齿的三维模型;第三,利用重建的牙齿位置、大小和姿态,拟合牙弓曲线来指导牙齿运动,生成模拟正畸调整后牙齿的三维模型。最后,我们采用语义引导扩散模型进行结构控制,通过纹理变换生成与输入图像风格一致的正畸预测图像。值得注意的是,我们的牙齿语义分割模型对24个牙齿类别(不包括第二和第三磨牙)的平均联合交集为0.834。在测试案例中,我们重建的牙齿模型与相应的地基真值模型之间的平均倒角距离为1.272 mm2。牙齿排列,正如我们的方法所预测的,显示出高度的一致性与实际的正畸后的正面图像结果。这一综合的定性和定量评价表明了我们的框架在正畸和面部美化方面的实用性和有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Medical image analysis
Medical image analysis 工程技术-工程:生物医学
CiteScore
22.10
自引率
6.40%
发文量
309
审稿时长
6.6 months
期刊介绍: Medical Image Analysis serves as a platform for sharing new research findings in the realm of medical and biological image analysis, with a focus on applications of computer vision, virtual reality, and robotics to biomedical imaging challenges. The journal prioritizes the publication of high-quality, original papers contributing to the fundamental science of processing, analyzing, and utilizing medical and biological images. It welcomes approaches utilizing biomedical image datasets across all spatial scales, from molecular/cellular imaging to tissue/organ imaging.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信