3D evaluation model of facial aesthetics based on multi-input 3D convolution neural networks for orthognathic surgery

IF 2.3 3区 医学 Q2 SURGERY
Qingchuan Ma, Etsuko Kobayashi, Siao Jin, Ken Masamune, Hideyuki Suenaga
{"title":"3D evaluation model of facial aesthetics based on multi-input 3D convolution neural networks for orthognathic surgery","authors":"Qingchuan Ma,&nbsp;Etsuko Kobayashi,&nbsp;Siao Jin,&nbsp;Ken Masamune,&nbsp;Hideyuki Suenaga","doi":"10.1002/rcs.2651","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Quantitative evaluation of facial aesthetics is an important but also time-consuming procedure in orthognathic surgery, while existing 2D beauty-scoring models are mainly used for entertainment with less clinical impact.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A deep-learning-based 3D evaluation model DeepBeauty3D was designed and trained using 133 patients' CT images. The customised image preprocessing module extracted the skeleton, soft tissue, and personal physical information from raw DICOM data, and the predicting network module employed 3-input-2-output convolution neural networks (CNN) to receive the aforementioned data and output aesthetic scores automatically.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Experiment results showed that this model predicted the skeleton and soft tissue score with 0.231 ± 0.218 (4.62%) and 0.100 ± 0.344 (2.00%) accuracy in 11.203 ± 2.824 s from raw CT images.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>This study provided an end-to-end solution using real clinical data based on 3D CNN to quantitatively evaluate facial aesthetics by considering three anatomical factors simultaneously, showing promising potential in reducing workload and bridging the surgeon-patient aesthetics perspective gap.</p>\n </section>\n </div>","PeriodicalId":50311,"journal":{"name":"International Journal of Medical Robotics and Computer Assisted Surgery","volume":"20 3","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2024-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rcs.2651","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Robotics and Computer Assisted Surgery","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rcs.2651","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0

Abstract

Background

Quantitative evaluation of facial aesthetics is an important but also time-consuming procedure in orthognathic surgery, while existing 2D beauty-scoring models are mainly used for entertainment with less clinical impact.

Methods

A deep-learning-based 3D evaluation model DeepBeauty3D was designed and trained using 133 patients' CT images. The customised image preprocessing module extracted the skeleton, soft tissue, and personal physical information from raw DICOM data, and the predicting network module employed 3-input-2-output convolution neural networks (CNN) to receive the aforementioned data and output aesthetic scores automatically.

Results

Experiment results showed that this model predicted the skeleton and soft tissue score with 0.231 ± 0.218 (4.62%) and 0.100 ± 0.344 (2.00%) accuracy in 11.203 ± 2.824 s from raw CT images.

Conclusion

This study provided an end-to-end solution using real clinical data based on 3D CNN to quantitatively evaluate facial aesthetics by considering three anatomical factors simultaneously, showing promising potential in reducing workload and bridging the surgeon-patient aesthetics perspective gap.

Abstract Image

基于多输入三维卷积神经网络的面部美学三维评估模型,用于正颌外科手术。
背景:定量评估面部美学是正颌外科中一项重要但耗时的工作,而现有的二维美学评分模型主要用于娱乐,对临床影响较小:对面部美学进行定量评估是正颌外科中一项重要但耗时的程序,而现有的二维美学评分模型主要用于娱乐,临床影响较小:方法:使用 133 幅患者 CT 图像设计并训练了基于深度学习的 3D 评估模型 DeepBeauty3D。定制的图像预处理模块从 DICOM 原始数据中提取骨架、软组织和个人体征信息,预测网络模块采用 3 输入 2 输出的卷积神经网络(CNN)接收上述数据并自动输出美学评分:实验结果表明,该模型能在 11.203±2.824 秒内从原始 CT 图像预测骨骼和软组织评分,准确率分别为 0.231±0.218 (4.62%)和 0.100±0.344 (2.00%):该研究基于三维 CNN,利用真实临床数据提供了一种端到端的解决方案,通过同时考虑三个解剖因素来定量评估面部美学,在减少工作量和缩小外科医生-患者美学视角差距方面显示出巨大潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.50
自引率
12.00%
发文量
131
审稿时长
6-12 weeks
期刊介绍: The International Journal of Medical Robotics and Computer Assisted Surgery provides a cross-disciplinary platform for presenting the latest developments in robotics and computer assisted technologies for medical applications. The journal publishes cutting-edge papers and expert reviews, complemented by commentaries, correspondence and conference highlights that stimulate discussion and exchange of ideas. Areas of interest include robotic surgery aids and systems, operative planning tools, medical imaging and visualisation, simulation and navigation, virtual reality, intuitive command and control systems, haptics and sensor technologies. In addition to research and surgical planning studies, the journal welcomes papers detailing clinical trials and applications of computer-assisted workflows and robotic systems in neurosurgery, urology, paediatric, orthopaedic, craniofacial, cardiovascular, thoraco-abdominal, musculoskeletal and visceral surgery. Articles providing critical analysis of clinical trials, assessment of the benefits and risks of the application of these technologies, commenting on ease of use, or addressing surgical education and training issues are also encouraged. The journal aims to foster a community that encompasses medical practitioners, researchers, and engineers and computer scientists developing robotic systems and computational tools in academic and commercial environments, with the intention of promoting and developing these exciting areas of medical technology.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信