Nathan Lampen, Xuanang Xu, Daeseung Kim, Tianshu Kuang, Jungwook Lee, Hannah H Deng, Jaime Gateno, Pingkun Yan
{"title":"人工智能辅助的面部软组织建模网格生成。","authors":"Nathan Lampen, Xuanang Xu, Daeseung Kim, Tianshu Kuang, Jungwook Lee, Hannah H Deng, Jaime Gateno, Pingkun Yan","doi":"10.1007/s11548-025-03419-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Simulation of reconstructive and cosmetic facial surgeries, such as orthognathic surgery, requires precise, patient-specific soft tissue meshes for outcome prediction. Conventional meshing methods rely on labor-intensive processes, including manual landmark digitization and mesh editing, and often lack point correspondence among subjects. These limitations reduce their efficiency, scalability, and utility in fast-paced clinical environments, highlighting the need for innovative and streamlined meshing techniques.</p><p><strong>Methods: </strong>This study presents a novel AI-assisted mesh generation (AAMG) approach using Google MediaPipe for real-time facial landmark detection to automate the creation of volumetric meshes of facial soft tissues. By leveraging these landmarks as reference points, the AAMG method generates detailed meshes that accurately reflect individual facial anatomy without manual intervention. To evaluate performance, we compared our automated method with a clinically validated, expert-guided mesh generation (EGMG) method that relies on manual landmark digitization and mesh editing. Both methods were tested on a dataset of 29 subjects who had undergone orthognathic surgery.</p><p><strong>Results: </strong>The AAMG method demonstrated high-quality metrics, with a mean Jacobian ratio of 0.83, skewness of 0.25, and an aspect ratio of 2.15, comparable to the EGMG method. Additionally, Chamfer distance analysis showed no significant differences affecting simulation performance between the two methods.</p><p><strong>Conclusion: </strong>The proposed AI-assisted mesh generation method significantly reduces mesh generation time from several hours to under a minute, while maintaining comparable mesh quality and accuracy to a clinically validated, expert-guided mesh generation method. Our method ensures consistent subject-specific meshing by leveraging real-time landmark detection and automated interpolation, improving workflow efficiency for surgical planning.</p>","PeriodicalId":51251,"journal":{"name":"International Journal of Computer Assisted Radiology and Surgery","volume":" ","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AI-assisted mesh generation for subject-specific modeling of facial soft tissues.\",\"authors\":\"Nathan Lampen, Xuanang Xu, Daeseung Kim, Tianshu Kuang, Jungwook Lee, Hannah H Deng, Jaime Gateno, Pingkun Yan\",\"doi\":\"10.1007/s11548-025-03419-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Simulation of reconstructive and cosmetic facial surgeries, such as orthognathic surgery, requires precise, patient-specific soft tissue meshes for outcome prediction. Conventional meshing methods rely on labor-intensive processes, including manual landmark digitization and mesh editing, and often lack point correspondence among subjects. These limitations reduce their efficiency, scalability, and utility in fast-paced clinical environments, highlighting the need for innovative and streamlined meshing techniques.</p><p><strong>Methods: </strong>This study presents a novel AI-assisted mesh generation (AAMG) approach using Google MediaPipe for real-time facial landmark detection to automate the creation of volumetric meshes of facial soft tissues. By leveraging these landmarks as reference points, the AAMG method generates detailed meshes that accurately reflect individual facial anatomy without manual intervention. To evaluate performance, we compared our automated method with a clinically validated, expert-guided mesh generation (EGMG) method that relies on manual landmark digitization and mesh editing. Both methods were tested on a dataset of 29 subjects who had undergone orthognathic surgery.</p><p><strong>Results: </strong>The AAMG method demonstrated high-quality metrics, with a mean Jacobian ratio of 0.83, skewness of 0.25, and an aspect ratio of 2.15, comparable to the EGMG method. Additionally, Chamfer distance analysis showed no significant differences affecting simulation performance between the two methods.</p><p><strong>Conclusion: </strong>The proposed AI-assisted mesh generation method significantly reduces mesh generation time from several hours to under a minute, while maintaining comparable mesh quality and accuracy to a clinically validated, expert-guided mesh generation method. Our method ensures consistent subject-specific meshing by leveraging real-time landmark detection and automated interpolation, improving workflow efficiency for surgical planning.</p>\",\"PeriodicalId\":51251,\"journal\":{\"name\":\"International Journal of Computer Assisted Radiology and Surgery\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-05-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Computer Assisted Radiology and Surgery\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s11548-025-03419-9\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer Assisted Radiology and Surgery","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11548-025-03419-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
AI-assisted mesh generation for subject-specific modeling of facial soft tissues.
Purpose: Simulation of reconstructive and cosmetic facial surgeries, such as orthognathic surgery, requires precise, patient-specific soft tissue meshes for outcome prediction. Conventional meshing methods rely on labor-intensive processes, including manual landmark digitization and mesh editing, and often lack point correspondence among subjects. These limitations reduce their efficiency, scalability, and utility in fast-paced clinical environments, highlighting the need for innovative and streamlined meshing techniques.
Methods: This study presents a novel AI-assisted mesh generation (AAMG) approach using Google MediaPipe for real-time facial landmark detection to automate the creation of volumetric meshes of facial soft tissues. By leveraging these landmarks as reference points, the AAMG method generates detailed meshes that accurately reflect individual facial anatomy without manual intervention. To evaluate performance, we compared our automated method with a clinically validated, expert-guided mesh generation (EGMG) method that relies on manual landmark digitization and mesh editing. Both methods were tested on a dataset of 29 subjects who had undergone orthognathic surgery.
Results: The AAMG method demonstrated high-quality metrics, with a mean Jacobian ratio of 0.83, skewness of 0.25, and an aspect ratio of 2.15, comparable to the EGMG method. Additionally, Chamfer distance analysis showed no significant differences affecting simulation performance between the two methods.
Conclusion: The proposed AI-assisted mesh generation method significantly reduces mesh generation time from several hours to under a minute, while maintaining comparable mesh quality and accuracy to a clinically validated, expert-guided mesh generation method. Our method ensures consistent subject-specific meshing by leveraging real-time landmark detection and automated interpolation, improving workflow efficiency for surgical planning.
期刊介绍:
The International Journal for Computer Assisted Radiology and Surgery (IJCARS) is a peer-reviewed journal that provides a platform for closing the gap between medical and technical disciplines, and encourages interdisciplinary research and development activities in an international environment.