Chen Jiang, Changwei Luo, Jun Yu, Rui Li, Zengfu Wang
{"title":"模拟一个真实的三维生理舌头,用于视觉语音合成","authors":"Chen Jiang, Changwei Luo, Jun Yu, Rui Li, Zengfu Wang","doi":"10.1109/ICMEW.2014.6890595","DOIUrl":null,"url":null,"abstract":"We built a 3D anatomically and biomechanically accurate physiological tongue model for use in visual speech synthesis. For the anatomical modeling part, the tongue and its muscles are constructed based on accurate medical data. Due to their complexity, muscles geometry and fiber arrangement are specified by a proposed interactive muscle marking method. For the biomechanical modeling part, a nonlinear, quasi-incompressible, hyperelastic constitutive model is applied for describing the tongue tissues. Particularly, tongue muscles are additionally endowed with an anisotropic constitutive model, which reflects the active and passive mechanical behavior of muscle fibers. The dynamic deformation of tongue is simulated based on finite element method (FEM). Simulation results of tongue movements subjected to certain muscle activations are presented and validated with experimental data. This tongue model can be applied in many areas, like media art, education, entertainment.","PeriodicalId":178700,"journal":{"name":"2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Modeling a realistic 3D physiological tongue for visual speech synthesis\",\"authors\":\"Chen Jiang, Changwei Luo, Jun Yu, Rui Li, Zengfu Wang\",\"doi\":\"10.1109/ICMEW.2014.6890595\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We built a 3D anatomically and biomechanically accurate physiological tongue model for use in visual speech synthesis. For the anatomical modeling part, the tongue and its muscles are constructed based on accurate medical data. Due to their complexity, muscles geometry and fiber arrangement are specified by a proposed interactive muscle marking method. For the biomechanical modeling part, a nonlinear, quasi-incompressible, hyperelastic constitutive model is applied for describing the tongue tissues. Particularly, tongue muscles are additionally endowed with an anisotropic constitutive model, which reflects the active and passive mechanical behavior of muscle fibers. The dynamic deformation of tongue is simulated based on finite element method (FEM). Simulation results of tongue movements subjected to certain muscle activations are presented and validated with experimental data. This tongue model can be applied in many areas, like media art, education, entertainment.\",\"PeriodicalId\":178700,\"journal\":{\"name\":\"2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)\",\"volume\":\"66 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-07-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMEW.2014.6890595\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMEW.2014.6890595","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Modeling a realistic 3D physiological tongue for visual speech synthesis
We built a 3D anatomically and biomechanically accurate physiological tongue model for use in visual speech synthesis. For the anatomical modeling part, the tongue and its muscles are constructed based on accurate medical data. Due to their complexity, muscles geometry and fiber arrangement are specified by a proposed interactive muscle marking method. For the biomechanical modeling part, a nonlinear, quasi-incompressible, hyperelastic constitutive model is applied for describing the tongue tissues. Particularly, tongue muscles are additionally endowed with an anisotropic constitutive model, which reflects the active and passive mechanical behavior of muscle fibers. The dynamic deformation of tongue is simulated based on finite element method (FEM). Simulation results of tongue movements subjected to certain muscle activations are presented and validated with experimental data. This tongue model can be applied in many areas, like media art, education, entertainment.