基于人脸表情特征的仿人机器人头部面部驱动点选择与快速定位研究

IF 4.4 3区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Zhibin Yan, Jiayu Zhao, Zhouyi Wang, Liuwei Wang, Zhendong Dai
{"title":"基于人脸表情特征的仿人机器人头部面部驱动点选择与快速定位研究","authors":"Zhibin Yan,&nbsp;Jiayu Zhao,&nbsp;Zhouyi Wang,&nbsp;Liuwei Wang,&nbsp;Zhendong Dai","doi":"10.1007/s42235-026-00969-9","DOIUrl":null,"url":null,"abstract":"<div><p>Achieving realistic facial expressions is a central goal in humanoid robot head research. Current methods for determining facial drive points, often based on FACS and design experience, are subjective and prone to bias. This study proposes a quantitative method for selecting facial drive point positions based on optical motion capture and interpolation reconstruction, providing a set of 3D coordinates. On this basis, we further propose a rapid positioning method for robotic drive points applicable to diverse human bionic subjects. Motion data of 238 reflective markers were captured from volunteers performing six basic and one arbitrary facial expression to represent facial movement characteristics. Drive areas were defined based on facial muscle distribution and movement patterns, and the maximum displacement point in each area was calculated using TPS interpolation and displacement field reconstruction to obtain full-face drive point coordinates. For diverse human bionic subjects, proportional correspondences between their inherent facial features and the drive point parameters established in this study were calculated, and new facial drive points were positioned through scaling. To validate the approach, based on the results, a 19-degree-of-freedom humanoid head prototype was built, realizing six basic expressions with recognition rates exceeding 90%, thereby validating the feasibility of the proposed drive point determination method for practical applications. In summary, the proposed methods provide a quantitative reference for subsequent research, enhance design efficiency, and provides a theoretical foundation for achieving more natural and realistic robotic facial expressions.</p></div>","PeriodicalId":614,"journal":{"name":"Journal of Bionic Engineering","volume":"23 5","pages":"3001 - 3019"},"PeriodicalIF":4.4000,"publicationDate":"2026-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on the Selection and Rapid Positioning of Facial Drive Points for Humanoid Robot Heads by Characterizing Human Facial Expressions\",\"authors\":\"Zhibin Yan,&nbsp;Jiayu Zhao,&nbsp;Zhouyi Wang,&nbsp;Liuwei Wang,&nbsp;Zhendong Dai\",\"doi\":\"10.1007/s42235-026-00969-9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Achieving realistic facial expressions is a central goal in humanoid robot head research. Current methods for determining facial drive points, often based on FACS and design experience, are subjective and prone to bias. This study proposes a quantitative method for selecting facial drive point positions based on optical motion capture and interpolation reconstruction, providing a set of 3D coordinates. On this basis, we further propose a rapid positioning method for robotic drive points applicable to diverse human bionic subjects. Motion data of 238 reflective markers were captured from volunteers performing six basic and one arbitrary facial expression to represent facial movement characteristics. Drive areas were defined based on facial muscle distribution and movement patterns, and the maximum displacement point in each area was calculated using TPS interpolation and displacement field reconstruction to obtain full-face drive point coordinates. For diverse human bionic subjects, proportional correspondences between their inherent facial features and the drive point parameters established in this study were calculated, and new facial drive points were positioned through scaling. To validate the approach, based on the results, a 19-degree-of-freedom humanoid head prototype was built, realizing six basic expressions with recognition rates exceeding 90%, thereby validating the feasibility of the proposed drive point determination method for practical applications. In summary, the proposed methods provide a quantitative reference for subsequent research, enhance design efficiency, and provides a theoretical foundation for achieving more natural and realistic robotic facial expressions.</p></div>\",\"PeriodicalId\":614,\"journal\":{\"name\":\"Journal of Bionic Engineering\",\"volume\":\"23 5\",\"pages\":\"3001 - 3019\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2026-08-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Bionic Engineering\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s42235-026-00969-9\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Bionic Engineering","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s42235-026-00969-9","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

实现逼真的面部表情是仿人机器人头部研究的核心目标。目前确定面部驱动点的方法通常基于FACS和设计经验,是主观的,容易产生偏见。本研究提出了一种基于光学运动捕捉和插值重建的面部驱动点位置定量化选择方法,提供了一组三维坐标。在此基础上,我们进一步提出了一种适用于多种人体仿生主体的机器人驱动点快速定位方法。通过对志愿者进行6种基本面部表情和1种任意面部表情表征面部运动特征,获取238个反射标记的运动数据。基于面部肌肉分布和运动模式定义驱动区域,利用TPS插值和位移场重构计算每个区域的最大位移点,得到全面驱动点坐标。针对不同的人体仿生对象,计算其固有面部特征与本研究建立的驱动点参数之间的比例对应关系,并通过缩放定位新的面部驱动点。为了验证该方法的有效性,在此基础上构建了一个19自由度的人形头部原型,实现了6种基本表情,识别率超过90%,从而验证了所提出的驱动点确定方法在实际应用中的可行性。综上所述,所提出的方法为后续研究提供了定量参考,提高了设计效率,为实现更加自然逼真的机器人面部表情提供了理论基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Research on the Selection and Rapid Positioning of Facial Drive Points for Humanoid Robot Heads by Characterizing Human Facial Expressions

Achieving realistic facial expressions is a central goal in humanoid robot head research. Current methods for determining facial drive points, often based on FACS and design experience, are subjective and prone to bias. This study proposes a quantitative method for selecting facial drive point positions based on optical motion capture and interpolation reconstruction, providing a set of 3D coordinates. On this basis, we further propose a rapid positioning method for robotic drive points applicable to diverse human bionic subjects. Motion data of 238 reflective markers were captured from volunteers performing six basic and one arbitrary facial expression to represent facial movement characteristics. Drive areas were defined based on facial muscle distribution and movement patterns, and the maximum displacement point in each area was calculated using TPS interpolation and displacement field reconstruction to obtain full-face drive point coordinates. For diverse human bionic subjects, proportional correspondences between their inherent facial features and the drive point parameters established in this study were calculated, and new facial drive points were positioned through scaling. To validate the approach, based on the results, a 19-degree-of-freedom humanoid head prototype was built, realizing six basic expressions with recognition rates exceeding 90%, thereby validating the feasibility of the proposed drive point determination method for practical applications. In summary, the proposed methods provide a quantitative reference for subsequent research, enhance design efficiency, and provides a theoretical foundation for achieving more natural and realistic robotic facial expressions.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Bionic Engineering
Journal of Bionic Engineering 工程技术-材料科学:生物材料
CiteScore
7.10
自引率
10.00%
发文量
162
审稿时长
10.0 months
期刊介绍: The Journal of Bionic Engineering (JBE) is a peer-reviewed journal that publishes original research papers and reviews that apply the knowledge learned from nature and biological systems to solve concrete engineering problems. The topics that JBE covers include but are not limited to: Mechanisms, kinematical mechanics and control of animal locomotion, development of mobile robots with walking (running and crawling), swimming or flying abilities inspired by animal locomotion. Structures, morphologies, composition and physical properties of natural and biomaterials; fabrication of new materials mimicking the properties and functions of natural and biomaterials. Biomedical materials, artificial organs and tissue engineering for medical applications; rehabilitation equipment and devices. Development of bioinspired computation methods and artificial intelligence for engineering applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书