Facial Expression and Behavior Modeling from Digital Avatars to Expressive Humanoid Robots: A Review

IF 30.4 1区 计算机科学 Q1 COMPUTER SCIENCE, THEORY & METHODS
Xu Zhang, Longbing Cao
{"title":"Facial Expression and Behavior Modeling from Digital Avatars to Expressive Humanoid Robots: A Review","authors":"Xu Zhang, Longbing Cao","doi":"10.1145/3856804","DOIUrl":null,"url":null,"abstract":"Endowing humanoid robots with expressive, controllable, and robust facial expressions and behaviors is essential for advancing human-like humanoid-human interaction across social, healthcare, and service domains. However, transforming the semantic richness and flexibility of virtual avatars into the mechanical, real-time, and calibration constraints of physical humanoids remains a fundamental challenge. This survey reviews facial expression and behavior modeling for both and analyzes their virtual-to-physical gaps from a deployment-oriented perspective. Our review is organized along three axes: (i) <jats:italic toggle=\"yes\">modeling paradigms</jats:italic> , with emphasis on actuator compatibility and transferability; (ii) <jats:italic toggle=\"yes\">expression control strategies</jats:italic> , assessed for their potential to enable robust robotic deployment; and (iii) <jats:italic toggle=\"yes\">deployment dimensions</jats:italic> , which examine the challenges of parameter-to-actuator mapping, calibration, and real-time operation. This survey provides a critical synthesis of the trade-offs between expressive fidelity and hardware feasibility. We analyze persistent gaps between algorithmic advances and embodied realization, and review the datasets, metrics, and evaluation frameworks necessary for advancing expressive humanoids and their facial expression and behavior modeling. Finally, we identify open challenges and future research directions, including multimodal coordination, adaptive personalization, and standardized evaluation, providing guidance for next-generation expressive human-like humanoids, and systematically integrating advances in humanoid modeling with actionable deployment of humanoid facial expressions and behaviors.","PeriodicalId":50926,"journal":{"name":"ACM Computing Surveys","volume":"90 1","pages":""},"PeriodicalIF":30.4000,"publicationDate":"2026-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Computing Surveys","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3856804","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

Endowing humanoid robots with expressive, controllable, and robust facial expressions and behaviors is essential for advancing human-like humanoid-human interaction across social, healthcare, and service domains. However, transforming the semantic richness and flexibility of virtual avatars into the mechanical, real-time, and calibration constraints of physical humanoids remains a fundamental challenge. This survey reviews facial expression and behavior modeling for both and analyzes their virtual-to-physical gaps from a deployment-oriented perspective. Our review is organized along three axes: (i) modeling paradigms , with emphasis on actuator compatibility and transferability; (ii) expression control strategies , assessed for their potential to enable robust robotic deployment; and (iii) deployment dimensions , which examine the challenges of parameter-to-actuator mapping, calibration, and real-time operation. This survey provides a critical synthesis of the trade-offs between expressive fidelity and hardware feasibility. We analyze persistent gaps between algorithmic advances and embodied realization, and review the datasets, metrics, and evaluation frameworks necessary for advancing expressive humanoids and their facial expression and behavior modeling. Finally, we identify open challenges and future research directions, including multimodal coordination, adaptive personalization, and standardized evaluation, providing guidance for next-generation expressive human-like humanoids, and systematically integrating advances in humanoid modeling with actionable deployment of humanoid facial expressions and behaviors.
面部表情和行为建模,从数字化身到富有表现力的人形机器人:综述
为类人机器人赋予富有表现力、可控制且稳健的面部表情和行为,对于在社会、医疗保健和服务领域推进类人类人互动至关重要。然而,将虚拟化身的语义丰富性和灵活性转化为物理类人的机械、实时和校准约束仍然是一个根本性的挑战。本调查回顾了面部表情和行为建模,并从面向部署的角度分析了它们的虚拟与物理差距。我们的审查是沿着三个轴组织:(i)建模范式,重点是执行器的兼容性和可转移性;(ii)表情控制策略,评估其实现稳健机器人部署的潜力;(iii)部署维度,考察参数到执行器映射、校准和实时操作的挑战。这项调查提供了一个关键的综合在表达保真度和硬件可行性之间的权衡。我们分析了算法进步和具体化实现之间的持续差距,并回顾了推进具有表现力的类人机器人及其面部表情和行为建模所需的数据集、指标和评估框架。最后,我们确定了开放的挑战和未来的研究方向,包括多模态协调、自适应个性化和标准化评估,为下一代具有表现力的类人机器人提供指导,并系统地将类人机器人建模的进展与可操作的类人面部表情和行为部署相结合。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ACM Computing Surveys
ACM Computing Surveys 工程技术-计算机:理论方法
CiteScore
33.20
自引率
0.60%
发文量
372
审稿时长
12 months
期刊介绍: ACM Computing Surveys is an academic journal that focuses on publishing surveys and tutorials on various areas of computing research and practice. The journal aims to provide comprehensive and easily understandable articles that guide readers through the literature and help them understand topics outside their specialties. In terms of impact, CSUR has a high reputation with a 2022 Impact Factor of 16.6. It is ranked 3rd out of 111 journals in the field of Computer Science Theory & Methods. ACM Computing Surveys is indexed and abstracted in various services, including AI2 Semantic Scholar, Baidu, Clarivate/ISI: JCR, CNKI, DeepDyve, DTU, EBSCO: EDS/HOST, and IET Inspec, among others.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书