{"title":"Facial Expression and Behavior Modeling from Digital Avatars to Expressive Humanoid Robots: A Review","authors":"Xu Zhang, Longbing Cao","doi":"10.1145/3856804","DOIUrl":null,"url":null,"abstract":"Endowing humanoid robots with expressive, controllable, and robust facial expressions and behaviors is essential for advancing human-like humanoid-human interaction across social, healthcare, and service domains. However, transforming the semantic richness and flexibility of virtual avatars into the mechanical, real-time, and calibration constraints of physical humanoids remains a fundamental challenge. This survey reviews facial expression and behavior modeling for both and analyzes their virtual-to-physical gaps from a deployment-oriented perspective. Our review is organized along three axes: (i) <jats:italic toggle=\"yes\">modeling paradigms</jats:italic> , with emphasis on actuator compatibility and transferability; (ii) <jats:italic toggle=\"yes\">expression control strategies</jats:italic> , assessed for their potential to enable robust robotic deployment; and (iii) <jats:italic toggle=\"yes\">deployment dimensions</jats:italic> , which examine the challenges of parameter-to-actuator mapping, calibration, and real-time operation. This survey provides a critical synthesis of the trade-offs between expressive fidelity and hardware feasibility. We analyze persistent gaps between algorithmic advances and embodied realization, and review the datasets, metrics, and evaluation frameworks necessary for advancing expressive humanoids and their facial expression and behavior modeling. Finally, we identify open challenges and future research directions, including multimodal coordination, adaptive personalization, and standardized evaluation, providing guidance for next-generation expressive human-like humanoids, and systematically integrating advances in humanoid modeling with actionable deployment of humanoid facial expressions and behaviors.","PeriodicalId":50926,"journal":{"name":"ACM Computing Surveys","volume":"90 1","pages":""},"PeriodicalIF":30.4000,"publicationDate":"2026-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Computing Surveys","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3856804","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0
Abstract
Endowing humanoid robots with expressive, controllable, and robust facial expressions and behaviors is essential for advancing human-like humanoid-human interaction across social, healthcare, and service domains. However, transforming the semantic richness and flexibility of virtual avatars into the mechanical, real-time, and calibration constraints of physical humanoids remains a fundamental challenge. This survey reviews facial expression and behavior modeling for both and analyzes their virtual-to-physical gaps from a deployment-oriented perspective. Our review is organized along three axes: (i) modeling paradigms , with emphasis on actuator compatibility and transferability; (ii) expression control strategies , assessed for their potential to enable robust robotic deployment; and (iii) deployment dimensions , which examine the challenges of parameter-to-actuator mapping, calibration, and real-time operation. This survey provides a critical synthesis of the trade-offs between expressive fidelity and hardware feasibility. We analyze persistent gaps between algorithmic advances and embodied realization, and review the datasets, metrics, and evaluation frameworks necessary for advancing expressive humanoids and their facial expression and behavior modeling. Finally, we identify open challenges and future research directions, including multimodal coordination, adaptive personalization, and standardized evaluation, providing guidance for next-generation expressive human-like humanoids, and systematically integrating advances in humanoid modeling with actionable deployment of humanoid facial expressions and behaviors.
期刊介绍:
ACM Computing Surveys is an academic journal that focuses on publishing surveys and tutorials on various areas of computing research and practice. The journal aims to provide comprehensive and easily understandable articles that guide readers through the literature and help them understand topics outside their specialties. In terms of impact, CSUR has a high reputation with a 2022 Impact Factor of 16.6. It is ranked 3rd out of 111 journals in the field of Computer Science Theory & Methods.
ACM Computing Surveys is indexed and abstracted in various services, including AI2 Semantic Scholar, Baidu, Clarivate/ISI: JCR, CNKI, DeepDyve, DTU, EBSCO: EDS/HOST, and IET Inspec, among others.