面向交互环境可视化的脸色变化语音驱动化身机器人系统

IF 0.9 Q4 ROBOTICS

Journal of Robotics and Mechatronics Pub Date : 2023-10-20 DOI:10.20965/jrm.2023.p1331

Yoshihiro Sejima, Liheng Yang, Saki Inagaki, Daiki Morita

{"title":"面向交互环境可视化的脸色变化语音驱动化身机器人系统","authors":"Yoshihiro Sejima, Liheng Yang, Saki Inagaki, Daiki Morita","doi":"10.20965/jrm.2023.p1331","DOIUrl":null,"url":null,"abstract":"Smooth interactions between talkers can be realized by transmitting and receiving mutual video images and voices in remote communication. However, in such remote communication, it is difficult to generate a sense of unity and an interactive atmosphere because humans recognize screens as a boundary of the physical space. Therefore, it is essential to develop a communication system that can generate and share an interactive atmosphere and interaction-activated communication even if talkers are in remote places. In this study, we developed a speech-driven avatar robot system incorporating an estimation model that simulates the degree of activated communication based on the talker’s speech. The developed avatar robot system can visualize an interactive atmosphere while changing the complexion based on an estimated value. The effectiveness of the developed system was demonstrated by means of sensory evaluations.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"70 5","pages":"0"},"PeriodicalIF":0.9000,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Speech-Driven Avatar Robot System with Changing Complexion for the Visualization of an Interactive Atmosphere\",\"authors\":\"Yoshihiro Sejima, Liheng Yang, Saki Inagaki, Daiki Morita\",\"doi\":\"10.20965/jrm.2023.p1331\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Smooth interactions between talkers can be realized by transmitting and receiving mutual video images and voices in remote communication. However, in such remote communication, it is difficult to generate a sense of unity and an interactive atmosphere because humans recognize screens as a boundary of the physical space. Therefore, it is essential to develop a communication system that can generate and share an interactive atmosphere and interaction-activated communication even if talkers are in remote places. In this study, we developed a speech-driven avatar robot system incorporating an estimation model that simulates the degree of activated communication based on the talker’s speech. The developed avatar robot system can visualize an interactive atmosphere while changing the complexion based on an estimated value. The effectiveness of the developed system was demonstrated by means of sensory evaluations.\",\"PeriodicalId\":51661,\"journal\":{\"name\":\"Journal of Robotics and Mechatronics\",\"volume\":\"70 5\",\"pages\":\"0\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2023-10-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Robotics and Mechatronics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.20965/jrm.2023.p1331\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Robotics and Mechatronics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.20965/jrm.2023.p1331","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ROBOTICS","Score":null,"Total":0}

引用次数: 0

摘要

在远程通信中，通过相互发送和接收视频图像和语音，可以实现通话者之间的顺畅交互。然而，在这种远程交流中，由于人们将屏幕视为物理空间的边界，因此很难产生一种统一感和互动氛围。因此，开发一种即使在遥远的地方也能产生和共享互动氛围和互动激活通信的通信系统是非常必要的。在这项研究中，我们开发了一个语音驱动的化身机器人系统，该系统结合了一个估计模型，该模型基于说话者的语音来模拟激活沟通的程度。开发的化身机器人系统可以在根据估计值改变肤色的同时，将互动氛围可视化。通过感官评价证明了所开发系统的有效性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Speech-Driven Avatar Robot System with Changing Complexion for the Visualization of an Interactive Atmosphere

Smooth interactions between talkers can be realized by transmitting and receiving mutual video images and voices in remote communication. However, in such remote communication, it is difficult to generate a sense of unity and an interactive atmosphere because humans recognize screens as a boundary of the physical space. Therefore, it is essential to develop a communication system that can generate and share an interactive atmosphere and interaction-activated communication even if talkers are in remote places. In this study, we developed a speech-driven avatar robot system incorporating an estimation model that simulates the degree of activated communication based on the talker’s speech. The developed avatar robot system can visualize an interactive atmosphere while changing the complexion based on an estimated value. The effectiveness of the developed system was demonstrated by means of sensory evaluations.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Journal of Robotics and Mechatronics ROBOTICS-

CiteScore

2.20

自引率

36.40%

发文量

134

期刊介绍： First published in 1989, the Journal of Robotics and Mechatronics (JRM) has the longest publication history in the world in this field, publishing a total of over 2,000 works exclusively on robotics and mechatronics from the first number. The Journal publishes academic papers, development reports, reviews, letters, notes, and discussions. The JRM is a peer-reviewed journal in fields such as robotics, mechatronics, automation, and system integration. Its editorial board includes wellestablished researchers and engineers in the field from the world over. The scope of the journal includes any and all topics on robotics and mechatronics. As a key technology in robotics and mechatronics, it includes actuator design, motion control, sensor design, sensor fusion, sensor networks, robot vision, audition, mechanism design, robot kinematics and dynamics, mobile robot, path planning, navigation, SLAM, robot hand, manipulator, nano/micro robot, humanoid, service and home robots, universal design, middleware, human-robot interaction, human interface, networked robotics, telerobotics, ubiquitous robot, learning, and intelligence. The scope also includes applications of robotics and automation, and system integrations in the fields of manufacturing, construction, underwater, space, agriculture, sustainability, energy conservation, ecology, rescue, hazardous environments, safety and security, dependability, medical, and welfare.