基于手势的沉浸式交互和ml驱动的声音生成的实现

2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) Pub Date : 2020-12-01 DOI:10.1109/AIVR50618.2020.00078

Lee Jen Tun, R. J. Rajapakse, Y. Hung, K. Miyata

{"title":"基于手势的沉浸式交互和ml驱动的声音生成的实现","authors":"Lee Jen Tun, R. J. Rajapakse, Y. Hung, K. Miyata","doi":"10.1109/AIVR50618.2020.00078","DOIUrl":null,"url":null,"abstract":"The main purpose of virtual reality is to immerse a user in a virtual environment. However, the most common criticism of companion robotics is that they are not able to provide effective tactile feedback. In this research, we will propose an interactive companion doll that has a tail mechanism controlled by the user’s hand gestures as well as generate sound feedback by applying OSC and Wekinator. For the VR content, we designed six emotions for the companion doll to be able to provide the user with different feelings while they are interacting with the companion doll in the virtual and physical worlds.","PeriodicalId":348199,"journal":{"name":"2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Implementations of the Gesture-based Immersive Interaction and ML-driven Sound Generation for Haptic Companion Doll\",\"authors\":\"Lee Jen Tun, R. J. Rajapakse, Y. Hung, K. Miyata\",\"doi\":\"10.1109/AIVR50618.2020.00078\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The main purpose of virtual reality is to immerse a user in a virtual environment. However, the most common criticism of companion robotics is that they are not able to provide effective tactile feedback. In this research, we will propose an interactive companion doll that has a tail mechanism controlled by the user’s hand gestures as well as generate sound feedback by applying OSC and Wekinator. For the VR content, we designed six emotions for the companion doll to be able to provide the user with different feelings while they are interacting with the companion doll in the virtual and physical worlds.\",\"PeriodicalId\":348199,\"journal\":{\"name\":\"2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)\",\"volume\":\"8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AIVR50618.2020.00078\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIVR50618.2020.00078","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

摘要

虚拟现实的主要目的是让用户沉浸在虚拟环境中。然而，对同伴机器人最常见的批评是它们不能提供有效的触觉反馈。在本研究中，我们将提出一种交互式伴侣娃娃，该娃娃具有由用户手势控制的尾巴机制，并通过OSC和Wekinator产生声音反馈。在VR内容上，我们为陪伴人偶设计了六种情感，让用户在虚拟世界和物理世界中与陪伴人偶互动时，能够感受到不同的感受。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Implementations of the Gesture-based Immersive Interaction and ML-driven Sound Generation for Haptic Companion Doll

The main purpose of virtual reality is to immerse a user in a virtual environment. However, the most common criticism of companion robotics is that they are not able to provide effective tactile feedback. In this research, we will propose an interactive companion doll that has a tail mechanism controlled by the user’s hand gestures as well as generate sound feedback by applying OSC and Wekinator. For the VR content, we designed six emotions for the companion doll to be able to provide the user with different feelings while they are interacting with the companion doll in the virtual and physical worlds.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)

自引率

0.00%

发文量