基于深度学习的沉浸式4D智能交互平台

Huang Yonghao, Yan Qi, Wang Xiaofang
{"title":"基于深度学习的沉浸式4D智能交互平台","authors":"Huang Yonghao, Yan Qi, Wang Xiaofang","doi":"10.1109/ICCWAMTIP53232.2021.9674087","DOIUrl":null,"url":null,"abstract":"With the advent of the Internet era, the cost of realizing virtual characters has been greatly reduced. The high cost and low efficiency exhibited by traditional virtual technology can't meet social needs. People are seeking fast, convenient and accurate virtual character reproduction technology. Through researching the characteristics of the characters appearance, language habits, voice tone and so on, the research direction of this paper is to simulate and reshape voice and images, construct a cloud platform-based on user-side and client-side, and integrate deep learning, natural language processing, digital twins and other technologies to an immersive 4D intelligent interactive platform. The platform under in the form of application software provides integrated services of intelligent voice interaction and virtual character interaction. In the industrial diagnosis mode, the transition from traditional video retention and voice retention to a new intelligent voice recognition and simulation mode is realized.","PeriodicalId":358772,"journal":{"name":"2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)","volume":"60 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Immersive 4D Intelligent Interactive Platform Based on Deep Learning\",\"authors\":\"Huang Yonghao, Yan Qi, Wang Xiaofang\",\"doi\":\"10.1109/ICCWAMTIP53232.2021.9674087\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the advent of the Internet era, the cost of realizing virtual characters has been greatly reduced. The high cost and low efficiency exhibited by traditional virtual technology can't meet social needs. People are seeking fast, convenient and accurate virtual character reproduction technology. Through researching the characteristics of the characters appearance, language habits, voice tone and so on, the research direction of this paper is to simulate and reshape voice and images, construct a cloud platform-based on user-side and client-side, and integrate deep learning, natural language processing, digital twins and other technologies to an immersive 4D intelligent interactive platform. The platform under in the form of application software provides integrated services of intelligent voice interaction and virtual character interaction. In the industrial diagnosis mode, the transition from traditional video retention and voice retention to a new intelligent voice recognition and simulation mode is realized.\",\"PeriodicalId\":358772,\"journal\":{\"name\":\"2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)\",\"volume\":\"60 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCWAMTIP53232.2021.9674087\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCWAMTIP53232.2021.9674087","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

随着互联网时代的到来,实现虚拟角色的成本大大降低。传统虚拟技术所表现出的高成本、低效率已经不能满足社会的需求。人们追求快速、方便、准确的虚拟人物复制技术。通过对人物外貌、语言习惯、语音语调等特征的研究,对语音和图像进行模拟重塑,构建基于用户端和客户端的云平台,将深度学习、自然语言处理、数字孪生等技术融合到一个沉浸式的4D智能交互平台。该平台以应用软件的形式提供智能语音交互和虚拟人物交互的综合服务。在工业诊断模式中,实现了从传统的视频保留和语音保留向智能语音识别和模拟新模式的过渡。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Immersive 4D Intelligent Interactive Platform Based on Deep Learning
With the advent of the Internet era, the cost of realizing virtual characters has been greatly reduced. The high cost and low efficiency exhibited by traditional virtual technology can't meet social needs. People are seeking fast, convenient and accurate virtual character reproduction technology. Through researching the characteristics of the characters appearance, language habits, voice tone and so on, the research direction of this paper is to simulate and reshape voice and images, construct a cloud platform-based on user-side and client-side, and integrate deep learning, natural language processing, digital twins and other technologies to an immersive 4D intelligent interactive platform. The platform under in the form of application software provides integrated services of intelligent voice interaction and virtual character interaction. In the industrial diagnosis mode, the transition from traditional video retention and voice retention to a new intelligent voice recognition and simulation mode is realized.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信