虚拟现实中的立体声和声音模拟

Yulia Yagunova, M. Poletti, Paul D. Teal
{"title":"虚拟现实中的立体声和声音模拟","authors":"Yulia Yagunova, M. Poletti, Paul D. Teal","doi":"10.1109/TENCON54134.2021.9707299","DOIUrl":null,"url":null,"abstract":"It can be challenging for opera singers to access their performance venues for rehearsal due to venue sched-ules or travel restrictions. Virtual reality (VR) or augmented reality (AR) technologies provide the possibility for rehearsal in a virtual venue. However, these technologies are mainly focused on visuals, rather than on the sonic plausibility of a virtual space. Moreover, existing self-auralization methods have one or more of the following limitations: a small choice of virtual venues, restricted user movement, generic rather than individualized configuration, and an expensive rehearsal space. This paper presents an Ambisonics method that addresses these limitations. The method simulates the acoustics of a chosen performance venue in real-time, by simulating oral-binaural room impulse responses (OBRIRs). This method allows changing the virtual venue and user-related data, and provides three-degrees-of-freedom (3DoF) for user head movement. The method is validated using quantitative and qualitative methods, and challenges of future real-time implementation are discussed. Despite the challenges, the method is capable of facilitating virtual rehearsal in real-time while providing for greater user flexibility.","PeriodicalId":405859,"journal":{"name":"TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Ambisonics and Sonic Simulation in Virtual Reality\",\"authors\":\"Yulia Yagunova, M. Poletti, Paul D. Teal\",\"doi\":\"10.1109/TENCON54134.2021.9707299\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"It can be challenging for opera singers to access their performance venues for rehearsal due to venue sched-ules or travel restrictions. Virtual reality (VR) or augmented reality (AR) technologies provide the possibility for rehearsal in a virtual venue. However, these technologies are mainly focused on visuals, rather than on the sonic plausibility of a virtual space. Moreover, existing self-auralization methods have one or more of the following limitations: a small choice of virtual venues, restricted user movement, generic rather than individualized configuration, and an expensive rehearsal space. This paper presents an Ambisonics method that addresses these limitations. The method simulates the acoustics of a chosen performance venue in real-time, by simulating oral-binaural room impulse responses (OBRIRs). This method allows changing the virtual venue and user-related data, and provides three-degrees-of-freedom (3DoF) for user head movement. The method is validated using quantitative and qualitative methods, and challenges of future real-time implementation are discussed. Despite the challenges, the method is capable of facilitating virtual rehearsal in real-time while providing for greater user flexibility.\",\"PeriodicalId\":405859,\"journal\":{\"name\":\"TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON)\",\"volume\":\"32 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/TENCON54134.2021.9707299\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"TENCON 2021 - 2021 IEEE Region 10 Conference (TENCON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/TENCON54134.2021.9707299","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

由于演出场地的日程安排或旅行限制,歌剧演员很难进入演出场地进行排练。虚拟现实(VR)或增强现实(AR)技术提供了在虚拟场地进行排练的可能性。然而,这些技术主要集中在视觉上,而不是虚拟空间的声音合理性。此外,现有的自我听觉化方法有以下一个或多个限制:虚拟场地的选择很少,用户的移动受限,通用而非个性化的配置,以及昂贵的排练空间。本文提出了一种解决这些限制的双声方法。该方法通过模拟口-双耳房间脉冲响应(OBRIRs),实时模拟选定演出场地的声学效果。这种方法允许改变虚拟场地和用户相关数据,并为用户头部运动提供三自由度(3DoF)。采用定量和定性方法对该方法进行了验证,并讨论了未来实时实现的挑战。尽管存在挑战,但该方法能够促进实时虚拟排练,同时为用户提供更大的灵活性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Ambisonics and Sonic Simulation in Virtual Reality
It can be challenging for opera singers to access their performance venues for rehearsal due to venue sched-ules or travel restrictions. Virtual reality (VR) or augmented reality (AR) technologies provide the possibility for rehearsal in a virtual venue. However, these technologies are mainly focused on visuals, rather than on the sonic plausibility of a virtual space. Moreover, existing self-auralization methods have one or more of the following limitations: a small choice of virtual venues, restricted user movement, generic rather than individualized configuration, and an expensive rehearsal space. This paper presents an Ambisonics method that addresses these limitations. The method simulates the acoustics of a chosen performance venue in real-time, by simulating oral-binaural room impulse responses (OBRIRs). This method allows changing the virtual venue and user-related data, and provides three-degrees-of-freedom (3DoF) for user head movement. The method is validated using quantitative and qualitative methods, and challenges of future real-time implementation are discussed. Despite the challenges, the method is capable of facilitating virtual rehearsal in real-time while providing for greater user flexibility.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信