Perceptual evaluation of approaches for binaural reproduction of non-spherical microphone array signals

IF 1.3 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Tim Lübeck, Sebastià V. Amengual Garí, P. Calamia, D. Alon, Jeff Crukley, Z. Ben-Hur
{"title":"Perceptual evaluation of approaches for binaural reproduction of non-spherical microphone array signals","authors":"Tim Lübeck, Sebastià V. Amengual Garí, P. Calamia, D. Alon, Jeff Crukley, Z. Ben-Hur","doi":"10.3389/frsip.2022.883696","DOIUrl":null,"url":null,"abstract":"Microphone arrays consisting of sensors mounted on the surface of a rigid, spherical scatterer are popular tools for the capture and binaural reproduction of spatial sound scenes. However, microphone arrays with a perfectly spherical body and uniformly distributed microphones are often impractical for the consumer sector, in which microphone arrays are generally mounted on mobile and wearable devices of arbitrary geometries. Therefore, the binaural reproduction of sound fields captured with arbitrarily shaped microphone arrays has become an important field of research. In this work, we present a comparison of methods for the binaural reproduction of sound fields captured with non-spherical microphone arrays. First, we evaluated equatorial microphone arrays (EMAs), where the microphones are distributed on an equatorial contour of a rigid, spherical 1 . Second, we evaluated a microphone array with six microphones mounted on a pair of glasses. Using these two arrays, we conducted two listening experiments comparing four rendering methods based on acoustic scenes captured in different rooms2. The evaluation includes a microphone-based stereo approach (sAB stereo), a beamforming-based stereo approach (sXY stereo), beamforming-based binaural reproduction (BFBR), and BFBR with binaural signal matching (BSM). Additionally, the perceptual evaluation included binaural Ambisonics renderings, which were based on measurements with spherical microphone arrays. In the EMA experiment we included a fourth-order Ambisonics rendering, while in the glasses array experiment we included a second-order Ambisonics rendering. In both listening experiments in which participants compared all approaches with a dummy head recording we applied non-head-tracked binaural synthesis, with sound sources only in the horizontal plane. The perceived differences were rated separately for the attributes timbre and spaciousness. Results suggest that most approaches perform similarly to the Ambisonics rendering. Overall, BSM, and microphone-based stereo were rated the best for EMAs, and BFBR and microphone-based stereo for the glasses array.","PeriodicalId":93557,"journal":{"name":"Frontiers in signal processing","volume":"106 1","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2022-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in signal processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frsip.2022.883696","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 1

Abstract

Microphone arrays consisting of sensors mounted on the surface of a rigid, spherical scatterer are popular tools for the capture and binaural reproduction of spatial sound scenes. However, microphone arrays with a perfectly spherical body and uniformly distributed microphones are often impractical for the consumer sector, in which microphone arrays are generally mounted on mobile and wearable devices of arbitrary geometries. Therefore, the binaural reproduction of sound fields captured with arbitrarily shaped microphone arrays has become an important field of research. In this work, we present a comparison of methods for the binaural reproduction of sound fields captured with non-spherical microphone arrays. First, we evaluated equatorial microphone arrays (EMAs), where the microphones are distributed on an equatorial contour of a rigid, spherical 1 . Second, we evaluated a microphone array with six microphones mounted on a pair of glasses. Using these two arrays, we conducted two listening experiments comparing four rendering methods based on acoustic scenes captured in different rooms2. The evaluation includes a microphone-based stereo approach (sAB stereo), a beamforming-based stereo approach (sXY stereo), beamforming-based binaural reproduction (BFBR), and BFBR with binaural signal matching (BSM). Additionally, the perceptual evaluation included binaural Ambisonics renderings, which were based on measurements with spherical microphone arrays. In the EMA experiment we included a fourth-order Ambisonics rendering, while in the glasses array experiment we included a second-order Ambisonics rendering. In both listening experiments in which participants compared all approaches with a dummy head recording we applied non-head-tracked binaural synthesis, with sound sources only in the horizontal plane. The perceived differences were rated separately for the attributes timbre and spaciousness. Results suggest that most approaches perform similarly to the Ambisonics rendering. Overall, BSM, and microphone-based stereo were rated the best for EMAs, and BFBR and microphone-based stereo for the glasses array.
非球形传声器阵列信号双耳再现方法的感知评价
由安装在刚性球形散射体表面的传感器组成的麦克风阵列是捕获和双耳再现空间声音场景的常用工具。然而,具有完美球形体和均匀分布麦克风的麦克风阵列通常不适合消费领域,其中麦克风阵列通常安装在任意几何形状的移动和可穿戴设备上。因此,利用任意形状的传声器阵列捕获声场的双耳再现已成为一个重要的研究领域。在这项工作中,我们提出了用非球形麦克风阵列捕获声场的双耳再现方法的比较。首先,我们评估了赤道麦克风阵列(ema),其中麦克风分布在刚性球形的赤道轮廓上。其次,我们评估了一个麦克风阵列,其中六个麦克风安装在一副眼镜上。利用这两种阵列,我们进行了两次听力实验,比较了四种基于不同房间声学场景的渲染方法。评估包括基于麦克风的立体声方法(sAB立体声)、基于波束形成的立体声方法(sXY立体声)、基于波束形成的双耳再现(BFBR)和基于BFBR的双耳信号匹配(BSM)。此外,感知评价包括双耳立体声渲染,这是基于球形麦克风阵列的测量。在EMA实验中,我们包含了一个四阶立体声渲染,而在眼镜阵列实验中,我们包含了一个二阶立体声渲染。在两个听力实验中,参与者将所有方法与假头录音进行比较,我们使用了非头部跟踪的双耳合成,声源仅在水平面上。感知差异分别评估属性音色和空间。结果表明,大多数方法的表现与立体声渲染相似。总体而言,BSM和基于麦克风的立体声被评为ema的最佳选择,BFBR和基于麦克风的立体声被评为眼镜阵列的最佳选择。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信