基于WebRTC的网络音乐表演：一种低延迟PCM音频解决方案

IF 1.1 4区工程技术 Q3 ACOUSTICS

Journal of the Audio Engineering Society Pub Date : 2022-12-12 DOI:10.17743/jaes.2022.0021

Matteo Sacchetto, P. Gastaldi, C. Chafe, C. Rottondi, A. Servetti

{"title":"基于WebRTC的网络音乐表演：一种低延迟PCM音频解决方案","authors":"Matteo Sacchetto, P. Gastaldi, C. Chafe, C. Rottondi, A. Servetti","doi":"10.17743/jaes.2022.0021","DOIUrl":null,"url":null,"abstract":"Nowadays, widely used videoconferencing software has been diffused even further by the social distancing measures adopted during the SARS-CoV-2 pandemic. However, none of the Web-based solutions currently available support high-fidelity stereo audio streaming, which is a fundamental prerequisite for networked music applications. This is mainly because of the fact that the WebRTC RTCPeerConnection standard or Web-based audio streaming do not handle uncompressed audio formats. To overcome that limitation, an implementation of 16-bit pulse code modulation (PCM) stereo audio transmission on top of the WebRTC RTCDataChannel, leveraging Web Audio and AudioWorklets, is discussed. Results obtained with multiple configurations, browsers, and operating systems show that the proposed approach outperforms the WebRTC RTCPeerConnection standard in terms of audio quality and latency, which in the authors' best case to date has been reduced to only 40 ms between two MacBooks on a local area network. © 2022 Audio Engineering Society. All rights reserved.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2022-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Web-Based Networked Music Performances via WebRTC: A Low-Latency PCM Audio Solution\",\"authors\":\"Matteo Sacchetto, P. Gastaldi, C. Chafe, C. Rottondi, A. Servetti\",\"doi\":\"10.17743/jaes.2022.0021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Nowadays, widely used videoconferencing software has been diffused even further by the social distancing measures adopted during the SARS-CoV-2 pandemic. However, none of the Web-based solutions currently available support high-fidelity stereo audio streaming, which is a fundamental prerequisite for networked music applications. This is mainly because of the fact that the WebRTC RTCPeerConnection standard or Web-based audio streaming do not handle uncompressed audio formats. To overcome that limitation, an implementation of 16-bit pulse code modulation (PCM) stereo audio transmission on top of the WebRTC RTCDataChannel, leveraging Web Audio and AudioWorklets, is discussed. Results obtained with multiple configurations, browsers, and operating systems show that the proposed approach outperforms the WebRTC RTCPeerConnection standard in terms of audio quality and latency, which in the authors' best case to date has been reduced to only 40 ms between two MacBooks on a local area network. © 2022 Audio Engineering Society. All rights reserved.\",\"PeriodicalId\":50008,\"journal\":{\"name\":\"Journal of the Audio Engineering Society\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2022-12-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the Audio Engineering Society\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.17743/jaes.2022.0021\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ACOUSTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Audio Engineering Society","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.17743/jaes.2022.0021","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ACOUSTICS","Score":null,"Total":0}

引用次数: 6

摘要

如今，由于严重急性呼吸系统综合征冠状病毒2型疫情期间采取的社交距离措施，广泛使用的视频会议软件得到了进一步推广。然而，目前可用的基于Web的解决方案都不支持高保真立体声音频流，这是网络音乐应用程序的基本前提。这主要是因为WebRTC RTCPeerConnection标准或基于Web的音频流不处理未压缩的音频格式。为了克服这一限制，讨论了利用Web audio和AudioWorklets在WebRTC RTCDataChannel之上实现16位脉冲编码调制（PCM）立体声音频传输。使用多种配置、浏览器和操作系统获得的结果表明，所提出的方法在音频质量和延迟方面优于WebRTC RTCPeerConnection标准，在作者迄今为止的最佳情况下，局域网上两台MacBook之间的延迟已降至仅40毫秒。©2022音频工程学会。保留所有权利。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Web-Based Networked Music Performances via WebRTC: A Low-Latency PCM Audio Solution

Nowadays, widely used videoconferencing software has been diffused even further by the social distancing measures adopted during the SARS-CoV-2 pandemic. However, none of the Web-based solutions currently available support high-fidelity stereo audio streaming, which is a fundamental prerequisite for networked music applications. This is mainly because of the fact that the WebRTC RTCPeerConnection standard or Web-based audio streaming do not handle uncompressed audio formats. To overcome that limitation, an implementation of 16-bit pulse code modulation (PCM) stereo audio transmission on top of the WebRTC RTCDataChannel, leveraging Web Audio and AudioWorklets, is discussed. Results obtained with multiple configurations, browsers, and operating systems show that the proposed approach outperforms the WebRTC RTCPeerConnection standard in terms of audio quality and latency, which in the authors' best case to date has been reduced to only 40 ms between two MacBooks on a local area network. © 2022 Audio Engineering Society. All rights reserved.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Journal of the Audio Engineering Society 工程技术-工程：综合

CiteScore

3.50

自引率

14.30%

发文量

审稿时长

1 months

期刊介绍： The Journal of the Audio Engineering Society — the official publication of the AES — is the only peer-reviewed journal devoted exclusively to audio technology. Published 10 times each year, it is available to all AES members and subscribers. The Journal contains state-of-the-art technical papers and engineering reports; feature articles covering timely topics; pre and post reports of AES conventions and other society activities; news from AES sections around the world; Standards and Education Committee work; membership news, patents, new products, and newsworthy developments in the field of audio.