Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse

IF 16.4 1区化学 Q1 CHEMISTRY, MULTIDISCIPLINARY

Accounts of Chemical Research Pub Date : 2023-11-16 DOI:10.17743/jaes.2022.0096

Damian T. Dziwis, Henrik von Coler, Christoph Pörschmann

{"title":"Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse","authors":"Damian T. Dziwis, Henrik von Coler, Christoph Pörschmann","doi":"10.17743/jaes.2022.0096","DOIUrl":null,"url":null,"abstract":"As the potential of networked multiuser virtual environments increases under the concept of the metaverse, so do the interest and artistic possibilities of using them for live music performances. Live performances in online metaverse environments offer an easy and environmentally friendly way to bring together artists and audiences from all over the world. Virtualization also enables countless possibilities for designing and creating artistic experiences and new performance practices. For many years, live performances have been established on various virtual platforms, which differ significantly in terms of possible performance practices, user interaction, immersion, and usability. With Orchestra, we are developing an open-source toolbox that uses the Web Audio Application Programming Interface to realize live performances with various performance practices for web-based metaverse environments. Possibilities vary from live streaming of volumetric audio and video, live coding in multiple (including audiovisual) programming languages, to performing with generative algorithms or virtual instruments developed in Pure Data. These can be combined in various ways and also be used for telematic/networked music ensembles, interactive virtual installations, or novel performance concepts. In this paper, we describe the development and scope of the Orchestra toolbox, as well as use cases that illustrate the artistic possibilities.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2023-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.17743/jaes.2022.0096","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

As the potential of networked multiuser virtual environments increases under the concept of the metaverse, so do the interest and artistic possibilities of using them for live music performances. Live performances in online metaverse environments offer an easy and environmentally friendly way to bring together artists and audiences from all over the world. Virtualization also enables countless possibilities for designing and creating artistic experiences and new performance practices. For many years, live performances have been established on various virtual platforms, which differ significantly in terms of possible performance practices, user interaction, immersion, and usability. With Orchestra, we are developing an open-source toolbox that uses the Web Audio Application Programming Interface to realize live performances with various performance practices for web-based metaverse environments. Possibilities vary from live streaming of volumetric audio and video, live coding in multiple (including audiovisual) programming languages, to performing with generative algorithms or virtual instruments developed in Pure Data. These can be combined in various ways and also be used for telematic/networked music ensembles, interactive virtual installations, or novel performance concepts. In this paper, we describe the development and scope of the Orchestra toolbox, as well as use cases that illustrate the artistic possibilities.

查看原文本刊更多论文

管弦乐队基于网络的元宇宙中的现场音乐表演工具箱

在元宇宙概念下，网络多用户虚拟环境的潜力与日俱增，将其用于现场音乐表演的兴趣和艺术可能性也随之增加。在线元宇宙环境中的现场表演为汇集世界各地的艺术家和观众提供了一种简便、环保的方式。虚拟化还为设计和创造艺术体验和新的表演实践提供了无数可能性。多年来，现场表演一直建立在各种虚拟平台上，这些平台在可能的表演实践、用户互动、沉浸感和可用性方面存在很大差异。通过 Orchestra，我们正在开发一个开源工具箱，使用网络音频应用编程接口，在基于网络的元宇宙环境中实现各种表演实践的现场表演。其可能性多种多样，包括体积音频和视频的现场直播、多种（包括视听）编程语言的现场编码，以及使用纯数据开发的生成算法或虚拟乐器进行表演。这些功能可以多种方式组合，也可用于远程/网络音乐合奏、交互式虚拟装置或新颖的表演概念。在本文中，我们将介绍管弦乐队工具箱的开发和范围，以及说明艺术可能性的使用案例。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Accounts of Chemical Research 化学-化学综合

CiteScore

31.40

自引率

1.10%

发文量

312

审稿时长

2 months

期刊介绍： Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance. Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.