三维蜘蛛网的声音化和用颗粒合成的音乐合成

IF 0.4 Q4 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Isabelle Su;Zhao Qin;Tomás Saraceno;Ally Bisshop;Roland Mühlethaler;Evan Ziporyn;Markus J. Buehler
{"title":"三维蜘蛛网的声音化和用颗粒合成的音乐合成","authors":"Isabelle Su;Zhao Qin;Tomás Saraceno;Ally Bisshop;Roland Mühlethaler;Evan Ziporyn;Markus J. Buehler","doi":"10.1162/comj_a_00580","DOIUrl":null,"url":null,"abstract":"Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom–up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.","PeriodicalId":50639,"journal":{"name":"Computer Music Journal","volume":"44 4","pages":"43-59"},"PeriodicalIF":0.4000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis\",\"authors\":\"Isabelle Su;Zhao Qin;Tomás Saraceno;Ally Bisshop;Roland Mühlethaler;Evan Ziporyn;Markus J. Buehler\",\"doi\":\"10.1162/comj_a_00580\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom–up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.\",\"PeriodicalId\":50639,\"journal\":{\"name\":\"Computer Music Journal\",\"volume\":\"44 4\",\"pages\":\"43-59\"},\"PeriodicalIF\":0.4000,\"publicationDate\":\"2021-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computer Music Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/9655687/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Music Journal","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/9655687/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 6

摘要

三维蜘蛛网具有高度复杂的纤维结构,可以通过三维扫描和建模来表示。为了对三维citricola蜘蛛网的关键特征进行新颖的解释,我们使用数据超声技术将原始网络模型中的复杂三维数据转化为音乐。我们将蜘蛛网数据映射到音高、振幅和包络等音频参数。与视觉表现相结合,由此产生的音频允许独特而全面的沉浸在网络中,可以描述三维建筑的特征(光纤距离、长度、连通性和结构的整体孔隙度),作为网络空间位置的函数。使用颗粒合成,我们进一步开发了一种方法,从声音网络中提取音乐构建块,将网络数据的原始表示转换为新的音乐作品。我们构建了一种新的虚拟交互式乐器,其中使用物理三维网络数据通过探索不同的空间位置和颗粒处理参数来产生新的声音变化。声音从颗粒到音乐排列(旋律、节奏、和声、和弦等的变化)的转变类似于蛋白质的自然自下而上的加工,类似于从基本化学构建块开始的序列设计和更高层次的蛋白质材料组织。这里记录的工具为现场表演和艺术装置创造基于蜘蛛网的虚拟乐器提供了可能性,为沉浸在蜘蛛网数据中提供了新的可能性,并为探索蛋白质折叠之间的相似性提供了可能性,另一方面,组装和音乐表达。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Sonification of a 3-D Spider Web and Reconstitution for Musical Composition Using Granular Synthesis
Three-dimensional spider webs feature highly intricate fiber architectures, which can be represented via 3-D scanning and modeling. To allow novel interpretations of the key features of a 3-D Cyrtophora citricola spider web, we translate complex 3-D data from the original web model into music, using data sonification. We map the spider web data to audio parameters such as pitch, amplitude, and envelope. Paired with a visual representation, the resulting audio allows a unique and holistic immersion into the web that can describe features of the 3-D architecture (fiber distance, lengths, connectivity, and overall porosity of the structure) as a function of spatial location in the web. Using granular synthesis, we further develop a method to extract musical building blocks from the sonified web, transforming the original representation of the web data into new musical compositions. We build a new virtual, interactive musical instrument in which the physical 3-D web data are used to generate new variations in sound through exploration of different spatial locations and grain-processing parameters. The transformation of sound from grains to musical arrangements (variations of melody, rhythm, harmony, chords, etc.) is analogous to the natural bottom–up processing of proteins, resembling the design of sequence and higher-level hierarchical protein material organization from elementary chemical building blocks. The tools documented here open possibilities for creating virtual instruments based on spider webs for live performances and art installations, suggesting new possibilities for immersion into spider web data, and for exploring similarities between protein folding, on the one hand, and assembly and musical expression, on the other.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computer Music Journal
Computer Music Journal 工程技术-计算机:跨学科应用
CiteScore
1.80
自引率
0.00%
发文量
2
审稿时长
>12 weeks
期刊介绍: Computer Music Journal is published quarterly with an annual sound and video anthology containing curated music¹. For four decades, it has been the leading publication about computer music, concentrating fully on digital sound technology and all musical applications of computers. This makes it an essential resource for musicians, composers, scientists, engineers, computer enthusiasts, and anyone exploring the wonders of computer-generated sound. Edited by experts in the field and featuring an international advisory board of eminent computer musicians, issues typically include: In-depth articles on cutting-edge research and developments in technology, methods, and aesthetics of computer music Reports on products of interest, such as new audio and MIDI software and hardware Interviews with leading composers of computer music Announcements of and reports on conferences and courses in the United States and abroad Publication, event, and recording reviews Tutorials, letters, and editorials Numerous graphics, photographs, scores, algorithms, and other illustrations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信