New Interfaces for Musical Expression最新文献

筛选
英文 中文
Border: A Live Performance Based on Web AR and a Gesture-Controlled Virtual Instrument 边界:基于Web AR和手势控制虚拟仪器的现场表演
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672860
Kiyu Nishida, Akishige Yuguchi, Kazuhiro Jo, P. Modler, M. Noisternig
{"title":"Border: A Live Performance Based on Web AR and a Gesture-Controlled Virtual Instrument","authors":"Kiyu Nishida, Akishige Yuguchi, Kazuhiro Jo, P. Modler, M. Noisternig","doi":"10.5281/zenodo.3672860","DOIUrl":"https://doi.org/10.5281/zenodo.3672860","url":null,"abstract":"Recent technological advances, such as increased CPU/GPU processing speed, along with the miniaturization of devices and sensors, have created new possibilities for integrating immersive technologies in music and performance art. Virtual and Augmented Reality (VR/AR) have become increasingly interesting as mobile device platforms, such as up-to-date smartphones, with necessary CPU resources entered the consumer market. In combination with recent web technologies, any mobile device can simply connect with a browser to a local server to access the latest technology. The web platform also eases the integration of collabora-tive situated media in participatory artwork. In this paper , we present the interactive music improvisation piece 'Border,' premiered in 2018 at the Beyond Festival at the Center for Art and Media Karlsruhe (ZKM). This piece explores the interaction between a performer and the audience using web-based applications-including AR, real-time 3D audio/video streaming, advanced web audio, and gesture-controlled virtual instruments-on smart mobile devices.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128763033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Sound Control: Supporting Custom Musical Interface Design for Children with Disabilities 声音控制:支持自定义音乐界面设计为残疾儿童
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672920
Samuel Thompson Parke-Wolfe, Hugo Scurto, R. Fiebrink
{"title":"Sound Control: Supporting Custom Musical Interface Design for Children with Disabilities","authors":"Samuel Thompson Parke-Wolfe, Hugo Scurto, R. Fiebrink","doi":"10.5281/zenodo.3672920","DOIUrl":"https://doi.org/10.5281/zenodo.3672920","url":null,"abstract":"We have built a new software toolkit that enables mu- sic therapists and teachers to create custom digital musical interfaces for children with diverse disabilities. It was designed in collaboration with music therapists, teachers, and children. It uses interactive ma- chine learning to create new sensor- and vision-based musical interfaces using demonstrations of actions and sound, making interface building fast and accessible to people without programming or engineering expertise. Interviews with two music therapy and education professionals who have used the software extensively illustrate how richly customised, sensor-based inter- faces can be used in music therapy contexts; they also reveal how properties of input devices, music-making approaches, and mapping techniques can support a variety of interaction styles and therapy goals.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116268840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Fictional instruments, real values: discovering musical backgrounds with non-functional prototypes 虚构的乐器,真实的价值:用非功能原型发现音乐背景
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672890
G. Lepri, Andrew Mcpherson
{"title":"Fictional instruments, real values: discovering musical backgrounds with non-functional prototypes","authors":"G. Lepri, Andrew Mcpherson","doi":"10.5281/zenodo.3672890","DOIUrl":"https://doi.org/10.5281/zenodo.3672890","url":null,"abstract":"The emergence of a new technology can be considered as the result of social, cultural and technical process. Instrument designs are particularly influenced by cultural and aesthetic values linked to the specific contexts and communities that produced them. In previous work, we ran a design fiction workshop in which musicians created non-functional instrument mockups. In the current paper, we report on an online survey in which music technologists were asked to speculate on the background of the musicians who designed particular instruments. Our results showed several cues for the interpretation of the artefacts’ origins, including physical features, body-instrument interactions, use of language and references to established music practices and tools. Tacit musical and cultural values were also identified based on intuitive and holistic judgments. Our discussion highlights the importance of cultural awareness and context-dependent values on the design and use of interactive musical systems.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"24 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132640017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
The Symbaline - An Active Wine Glass Instrument with a Liquid Sloshing Vibrato Mechanism 象征-一种带有液体晃动振动机制的主动酒杯仪器
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672848
Lior Arbel, Y. Schechner, N. Amir
{"title":"The Symbaline - An Active Wine Glass Instrument with a Liquid Sloshing Vibrato Mechanism","authors":"Lior Arbel, Y. Schechner, N. Amir","doi":"10.5281/zenodo.3672848","DOIUrl":"https://doi.org/10.5281/zenodo.3672848","url":null,"abstract":"The Symbaline is an active instrument comprised of several partly-filled wine glasses excited by electromagnetic coils. This work describes an electromechanical system for incorporating frequency and amplitude modulation into the Symbaline’s sound. A pendulum having a magnetic bob is suspended inside the liquid in the wine glass. The pendulum is put into oscillation by driving infra-sound signals through the coil. The pendulum’s movement causes the liquid in the glass to slosh back and forth. Simultaneously, wine glass sounds are produced by driving audio-range signals through the coil, inducing vibrations in a small magnet attached to the glass’s surface and exciting glass vibrations. As the glass vibrates, the sloshing liquid periodically changes the glass’s resonance frequencies and dampens the glass, thus modulating both wine glass pitch and sound intensity.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"172 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122926206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Magpick: an Augmented Guitar Pick for Nuanced Control Magpick:一个增强吉他拨片细致入微的控制
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672868
Fabio Morreale, A. Guidi, Andrew Mcpherson
{"title":"Magpick: an Augmented Guitar Pick for Nuanced Control","authors":"Fabio Morreale, A. Guidi, Andrew Mcpherson","doi":"10.5281/zenodo.3672868","DOIUrl":"https://doi.org/10.5281/zenodo.3672868","url":null,"abstract":"This paper introduces the Magpick, an augmented pick for electric guitar that uses electromagnetic induction to sense the motion of the pick with respect to the permanent magnets in the guitar pickup. The Magpick provides the guitarist with nuanced control of the sound that coexists with traditional plucking-hand technique. The paper presents three ways that the signal from the pick can modulate the guitar sound, followed by a case study of its use in which 11 guitarists tested the Magpick for five days and composed a piece with it. Reflecting on their comments and experiences, we outline the innovative features of this technology from the point of view of performance practice. In particular, compared to other augmentations, the high temporal resolution, low latency, and large dynamic range of the Magpick support a highly nuanced control over the sound. Our discussion highlights the utility of having the locus of augmentation coincide with the locus of interaction.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115233630","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Material embodiments of electroacoustic music: an experimental workshop study 电声音乐的物质体现:一项实验车间研究
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672842
Enrique Tomás, T. Gorbach, H. Tellioglu, Martin Kaltenbrunner
{"title":"Material embodiments of electroacoustic music: an experimental workshop study","authors":"Enrique Tomás, T. Gorbach, H. Tellioglu, Martin Kaltenbrunner","doi":"10.5281/zenodo.3672842","DOIUrl":"https://doi.org/10.5281/zenodo.3672842","url":null,"abstract":"This paper reports on a workshop where participants produced physical mock-ups of musical interfaces directly after miming control of short electroacoustic music pieces. Our goal was understanding how people envision and materialize their own sound-producing gestures from spontaneous cognitive mappings. During the workshop, 50 participants from different creative backgrounds modeled more than 180 physical artifacts. Participants were filmed and interviewed for the later analysis of their different multimodal associations about music. Our initial hypothesis was that most of the physical mockups would be similar to the sound-producing objects that participants would identify in the musical pieces. Although the majority of artifacts clearly showed correlated design trajectories, our results indicate that a relevant number of participants intuitively decided to engineer alternative solutions emphasizing their personal design preferences. Therefore, in this paper we present and discuss the workshop format, its results, and the possible applications for designing new musical interfaces.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124302654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
'Blending Dimensions' when Composing for DMI and Symphonic Orchestra 为DMI和交响乐团作曲时的“混合维度”
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672922
Oliver Hödl
{"title":"'Blending Dimensions' when Composing for DMI and Symphonic Orchestra","authors":"Oliver Hödl","doi":"10.5281/zenodo.3672922","DOIUrl":"https://doi.org/10.5281/zenodo.3672922","url":null,"abstract":"With a new digital music instrument (DMI), the interface itself, the sound generation, the composition, and the performance are often closely related and even intrinsically linked with each other. Similarly, the instrument designer, composer, and performer are often the same person. The Academic Festival Overture is a new piece of music for the DMI Trombosonic and symphonic orchestra written by a composer who had no prior experience with the instrument. The piece underwent the phases of a composition competition, rehearsals, a music video production, and a public live performance. This whole process was evaluated reflecting on the experience of three involved key stakeholder: the composer, the conductor, and the instrument designer as performer. ‘Blending dimensions’ of these stakeholder and decoupling the composition from the instrument designer inspired the newly involved composer to completely rethink the DMI’s interaction and sound concept. Thus, to deliberately avoid an early collaboration between a DMI designer and a composer bears the potential for new inspiration and at the same time the challenge to seek such a collaboration in the need of clarifying possible misunderstandings and improvement.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121309168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Exploring the Container Metaphor for Equalisation Manipulation 探索均衡操作的容器隐喻
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672892
Christopher Dewey, J. Wakefield
{"title":"Exploring the Container Metaphor for Equalisation Manipulation","authors":"Christopher Dewey, J. Wakefield","doi":"10.5281/zenodo.3672892","DOIUrl":"https://doi.org/10.5281/zenodo.3672892","url":null,"abstract":"This paper presents the first stage in the design and evaluation of a novel container metaphor interface for equalisation control. The prototype system harnesses the Pepper’s Ghost illusion to project midair a holographic data visualisation of an audio track’s long-term average and real-time frequency content as a deformable shape manipulated directly via hand gestures. The system uses HTML 5, JavaScript and the Web Audio API in conjunction with a Leap Motion controller and bespoke low budget projection system. During subjective evaluation users commented that the novel system was simpler and more intuitive to use than commercially established equalisation interface paradigms and most suited to creative, expressive and explorative equalisation tasks.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"110 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115697833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Introducing Locus: a NIME for Immersive Exocentric Aural Environments 介绍Locus:沉浸式外心听觉环境的名称
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672946
Disha Sardana, Woohun Joo, I. Bukvic, G. Earle
{"title":"Introducing Locus: a NIME for Immersive Exocentric Aural Environments","authors":"Disha Sardana, Woohun Joo, I. Bukvic, G. Earle","doi":"10.5281/zenodo.3672946","DOIUrl":"https://doi.org/10.5281/zenodo.3672946","url":null,"abstract":"Locus is a NIME designed specifically for an interactive, immersive high density loudspeaker array environment. The system is based on a pointing mechanism to interact with a sound scene comprising 128 speakers. Users can point anywhere to interact with the system, and the spatial interaction utilizes motion capture, so it does not require a screen. Instead it is completely controlled via hand gestures using a glove that is populated with motion-tracking","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132002875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
SIBILIM: A low-cost customizable wireless musical interface SIBILIM:一个低成本的可定制无线音乐接口
New Interfaces for Musical Expression Pub Date : 2019-06-01 DOI: 10.5281/zenodo.3672850
H. Nunes, F. Visi, Lydia Helena Wohl Coelho, Rodrigo Schramm
{"title":"SIBILIM: A low-cost customizable wireless musical interface","authors":"H. Nunes, F. Visi, Lydia Helena Wohl Coelho, Rodrigo Schramm","doi":"10.5281/zenodo.3672850","DOIUrl":"https://doi.org/10.5281/zenodo.3672850","url":null,"abstract":"This paper presents the Sibilim, a low-cost musical interface composed of a resonance box made of cardboard containing customised push buttons that interact with a smartphone through its video camera. Each button can be mapped to a set of MIDI notes or control parameters. The sound is generated through synthesis or sample playback and can be amplified with the help of a transducer, which excites the resonance box. An essential contribution of this interface is the possibility of reconfiguration of the buttons layout without the need to hard rewire the system since it uses only the smartphone built-in camera. This features allow for quick instrument customisation for different use cases, such as low cost projects for schools or instrument building workshops. Our case study used the Sibilim for music education, where it was designed to develop the conscious of music perception and to stimulate creativity through exercises of short tonal musical compositions. We conducted a study with a group of twelve participants in an experimental workshop to verify its validity.","PeriodicalId":161317,"journal":{"name":"New Interfaces for Musical Expression","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131272591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信