{"title":"EmoSonics: Interactive Sound Interfaces for the Externalization of Emotions","authors":"T. Hermann, Jiajun Yang, Y. Nagai","doi":"10.1145/2986416.2986437","DOIUrl":"https://doi.org/10.1145/2986416.2986437","url":null,"abstract":"This paper presents a novel approach for using sound to externalize emotional states so that they become an object for communication and reflection both for the users themselves and for interaction with other users such as peers, parents or therapists. We present an abstract, vocal, and physiology-based sound synthesis model whose sound space each covers various emotional associations. The key idea in our approach is to use an evolutionary optimization approach to enable users to find emotional prototypes which are then in turn fed into a kernel-regression-based mapping to allow users to navigate the sound space via a low-dimensional interface, which can be controlled in a playful way via tablet interactions. The method is intended to be used for supporting people with autism spectrum disorder.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121890793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gabriel Urbain, Christian Frisson, A. Moinet, T. Dutoit
{"title":"A Semantic and Content-Based Search User Interface for Browsing Large Collections of Foley Sounds","authors":"Gabriel Urbain, Christian Frisson, A. Moinet, T. Dutoit","doi":"10.1145/2986416.2986436","DOIUrl":"https://doi.org/10.1145/2986416.2986436","url":null,"abstract":"Sound designers select the sounds they use among massive collections of recordings. They usually rely on text-based queries to narrow down a subset from these collections when looking for specific content. However, when it comes to unknown collections, this approach can fail to precisely retrieve files according to their content. We investigate an audio search engine that associates content-based features and semantic meta-data using Apache Solr deployed in a fully integrated server architecture. In order to facilitate the task of browsing the sounds, we also propose a search user interface in which the user can perform both text-based queries and visual browsing in a window where sounds are organized according to their audio features. A preliminary evaluation of the performances helped to optimize the parameters of the system.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121123456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Melokey: Create Melody with Keys","authors":"Nathan Guo","doi":"10.1145/2986416.2986417","DOIUrl":"https://doi.org/10.1145/2986416.2986417","url":null,"abstract":"This paper demonstrates a tangible musical device named Melokey which captures the profile of the key as well as its gesture and then synthesizes diverse sounds. The device also encourages multiple people to play together formulating a musical ensemble. The paper also illustrates the design and function of the device and how it enriches musical expression by the principle and paradigm of user experience design and tangible interaction. Additionally, the concept and motivation in both artistic and cultural contexts will be discussed. Furthermore, the future potential improvement and application will also be stated. The demo video can be found at https://goo.gl/oSgtaW.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116542559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multimodal interactions, virtual reality and 360 movies: applications using Wavefield synthesis","authors":"F. Grani, R. Nordahl, S. Serafin","doi":"10.1145/2986416.2986430","DOIUrl":"https://doi.org/10.1145/2986416.2986430","url":null,"abstract":"We present a report covering our preliminary research on the use of wavefield synthesis WFS in a multimodal context. Traditionally, WFS has been used as a way to faithfully reproduce auditory experiences. To our knowledge, little research has tried to understand how to gesturally control WFS. Moreover, there are no applications combining WFS and virtual reality video productions. In this paper, we are interested in exploring the applications of WFS in the context of gestural control and 360 video production. We present three projects performed by students at Aalborg University Copenhagen that explore these directions.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"85 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132367317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the Audio Mostly 2016","authors":"Johan Fagerlönn","doi":"10.1145/2986416","DOIUrl":"https://doi.org/10.1145/2986416","url":null,"abstract":"","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122169361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Design in Ecology of Other Artefacts","authors":"Rikard Lindell","doi":"10.1145/2986416.2986439","DOIUrl":"https://doi.org/10.1145/2986416.2986439","url":null,"abstract":"Music software has traditionally been developed in ecosystems of technology that artists combine to create their tools for compositions. The ability to connect artefacts has developed thought the evolution of music technology. Today, the mobile platform has become an increasingly important ecosystem for music applications, combining traditional technology with the platform specific infrastructure. To make an artefact's design valid in the ecosystem, designers and developers need to support this infrastructure. This paper present the design process of c3n loops, an iOS music app based on zoomable user interface in contrast with the platform's design idioms. The c3n loops design relies on its own design idioms while balancing the support for platform specific technologies such as AudioBus/Inter-app Audio, Ableton Link beat synchronisation, and MIDI.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116218997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
E. Berdahl, Matthew Blessing, S. D. Beck, Michael Blandino
{"title":"More Masses For The Masses","authors":"E. Berdahl, Matthew Blessing, S. D. Beck, Michael Blandino","doi":"10.1145/2986416.2986452","DOIUrl":"https://doi.org/10.1145/2986416.2986452","url":null,"abstract":"Physics-based modeling using floating-point computations can enable nuanced control of sound for applications in music. Historically, either powerful computers or custom hardware have been required to obtain high-fidelity sound, particularly as a large number of virtual masses or \"virtual resonators\" are for example needed to obtain complex timbres. However, over the past few years, low-cost (e.g. USD $35) embedded computers have become increasingly powerful and able to simulate a more impressive number of virtual masses or virtual resonators in real time. Benchmarks are conducted to compare how many virtual masses, virtual strings, or virtual resonators can be simulated in real time on the Raspberry Pi 1 and 2 embedded computers. It was observed that the Raspberry Pi 2 could provide for real-time audio bandwidths as large as 14 kHz (virtual masses) or 11 kHz (virtual resonators) for harmonic tones with f0 as low as 80 Hz, using only a single computational core. This will enable the creation of a whole new class of instruments called embedded acoustic instruments, which can be programmed using physics-based modeling techniques.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130944701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Grime Scene: Social Media, Music, Creation and Consumption","authors":"S. McGrath, A. Chamberlain, S. Benford","doi":"10.1145/2986416.2986433","DOIUrl":"https://doi.org/10.1145/2986416.2986433","url":null,"abstract":"In this paper we start to explore and unpack the work of Grime music producers and performers with a focus on their attitudes, working practices and use of social media. We explore the origins of grime and describe a complex set of interactions between people and technology in order to facilitate the production and dissemination of audio content in an evolving digital climate. We explore how individuals in this space curate and collect content, with a view to reuse in the future. We also explore how grime is evolving and ways in which technology might be able to facilitate many of these processes more effectively. Finally, we explore technological issues that pertain to music production and dissemination in its current state and implications for design for future applications and contexts.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124116135","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Post-DMI musical Instruments","authors":"Amelie Hinrichsen, Till Bovermann","doi":"10.1145/2986416.2986440","DOIUrl":"https://doi.org/10.1145/2986416.2986440","url":null,"abstract":"What are the particularities of developing contemporary instruments? This text points out how the authors observed both a focal shift and persisting elements in the design of contemporary digital musical instruments (DMI's). Based on observations around selected instrument prototypes that were developed by students as well as the authors, four constituent aspects of the development process of hybrid instruments emerged: corporeality --- the role of the body, materiality --- the role of material, sound --- the instrument's sonic appearance, and control --- its behaviour.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114382166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Johan Fagerlönn, Stefan Lindberg, Anna Sirkka, Gunnar Oledal
{"title":"OREGANO: Play a concert organ using your voice","authors":"Johan Fagerlönn, Stefan Lindberg, Anna Sirkka, Gunnar Oledal","doi":"10.1145/2986416.2986454","DOIUrl":"https://doi.org/10.1145/2986416.2986454","url":null,"abstract":"This paper describes the first version of Oregano, a system that allows people to interact with a large concert organ using their voices and a touch display. The main objective of the design was to increase the organ's accessibility for the general public and enhance their experience when visiting the Studio Acusticum concert hall in Piteå, Sweden. A number of built-in prerecorded songs allow visitors and concert-hall personnel to easily experience and demonstrate the instrument's capabilities. In addition, the voice interaction facilitates new types of fun interaction and musical expressions using the instrument. The concept will be set up in a permanent installation inside the concert hall during upcoming work.","PeriodicalId":128508,"journal":{"name":"Proceedings of the Audio Mostly 2016","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123620436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}