Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences最新文献_第2页

Mixed Reality MIDI Keyboard Demonstration 混合现实MIDI键盘演示

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123560

John Desnoyers-Stewart, Megan L. Smith, David Gerhard

引用次数: 0

More Cowbell: Measuring Beat Consistency With Respect To Tempo And Metronome Variations 更多的牛铃:测量节奏和节拍器变化的节拍一致性

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123558

Steffan Owens, Stuart Cunningham

{"title":"More Cowbell: Measuring Beat Consistency With Respect To Tempo And Metronome Variations","authors":"Steffan Owens, Stuart Cunningham","doi":"10.1145/3123514.3123558","DOIUrl":"https://doi.org/10.1145/3123514.3123558","url":null,"abstract":"This paper investigates the relationship between a participants' ability to maintain consistent distance between taps or strikes (Inter-Onset Interval, or IOI), when provided with varying metronome conditions and tempos. This ability, alongside traditional isochronous sequence production, represents two qualities that can be measured to express a musicians' capacity to keep time accurately. The experiments asked participants to play along with a metronome. The timings of these taps were recorded and analysed to observe consistency and establish any effect metronome and tempo have. The results of the experiments suggest that when the metronome is continuous, its type (Cross-Rhythmic or Mono-Rhythmic) has no significant effect on IOI. This is also true of tempo. When the metronome is removed for a number of beats, however, the results suggest this does have a significant effect on IOI consistency, and that this also has a significant relationship to tempo. The results of this study suggest that a participants' ability to maintain a consistent IOI may not be influenced as strongly by metronomic audio information as their ability to reproduce an isochronous sequence in-phase with a metronome. This suggests that consistent IOIs and traditional, in-phase timekeeping are not as closely linked as could be expected.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124170435","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Augmenting Drama: A Speech Emotion - Controlled Stage Lighting Framework 增强戏剧:一种言语情感控制的舞台灯光框架

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123557

N. Vryzas, A. Liatsou, Rigas Kotsakis, Charalampos A. Dimoulas, George M. Kalliris

{"title":"Augmenting Drama: A Speech Emotion - Controlled Stage Lighting Framework","authors":"N. Vryzas, A. Liatsou, Rigas Kotsakis, Charalampos A. Dimoulas, George M. Kalliris","doi":"10.1145/3123514.3123557","DOIUrl":"https://doi.org/10.1145/3123514.3123557","url":null,"abstract":"Lighting can play a key role in the aesthetic concept of a theatrical production. This paper explores the field of augmented interaction with stage lighting, providing a synesthetic approach to emotion perception. In the audio driven framework that is presented, the actors' speech is captured by stage microphones. The signals are led to a Speech Emotion Recognition system that classifies them by emotion, which are thereafter matched to different colors. Thus, stage lighting color can change in real-time in accordance with the actor's recognized speech emotion. The system is described in a generic form, suitable for different implementations of the main idea. For the purpose of this paper, 5 classes that represent different emotions were defined. Several audio features and classifiers were tested with audio data from different datasets of emotional speech to train a speech emotion recognition model. The final evaluation results are presented for the logistic regression classifier. Accuracy results and confusion matrix are presented for logistic regression classification. A wheel of emotions model for emotion visualization and color selection was adopted to render and simulate the colored lighting results.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130524992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Examples of use cases with Smart Instruments 智能仪器的用例示例

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123553

L. Turchet, Michele Benincaso, C. Fischione

引用次数: 37

Designing a Multimodal Warning Display for an Industrial Control Room 工业控制室多模态报警显示器设计

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123516

Johan Fagerlönn, Kristin Hammarberg, Stefan Lindberg, Anna Sirkka, Sofia Larsson

引用次数: 2

Mapping Media and Meaning: Autoethnography as an Approach to Designing Personal Heritage Soundscapes 映射媒介与意义:自我民族志作为设计个人遗产声景的途径

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123536

A. Chamberlain, Mads Bødker, Konstantinos Papangelis

{"title":"Mapping Media and Meaning: Autoethnography as an Approach to Designing Personal Heritage Soundscapes","authors":"A. Chamberlain, Mads Bødker, Konstantinos Papangelis","doi":"10.1145/3123514.3123536","DOIUrl":"https://doi.org/10.1145/3123514.3123536","url":null,"abstract":"The paper presents reflections on understanding the issues of designing of locative sonic memory-scapes. As physical space and digital media become ever more intertwined, together forming and augmenting meaning and experience, we need methods to further explore possible ways in which physical places and intangible personal content can be used to develop meaningful experiences. The paper explores the use of autoethnography as a method for soundscape design in the fields of personal heritage and locative media. Specifically, we explore possible connections between digital media, space and 'meaning making', suggesting how autoethnographies might help discover design opportunities for merging digital media and places. These are methods that are more personally relevant than those typically associated with a more system-based design approaches that we often find are less sensitive to the way that emotion, relationships, memory and meaning come together. As a way to expand upon these relationships we also reflect on relations between personal and community-based responses.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"438 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116169634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 18

Sound recycling from public databases: Another BigData approach to sound collections 从公共数据库中回收声音:另一种BigData收集声音的方法

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123550

Hernán Ordiales, Matías Lennie Bruno

{"title":"Sound recycling from public databases: Another BigData approach to sound collections","authors":"Hernán Ordiales, Matías Lennie Bruno","doi":"10.1145/3123514.3123550","DOIUrl":"https://doi.org/10.1145/3123514.3123550","url":null,"abstract":"Discovering new sounds from large databases or Internet is a tedious task. Standard search tools and manual exploration fails to manage the actual amount of information available. This paper presents a new approach to the problem which takes advantage of grown technologies like Big Data and Machine Learning, keeping in mind compositional concepts and focusing on artistic performances. Among several different distributed systems useful for music experimentation, a new workflow is proposed based on analysis techniques from Music Information Retrieval (MIR) combined with massive online databases, dynamic user interfaces, physical controllers and real-time synthesis. Based on Free Software tools and standard communication protocols to classify, cluster and segment sound. The control architecture allows multiple clients request the API services concurrently enabling collaborative work. The resulting system can retrieve well defined or pseudo-aleatory audio samples from the web, mix and transform them in real-time during a live-coding performance, play like another instrument in a band, as a solo artist combined with visual feedback or working alone as automated multimedia installation.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"772 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129564687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences 第十二届国际音频会议论文集:增强和参与式声音和音乐体验

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514

György Fazekas, M. Barthet, T. Stockman

引用次数: 2

Simulating Auditory Hallucinations in a Video Game: Three Prototype Mechanisms 在电子游戏中模拟幻听:三种原型机制

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123532

Jonathan Weinel, Stuart Cunningham

{"title":"Simulating Auditory Hallucinations in a Video Game: Three Prototype Mechanisms","authors":"Jonathan Weinel, Stuart Cunningham","doi":"10.1145/3123514.3123532","DOIUrl":"https://doi.org/10.1145/3123514.3123532","url":null,"abstract":"In previous work the authors have proposed the concept of 'ASC Simulation1: including audio-visual installations and experiences, as well as interactive video game systems, which simulate altered states of consciousness (ASCs) such as dreams and hallucinations. Building on the discussion of the authors' previous paper, where a large-scale qualitative study explored the changes to auditory perception that users of various intoxicating substances report, here the authors present three prototype audio mechanisms for simulating hallucinations in a video game. These were designed in the Unity video game engine as an early proof-of-concept. The first mechanism simulates 'selective auditory attention' to different sound sources, by attenuating the amplitude of unattended sources. The second simulates 'enhanced sounds', by adjusting perceived brightness through filtering. The third simulates 'spatial disruptions' to perception, by dislocating sound sources from their virtual acoustic origin in 3D-space, causing them to move in oscillations around a central location. In terms of programming structure, these mechanisms are designed using scripts that are attached to the collection of assets that make up the player character, and in future developments of this type of work we foresee a more advanced, standardised interface that models the senses, emotions and state of consciousness of player avatars.","PeriodicalId":282371,"journal":{"name":"Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131204292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

Structured interaction in the SoundThimble real-time gesture sonification framework SoundThimble实时手势声音框架中的结构化交互

Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences Pub Date : 2017-08-23 DOI: 10.1145/3123514.3123543

Grigore Burloiu, Stefan Damian, Bogdan Golumbeanu, Valentin Mihai

引用次数: 2