Playing with InMuSIC: An Interactive Multimodal System for Improvised Composition

Abstract

InMuSIC is a real-time interactive musical system conceived to be used in a context related to the practice of electroacoustic free improvisation. By integrating the observation of both non-verbal expressive behavior cues (motion tracking) and several sonic parameters (audio stream analysis) the system is able to identify, during the performance, relevant expressive musical properties. The real-time measurements control different digital sound processes through the correlation of different mapping strategies. The generated audio interventions should then be perceived as a consolidated sonic integration of the improvised performance. The research is based on the belief that human behaviors and their ambiguity must be taken into consideration in order to design and shape meaningful and sustainable technologies.