HCI in performance arts and the case of Illimitable Space System's multimodal interaction and visualization

Abstract

The primary aim of this art paper is to present a case study of the use of modern 3D graphics and sensor technologies in interactive stage performances. Specifically, we present studies of interactive performances in which we have used the Illimitable Space System, a proof-of-concept tool box that offers configurable multimodal interaction via a variety of means. The animation and interaction are all done in real-time and can be of arbitrary duration while the system is up and running. Earlier ISS versions were exhibited in the end of 2012 and 2013 during Open House and Stewart Hall Expo-Science events, as well during the 2014 2-day Chinese New Year Gala performance during the Ascension dance at Concordia University, Montreal, Canada, and in the large Like Shadows theatre production in Beijing, China. We describe how ISS was configured and used in these events, and the valuable feedback obtained, confidence gained in interactive technology usage in performances, and lessons learned from them. All of which help us in making continuous improvements in ISS. As a result this paper includes the themes of these events, methods, theory, and history. Since technology has been used in stage performances from ancient times, we start with a brief historical background of technology in performance arts.