Drawing Sound in MR Space: A Multi-User Audiovisual Experience in Mixed Reality Space

Abstract

In this study, we propose a multi-user interactive audiovisual art system using mixed reality (MR). In the MR space, participants can draw virtual lines in mid-air to create audiovisual effects. Each drawn line has a moving point object. The moving point object moves repeatedly from the starting to the ending point of a line. When the lines overlap and the points on the lines collide, an audiovisual effect is generated. The sound component of the audiovisual effect is related to the height of the real space. Participants can also move and erase the drawn line objects. Using these effects, participants can "draw sound in MR space."