Towards multimedia orchestra: a proposal for an interactive multimedia art creation system

Abstract

We propose a novel multimedia orchestra system named MusiKalScope-2. From our past experiences with multimedia art creation systems, we are aware of two issues: cognitive overload due to the simultaneous creation of music and graphics by a single performer, and finding a way to provide expert knowledge to a system. To address these issues, we propose two approaches: (1) use attribute based role allotment; and (2) the direct use of expert knowledge. We describe the construction of MusiKalScope-2 and illustrate the realization of the proposed methods.