Floating Music Score: System Design

This paper aims to describe an approach to create a useful and effective solution to facilitate the reading of musical scores during the performance or study of pieces, using the aid of Mixed Reality (MR), mobile devices, digital scores, and Data Musical Instrument Digital Interface (MIDI). MR can be defined as a system that combines physical objects with virtual objects. MIDI is a digital file containing musical notation information that can be interpreted by electronic devices. In this project, we aim to use HoloLens glasses and mobile devices, such as tablets or smartphones. The HoloLens are devices that can be used to create realistic holograms to visually represent the scores. The use of the various devices is intended to make the performance easier. The proposed approach aims to interpret scores in MIDI format and present them in hologram format to the MR glasses and graphical format to the mobile devices. In parallel, the system should be able to synchronize the presentation between different devices.