MuSense: Sensor Data Fusion-inspired Intelligent Music Improvisation Framework in 5G-Internet of Music Things

Abstract

This article focuses on the emerging music composition, reconstruction, and improvisation in the Internet of Things (IoT). In the current internet era, musical composition and reconstruction schemas are largely dependent on the IoT-based paradigm where human beings can arrange musical compositions through musical things, such as, remotely arranged singing and musical instruments, smart rhythmic behaviors, and intelligent autotuning systems. We have renamed the music composition, sharing, and recommendation phenomenon in the IoT paradigm as the Internet of Music Things (IoMT). We present a fifth-generation (5G) technology-enabled IoMT framework to explore remote music collaboration, multisensory music information fusion, and socially-desirable music composition schema due to its capability of providing ultra-low latency, prominent bandwidth, assured Quality of Services, and lively orchestrated network environment. We incorporate the system performance metrics with the proposed 5G-IoMT in terms of the data transmission latency and potential energy dissipation. We moreover illustrate a Generative Adversarial Network-inspired intelligent music improvisation strategy as a case study for audience interest.