Children’s sensory interaction music enlightenment system based on sensory interaction and game elements

Abstract

Recently, a widely developed technology in the field of tactile interactive human–computer interaction has been widely applied in various fields. However, there is currently a lack of application of somatosensory interaction technology in children’s music enlightenment products. To broaden the research scope of the field of sensory interaction products, this study first analyzes music enlightenment games based on game elements to obtain the needs of children in music education; Secondly, this study utilizes fuzzy judgment matrices and purpose chains to conduct research based on user psychology, in order to capture the product’s focus during the design process. Finally, the research designs Gesture recognition algorithm and children’s somatosensory interaction music enlightenment system on the basis of somatosensory interaction. The research results indicate that the age range of users is between 28 and 45 years old, and 88 % of respondents have no or limited experience in early music education for children. When the Gesture recognition algorithm iterates to about 4000 times, it can reach the convergence state, and the loss value fluctuates around 0.1. In addition, the running time of Gesture recognition algorithm in simple background and complex background is 0.089 s and 0.083 s respectively. And the average accuracy of this algorithm is 98.81 %, with an average recall rate of 93.38 %. Finally, the vast majority of participants expressed their willingness to continue using the children’s sensory interaction music enlightenment system in view of sensory interaction and game elements, with a higher proportion of medium to low difficulty participants willing to continue. In summary, the children’s somatosensory interactive music enlightenment system proposed in the study has better performance and is widely used by users.