Entertainment gesture robot based on wireless sensor network for singing learning perception and interactive experience simulation

This article proposes a gesture robot music interaction system based on wireless sensor networks, aiming to achieve a user experience of music perception interaction with robots through gestures. The system adopts sensing technology, obtains user gesture information through sensors, converts it into instructions, and controls the actions of gesture robots. The study elucidated the framework of a music interaction system and designed an overall music interaction system framework. Users interact with the system through gestures, and the system obtains user gesture information through sensors and converts it into corresponding robot action instructions. In this way, users can control the robot’s actions through gestures and achieve music perception interaction with the robot. The optical flow algorithm can infer the motion trajectory and velocity changes of gestures by analyzing the displacement information of pixels between consecutive frames, capture the dynamic characteristics of user gestures, and achieve more precise control and response to robot actions, enhancing the music interaction experience between users and robots. Based on the experimental results, we found that the system can accurately recognize the user’s gesture input and quickly convert it into corresponding music interaction instructions. The response time of the system is also within an acceptable range, which can meet the real-time feedback needs of users. These experimental results demonstrate the effectiveness and feasibility of the system.