Rhythm of music animating virtual environment models

Abstract

Alice is an innovative 3d programming environment that makes it easy to create an animation. Many virtual environment (ve) models are available in the Alice 3d environment. We created ve scenes using the Alice 3d ide (integrated development environment). We deploy a beat detector to detect the rhythm of a song, based on pd (Pure Data, a free dataflow programming environment similar to max/msp). It can extract the beat of a song in realtime. Using our Alice--Cve (Collaborative Virtual Environment) Bridge and Pd--Cve Bridge, we can create a communication link between the beat detector and Alice 3d environment. The cve is a Java client--server protocol in which clients connect to session server host via channels, and when clients need to communicate with each other they subscribe to the same channel. The Alice--Cve Bridge allows any device that can connect to the cve server to communicate with Alice without regard for architectural differences. When a song is played, its beat can be detected and data sent to animate objects and avatars. An avatar can dance (admittedly poorly) in the Alice 3d environment while receiving a realtime rhythm data stream from a cve session server. Stage color and other attributes a can also be rhythmically changed according to the beat using the same communication link.