Interactive human motion acquisition from video sequences

Human motion modeling for animation and VR has reached a level of capturing real motion data from people using various visual and non-visual sensors. However, most of the available systems require special devices and environments, or even attachments of extra things on an actor. To realize a personal system, we developed a general type software to acquire arbitrary motion from a video sequence. A 3D articulated human model with changeable size, color and surface shape is constructed and personalized to fit with a focused figure in the video. The personal model is then driven either automatically or manually to match with the moving body in consecutive image frames. This matching starts from key frames that contain key poses. A smooth motion is then interpolated in between key frames. The evaluation of the generated motion is enhanced by image correlation. We provide various methods to make the matching feasible in order to reduce the modeling time. This approach is suitable for personal use to meet wide needs of human motion acquisition.