Markerless human body motion capture using multiple cameras

Abstract

In this paper, we present an approach for markerless model-based full human-body motion capture using multi-view images as input. We extract volume data (voxels) representation from the silhouettes extracted from multiple-view video images by the method of shape from Silhouettes (SFS), and match our predefined human body model to the volume data. We construct an energy field in the volume of interest based on the volume data and human body model with pose parameters, and transform the matching to an energy minimizing problem. By dynamic graph cut, we get the minimum energy of certain pose parameters, and at last we optimize the pose parameters using Powell algorithm with a novel approach that uses the linear prediction guiding the optimization process and get the pose recovered. Through the test results on several video sequences of human body movements in an unaugmented office environment, we demonstrate the effectiveness and robustness of our approach.