Robust background removal in 4D Studio images

Abstract

In this paper we discuss background removal techniques developed for the 4D Reconstruction Studio at MTA SZTAKI. The 4D Studio enables creation of dynamic 3D models of real objects and actors. Robust foreground segmentation is a key element for 4D reconstruction, since the visual quality of the 3D model highly depends on the precision of the extracted silhouette. We present our novel solution for background removal based on exploiting the background colour in a robust manner. We also perform an analysis of shadow detection methods using different colour spaces, with the motivation of determining which colour representation is more suitable for shadow detection in a 4D Studio.