GPU-based real-time spatio-temporal reconstruction studio

Abstract

A GPU-based spatio-temporal reconstruction studio has recently been built at the Computer and Automation Research Institute of the Hungarian Academy of Sciences (MTA SZTAKI). The studio has 13 synchronised, calibrated high-resolution video cameras used to create dynamic 3D models of moving actors providing free-viewpoint video in real-time. We give a brief overview of advanced studios operating around the world, then present the main hardware and software components of our studio. For real-time operation, the image processing and reconstruction algorithms of the studio have been efficiently implemented on a graphics processing unit. We discuss the GPU implementation details of the complete reconstruction pipeline.