3D image display with motion parallax by camera matrix stereo

Abstract

We propose a 3D image display system which can present real scenes with realistic motion parallax. In the sensing system, a scene is observed by using a camera matrix. An excellent stereo algorithm SEA which utilizes 3/spl times/3 image matrix recovers the depth information of the scene with the density and the sharpness required for high quality image generation. In the display system, following the viewing position of the observer, 2D images with proper notion parallax are generated and presented. A novel algorithm to determine the view parameters suitable for reproducing the motion parallax on a fixed screen and an image generation algorithm which can cope with arbitrary viewing positions are described. A prototype system has been developed to demonstrate the feasibility of the proposed algorithms.