Creating Virtual 3D See-Through Experiences on Large-size 2D Displays

This paper describes a novel approach for creating virtual 3D see-through experiences on large-size 2D displays. The approach aims at simulating the real-life experience of observing an outside world through one or multiple windows. Here, the display screen serves as a virtual window such that viewers moving in front of the display can observe different part of the scene which is also moving in the opposite direction. In order to generate this see-through experience, a virtual 3D scene is first created and placed behind the display. Then, the viewers' 3D positions and motion are tracked by a 3D viewer tracking method based on multiple infra-red cameras. The virtual scene is rendered by 3D graphics engines in real-time speed, based on the tracked viewer positions. A prototype system has been implemented on a large-size tiled display and was able to bring viewers a realistic and natural 3D see-through experience.