Real-Time Rendering of Multi-View Images from a Single Image with Depth

Abstract

Image reprojection is a technique to generate novel images by projecting a reference image of an arbitrary view. Previous image reprojection methods often run on the CPU, but these approaches take high-cost for rendering. We present a real-time image reprojection method using the GPU entirely. From given a reference image and its depth image of the scene prerendered, we generate novel images at arbitrary view points without the original geometry data. We render a simple plane at a novel view, and for each pixel being rendered, we make a ray that faces the opposite direction of the view. Then, we transform the ray to reference image space and trace the ray through a depth image to find an intersection, using a recently proposed method. In our experience, we archived tens of frames per second and it was independent from the complexity of the scene.