Image- and Video-Based Rendering

The purpose of imageand video-based rendering (IVBR) is to be able to synthesize photo-realistic new, virtual views of real-world scenes and events from no more than a set of conventional photographs or videos of the scene. Purely image-based, or plenoptic, approaches densely sample scene appearance using a large number of images, Sections 17.2 and 5.3. New views are generated by simply re-sampling the captured image data. In contrast, geometry-assisted methods require much less input images. Here, 3D scene geometry is either a-priori known, reconstructed from the captured imagery, or acquired separately by some other means, e.g., ranging imaging, Chapter 4. With (approximate) scene geometry available, views