Multiperspective modeling, rendering, and imaging

Abstract

A perspective image represents the spatial relationships of objects in a scene as they appear from a single viewpoint. In contrast, a multiperspective image combines what is seen from several viewpoints into a single image. Despite their incongruity of view, effective multiperspective images are able to preserve spatial coherence and can depict, within a single context, details of a scene that are simultaneously inaccessible from a single view, yet easily interpretable by a viewer. In computer vision, multiperspective images have been used for analyzing structure revealed via motion and generating panoramic images with a wide field-of-view using mirrors. In this STAR, we provide a practical guide on topics in multiperspective modeling and rendering methods and multiperspective imaging systems. We start with a brief review of multiperspective image techniques frequently employed by artists such as the visual paradoxes of Escher, the Cubism of Picasso and Braque, and multiperspective panoramas in cel animations. We then characterize existing multiperspective camera models, with an emphasis on their underlying geometry and image properties. We demonstrate how to use these camera models for creating specific multiperspective rendering effects. Furthermore, we show that many of these cameras satisfy the multiperspective stereo constraints and we demonstrate several multiperspective imaging systems for extracting 3D geometry for computer vision. The participants learn about topics in multiperspective modeling and rendering for generating compelling pictures for computer graphics and in multiperspective imaging for extracting 3D geometry for computer vision. We hope to provide enough fundamentals to satisfy the technical specialist without intimidating curious digital artists interested in multiperspective images. The intended audience includes digital artists, photographers, and computer graphics and computer vision researchers using or building multiperspective cameras. They will learn about multiperspective modeling and rendering, along with many real world multiperspective imaging systems.