Beyond the Screen

Abstract

While working on the theme park ride project, we were required to solve problems of making a projection screen as a window that shows the virtual world behind it. To create this magical effect, we developed our own image resampling pipeline called ”BeyondScreen”. For each screen, it generates a video clip that makes the audience in the ride feel like they are seeing the virtual space. It produces a sense of depth by showing hidden areas beyond the screen as the viewpoint moves. After ensuring that the algorithm works well, we developed custom plug-ins for Nuke, RenderMan, and Houdini so that it can be easily used in the existing VFX pipeline.