A photo-realistic driving simulation system for mixed-reality traffic experiment space

In this paper, we propose an efficient and effective image generation system for "mixed reality traffic experiment space", an enhanced driving/traffic simulation system, which we have been developing for sustainable ITS project at the University of Tokyo. Conventional driving simulators represent their view by a set of polygon-based objects, which leads to less photo-reality and huge human costs for dataset construction. We introduce our image/geometry-based hybrid method to realize more photo-realistic view with less human cost at the same time. Images for datasets are captured from real world by multiple video cameras mounted on a data acquisition vehicle. The view for the system is created by synthesizing the image dataset. We mainly describe details on data acquisition and view rendering.