Image-Based End-to-End Neural Network for Dense Disparity Estimation

Abstract

Stereo matching is a challenging yet important task to various computer vision applications, e.g. 3D reconstruction, augmented reality, and autonomous vehicles. In this paper, we present a novel image-based convolutional neural network (CNN) for dense disparity estimation using stereo image pairs. In order to achieve precise and robust stereo matching, we introduce a feature extraction module that learns both local and global information. These features are then passed through an hour-glass structure to generate disparity maps from lower resolution to full resolution. We test the proposed method in several datasets including indoor scenes and synthetic scenes. Experimental results demonstrate that the proposed method outperforms the state-of-the-art methods in several datasets.