Shuqiao Sun, Rongke Liu, Qiuchen Du, Shantong Sun, Shaoli Kang
{"title":"基于图像的端到端神经网络密集视差估计","authors":"Shuqiao Sun, Rongke Liu, Qiuchen Du, Shantong Sun, Shaoli Kang","doi":"10.1109/VCIP47243.2019.8965761","DOIUrl":null,"url":null,"abstract":"Stereo matching is a challenging yet important task to various computer vision applications, e.g. 3D reconstruction, augmented reality, and autonomous vehicles. In this paper, we present a novel image-based convolutional neural network (CNN) for dense disparity estimation using stereo image pairs. In order to achieve precise and robust stereo matching, we introduce a feature extraction module that learns both local and global information. These features are then passed through an hour-glass structure to generate disparity maps from lower resolution to full resolution. We test the proposed method in several datasets including indoor scenes and synthetic scenes. Experimental results demonstrate that the proposed method outperforms the state-of-the-art methods in several datasets.","PeriodicalId":388109,"journal":{"name":"2019 IEEE Visual Communications and Image Processing (VCIP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Image-Based End-to-End Neural Network for Dense Disparity Estimation\",\"authors\":\"Shuqiao Sun, Rongke Liu, Qiuchen Du, Shantong Sun, Shaoli Kang\",\"doi\":\"10.1109/VCIP47243.2019.8965761\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Stereo matching is a challenging yet important task to various computer vision applications, e.g. 3D reconstruction, augmented reality, and autonomous vehicles. In this paper, we present a novel image-based convolutional neural network (CNN) for dense disparity estimation using stereo image pairs. In order to achieve precise and robust stereo matching, we introduce a feature extraction module that learns both local and global information. These features are then passed through an hour-glass structure to generate disparity maps from lower resolution to full resolution. We test the proposed method in several datasets including indoor scenes and synthetic scenes. Experimental results demonstrate that the proposed method outperforms the state-of-the-art methods in several datasets.\",\"PeriodicalId\":388109,\"journal\":{\"name\":\"2019 IEEE Visual Communications and Image Processing (VCIP)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE Visual Communications and Image Processing (VCIP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/VCIP47243.2019.8965761\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE Visual Communications and Image Processing (VCIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/VCIP47243.2019.8965761","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Image-Based End-to-End Neural Network for Dense Disparity Estimation
Stereo matching is a challenging yet important task to various computer vision applications, e.g. 3D reconstruction, augmented reality, and autonomous vehicles. In this paper, we present a novel image-based convolutional neural network (CNN) for dense disparity estimation using stereo image pairs. In order to achieve precise and robust stereo matching, we introduce a feature extraction module that learns both local and global information. These features are then passed through an hour-glass structure to generate disparity maps from lower resolution to full resolution. We test the proposed method in several datasets including indoor scenes and synthetic scenes. Experimental results demonstrate that the proposed method outperforms the state-of-the-art methods in several datasets.