{"title":"从粗到细:一种基于左右一致性的单目深度估计模型","authors":"Zeyu Lei, Yan Wang, Yufan Xu, Rui Huang","doi":"10.1109/ICCT46805.2019.8947220","DOIUrl":null,"url":null,"abstract":"Predicting depth from an image is an essential problem in the area of computer vision and deep learning shows a great potential in this area. However most deep Convolutional Neural Networks are need to train them using vast amount of manually labelled data, which is difficult or even scarcely possible in some special environment. In this paper, we proposed an unsupervised method based on left-right consistence with multi-loss fusion, which can perform single image depth estimation, despite the absence of ground truth data. We treat the issue as an image reconstruction problem by training our network with a combine of SSIM and Huber loss. To achieve estimation the depth from coarse to fine, we estimate a coarse map in the former layer and using bilinear sample to transmit the map to the latter layer to obtain a fine depth map. Our method achieves more accurate result on KITTI driving dataset.","PeriodicalId":306112,"journal":{"name":"2019 IEEE 19th International Conference on Communication Technology (ICCT)","volume":"116 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"From Coarse to Fine: A Monocular Depth Estimation Model Based on Left-Right Consistency\",\"authors\":\"Zeyu Lei, Yan Wang, Yufan Xu, Rui Huang\",\"doi\":\"10.1109/ICCT46805.2019.8947220\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Predicting depth from an image is an essential problem in the area of computer vision and deep learning shows a great potential in this area. However most deep Convolutional Neural Networks are need to train them using vast amount of manually labelled data, which is difficult or even scarcely possible in some special environment. In this paper, we proposed an unsupervised method based on left-right consistence with multi-loss fusion, which can perform single image depth estimation, despite the absence of ground truth data. We treat the issue as an image reconstruction problem by training our network with a combine of SSIM and Huber loss. To achieve estimation the depth from coarse to fine, we estimate a coarse map in the former layer and using bilinear sample to transmit the map to the latter layer to obtain a fine depth map. Our method achieves more accurate result on KITTI driving dataset.\",\"PeriodicalId\":306112,\"journal\":{\"name\":\"2019 IEEE 19th International Conference on Communication Technology (ICCT)\",\"volume\":\"116 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 19th International Conference on Communication Technology (ICCT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCT46805.2019.8947220\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 19th International Conference on Communication Technology (ICCT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCT46805.2019.8947220","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
From Coarse to Fine: A Monocular Depth Estimation Model Based on Left-Right Consistency
Predicting depth from an image is an essential problem in the area of computer vision and deep learning shows a great potential in this area. However most deep Convolutional Neural Networks are need to train them using vast amount of manually labelled data, which is difficult or even scarcely possible in some special environment. In this paper, we proposed an unsupervised method based on left-right consistence with multi-loss fusion, which can perform single image depth estimation, despite the absence of ground truth data. We treat the issue as an image reconstruction problem by training our network with a combine of SSIM and Huber loss. To achieve estimation the depth from coarse to fine, we estimate a coarse map in the former layer and using bilinear sample to transmit the map to the latter layer to obtain a fine depth map. Our method achieves more accurate result on KITTI driving dataset.