利用线性结构的EPI光场深度估计

Huijin Lv, Kaiyu Gu, Yongbing Zhang, Qionghai Dai
{"title":"利用线性结构的EPI光场深度估计","authors":"Huijin Lv, Kaiyu Gu, Yongbing Zhang, Qionghai Dai","doi":"10.1109/ICMEW.2015.7169836","DOIUrl":null,"url":null,"abstract":"Light field (LF), a promising representation to describe the visual appearance of a scene, implicitly captures 3D scene geometry. Inspired by this, we exploit the special linear structure of epipolar plane image (EPI) and propose a novel framework for depth estimation for 4D LF. Our approach estimates disparities through locating the optimal slope of each line segmentation on EPIs, which are projected by corresponding scene points. For each pixel to be processed, we employ intensity pixel value, gradient pixel value, spatial consistency as well as reliability measure to select the best slope from a predefined set. The depth value is calculated according to the geometric relation between disparity and slope of line segmentation in EPI. Then a novel method to detect and handle occlusion boundaries is introduced, further improving the quality of depth maps. We test our algorithm on not only a number of synthetic LF examples but real-world LF datasets, and the experimental results show that our technique outperforms both the state-of-the art and the recent light field stereo matching methods, especially near occlusion boundaries.","PeriodicalId":388471,"journal":{"name":"2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":"{\"title\":\"Light field depth estimation exploiting linear structure in EPI\",\"authors\":\"Huijin Lv, Kaiyu Gu, Yongbing Zhang, Qionghai Dai\",\"doi\":\"10.1109/ICMEW.2015.7169836\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Light field (LF), a promising representation to describe the visual appearance of a scene, implicitly captures 3D scene geometry. Inspired by this, we exploit the special linear structure of epipolar plane image (EPI) and propose a novel framework for depth estimation for 4D LF. Our approach estimates disparities through locating the optimal slope of each line segmentation on EPIs, which are projected by corresponding scene points. For each pixel to be processed, we employ intensity pixel value, gradient pixel value, spatial consistency as well as reliability measure to select the best slope from a predefined set. The depth value is calculated according to the geometric relation between disparity and slope of line segmentation in EPI. Then a novel method to detect and handle occlusion boundaries is introduced, further improving the quality of depth maps. We test our algorithm on not only a number of synthetic LF examples but real-world LF datasets, and the experimental results show that our technique outperforms both the state-of-the art and the recent light field stereo matching methods, especially near occlusion boundaries.\",\"PeriodicalId\":388471,\"journal\":{\"name\":\"2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"12\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMEW.2015.7169836\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMEW.2015.7169836","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12

摘要

光场(LF)是描述场景视觉外观的一种很有前途的表示,它隐含地捕获了3D场景的几何形状。受此启发,我们利用极平面图像(EPI)的特殊线性结构,提出了一种新的四维极平面图像深度估计框架。我们的方法通过在epi上定位每条线分割的最佳斜率来估计差异,这些线分割是由相应的场景点投影的。对于每个待处理的像素,我们采用强度像素值、梯度像素值、空间一致性和可靠性度量从预定义集合中选择最佳斜率。根据EPI中线分割的视差与斜率的几何关系计算深度值。然后提出了一种新的遮挡边界检测和处理方法,进一步提高了深度图的质量。我们不仅在许多合成的LF示例上测试了我们的算法,而且在真实的LF数据集上测试了我们的算法,实验结果表明,我们的技术优于最新的光场立体匹配方法,特别是在遮挡边界附近。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Light field depth estimation exploiting linear structure in EPI
Light field (LF), a promising representation to describe the visual appearance of a scene, implicitly captures 3D scene geometry. Inspired by this, we exploit the special linear structure of epipolar plane image (EPI) and propose a novel framework for depth estimation for 4D LF. Our approach estimates disparities through locating the optimal slope of each line segmentation on EPIs, which are projected by corresponding scene points. For each pixel to be processed, we employ intensity pixel value, gradient pixel value, spatial consistency as well as reliability measure to select the best slope from a predefined set. The depth value is calculated according to the geometric relation between disparity and slope of line segmentation in EPI. Then a novel method to detect and handle occlusion boundaries is introduced, further improving the quality of depth maps. We test our algorithm on not only a number of synthetic LF examples but real-world LF datasets, and the experimental results show that our technique outperforms both the state-of-the art and the recent light field stereo matching methods, especially near occlusion boundaries.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信