Occlusion Handling in Depth Estimation of a Scene from a Given Light Field Using a Geodesic Distance and the Principle of Symmetry of the View

IF 0.4 4区 计算机科学 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
M. G. Mozerov, V. N. Karnaukhov, V. I. Kober, L. V. Zimina
{"title":"Occlusion Handling in Depth Estimation of a Scene from a Given Light Field Using a Geodesic Distance and the Principle of Symmetry of the View","authors":"M. G. Mozerov, V. N. Karnaukhov, V. I. Kober, L. V. Zimina","doi":"10.1134/s1064226924700177","DOIUrl":null,"url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">\n<b>Abstract</b>—</h3><p>The problem of depth estimation of a scene from a given light field can be reduced to the problem of classical stereo matching with the statement that matching pixels in stereo images have the same brightness values. However, this assumption is generally incorrect, given the presence of noise in the images and the different illumination of the left and right images in the stereo pair, as well as the existence of occlusions. In this regard, the luminous flux, representing 80 images pairwise epipolar to the central one, offers a number of advantages, especially in terms of occlusion handling. In this paper, we propose the principle of viewing symmetry: if a pixel of the central image lies in the occlusion zone relative to one of the peripheral images of the light field, then this pixel does not belong to the occlusion zone for an axisymmetric image of the peripheral field. Thus, it is possible to form a robust volume of discrepancy weights relative to the occlusion. As a result, the algorithm proposed in the article significantly improves the result of the scene depth reconstruction. The effectiveness of our approach is demonstrated using the main test database of the light field and comparing it with the best reconstruction algorithms in the efficiency of border recognition and in the speed of calculation.</p>","PeriodicalId":50229,"journal":{"name":"Journal of Communications Technology and Electronics","volume":null,"pages":null},"PeriodicalIF":0.4000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Communications Technology and Electronics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1134/s1064226924700177","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

The problem of depth estimation of a scene from a given light field can be reduced to the problem of classical stereo matching with the statement that matching pixels in stereo images have the same brightness values. However, this assumption is generally incorrect, given the presence of noise in the images and the different illumination of the left and right images in the stereo pair, as well as the existence of occlusions. In this regard, the luminous flux, representing 80 images pairwise epipolar to the central one, offers a number of advantages, especially in terms of occlusion handling. In this paper, we propose the principle of viewing symmetry: if a pixel of the central image lies in the occlusion zone relative to one of the peripheral images of the light field, then this pixel does not belong to the occlusion zone for an axisymmetric image of the peripheral field. Thus, it is possible to form a robust volume of discrepancy weights relative to the occlusion. As a result, the algorithm proposed in the article significantly improves the result of the scene depth reconstruction. The effectiveness of our approach is demonstrated using the main test database of the light field and comparing it with the best reconstruction algorithms in the efficiency of border recognition and in the speed of calculation.

Abstract Image

利用大地测量距离和视图对称原理,在根据给定光场对场景进行深度估计时处理遮挡问题
摘要--根据给定光场对场景进行深度估计的问题可以简化为经典的立体匹配问题,即立体图像中的匹配像素具有相同的亮度值。然而,由于图像中存在噪声、立体图像中左右图像的照度不同以及遮挡物的存在,这一假设通常是不正确的。在这方面,光通量代表了与中心图像成对同极的 80 幅图像,具有许多优势,尤其是在处理遮挡方面。在本文中,我们提出了观察对称性原则:如果中心图像的一个像素相对于光场的一个外围图像位于遮挡区,那么对于轴对称的外围图像来说,这个像素就不属于遮挡区。因此,就有可能形成一个相对于遮挡区域的稳健的差异权重卷。因此,文章中提出的算法大大改善了场景深度重建的结果。我们使用主要的光场测试数据库证明了我们方法的有效性,并在边界识别效率和计算速度方面与最好的重建算法进行了比较。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
1.00
自引率
20.00%
发文量
170
审稿时长
10.5 months
期刊介绍: Journal of Communications Technology and Electronics is a journal that publishes articles on a broad spectrum of theoretical, fundamental, and applied issues of radio engineering, communication, and electron physics. It publishes original articles from the leading scientific and research centers. The journal covers all essential branches of electromagnetics, wave propagation theory, signal processing, transmission lines, telecommunications, physics of semiconductors, and physical processes in electron devices, as well as applications in biology, medicine, microelectronics, nanoelectronics, electron and ion emission, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信