Combination of dot-matrix lighting and floodlighting for multipath interference suppression in ToF imaging

Xiaoyue Liu, Jiayi Huo, Huimin Yan
{"title":"Combination of dot-matrix lighting and floodlighting for multipath interference suppression in ToF imaging","authors":"Xiaoyue Liu, Jiayi Huo, Huimin Yan","doi":"10.1117/12.2619673","DOIUrl":null,"url":null,"abstract":"Time-of-flight (ToF) cameras obtain the depth information of the whole scene simultaneously by floodlighting it. In the presence of mutual reflection between the targets, the measurement would suffer from the multipath interference (MPI), because the signal received by the sensor is a mixture of direct component and multipath (or global) component. MPI would lead to significant measurement errors. In this paper is introduced a method of separating the direct and global components by once dot-matrix lighting and twice floodlighting with different frequencies. With dot-matrix lighting, the depth information at the dot matrix position is almost only determined by the direct component. The phase value of the direct component is readily calculated. The global component at the dot position with floodlighting is separated by minimizing the separation error through solving the nonlinear least square problem. Then the global component of the whole scene can be obtained by two-dimensional interpolation from data at dot matrix position. As a result, the direct component can be calculated by subtracting the interpolation result from the floodlighting signal, and the depth were calculated only from direct component. Semi-physical experiments were made for three kinds of scenes, blank corner with uniform reflectivity, the corner with different reflectivity areas and the corner with an object placed in front of it. The results demonstrate that the MPI has been significantly suppressed in all scenes. Especially in the area with strong MPI in the first two kinds of scenes, the measurement errors can decrease to about 10%~20%.","PeriodicalId":201899,"journal":{"name":"International Conference on Optical Instruments and Technology","volume":"82 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Optical Instruments and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2619673","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Time-of-flight (ToF) cameras obtain the depth information of the whole scene simultaneously by floodlighting it. In the presence of mutual reflection between the targets, the measurement would suffer from the multipath interference (MPI), because the signal received by the sensor is a mixture of direct component and multipath (or global) component. MPI would lead to significant measurement errors. In this paper is introduced a method of separating the direct and global components by once dot-matrix lighting and twice floodlighting with different frequencies. With dot-matrix lighting, the depth information at the dot matrix position is almost only determined by the direct component. The phase value of the direct component is readily calculated. The global component at the dot position with floodlighting is separated by minimizing the separation error through solving the nonlinear least square problem. Then the global component of the whole scene can be obtained by two-dimensional interpolation from data at dot matrix position. As a result, the direct component can be calculated by subtracting the interpolation result from the floodlighting signal, and the depth were calculated only from direct component. Semi-physical experiments were made for three kinds of scenes, blank corner with uniform reflectivity, the corner with different reflectivity areas and the corner with an object placed in front of it. The results demonstrate that the MPI has been significantly suppressed in all scenes. Especially in the area with strong MPI in the first two kinds of scenes, the measurement errors can decrease to about 10%~20%.
点阵照明与泛光照明相结合抑制ToF成像中的多径干扰
ToF (Time-of-flight)相机通过泛光灯同时获取整个场景的深度信息。在目标之间相互反射的情况下,由于传感器接收到的信号是直接分量和多径(或全局)分量的混合,测量会受到多径干扰(MPI)。MPI会导致显著的测量误差。本文介绍了一种利用一次点阵光照和两次不同频率泛光灯分离直接分量和全局分量的方法。使用点阵照明,点阵位置的深度信息几乎只由直接分量决定。直接分量的相位值很容易计算出来。通过求解非线性最小二乘问题,使分离误差最小化,实现泛光灯点位全局分量的分离。然后对点阵位置的数据进行二维插值,得到整个场景的全局分量。因此,从泛光灯信号中减去插值结果即可得到直接分量,而深度仅由直接分量计算。对反射率均匀的空白角落、不同反射率区域的角落和前面放置物体的角落三种场景进行了半物理实验。结果表明,MPI在所有场景下都得到了明显的抑制。特别是在前两种场景中MPI较强的区域,测量误差可降低到10%~20%左右。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信