Single-shot 3D Reconstruction by Fusion of Fourier Transform Profilometry and Line Clustering

Abstract

Due to its better accuracy and resolution, Fourier transform profilometry (FTP) is more widely used than the line clustering (LC) based structured light (SL) 3D reconstruction technique. However, it has the bottleneck problem of the unavoidable phase unwrapping errors at places of occlusions and large discontinuities. In this paper, we propose a composite pattern based on the red, green and blue (RGB) channels of the color image to fuse FTP and LC for more robust single-shot reconstruction. The red channel contains the sinusoidal pattern for FTP and the rest of the channels contain the line patterns for LC. Therefore, the intervals between the adjacent lines in the line pattern could be selected as large as possible for robust clustering while the accuracy of FTP will not be affected by the large intervals of the lines. Based on the clustered lines, the phase wrap boundary errors caused by occlusions and large discontinuities are corrected. At last, a one-dimensional phase wrap boundary guided phase unwrapping approach is proposed to solve the bottleneck problem of spatial phase unwrapping for FTP. Experimental results showed that the proposed fusion method could reconstruct the complex shapes with occlusions and large discontinuities more robust than FTP or LC based SL alone.