Dynamic scene 360° three-dimensional reconstruction with large field-of-view based on metasurface-enabled structured light

Abstract

Three-dimensional (3D) reconstruction is a key technology for reshaping stereoscopic models of the physical world, with important applications in medical diagnosis, engineering exploration, and industrial manufacturing. Large field-of-view (FOV), dynamic reconstruction, and ultra-compact volume are important development directions for 3D reconstruction systems. However, existing reconstruction techniques struggle to meet these criteria simultaneously, which greatly restricts their further advancement. This paper proposes a structured light (SL) 3D reconstruction system based on metasurface, achieving 360° dynamic scene reconstruction with a large imaging FOV of 140°, a maximum error of only 6.32 % in 1.5 m, and SL dimensions of only 0.3 mm × 0.3 mm. Specifically, the designed metasurface projects 10,000 random dots into the 180° transmission space. By capturing and processing reflection images of dynamic scenes within the space using visual technology, single-frame 3D point clouds obtained at different times are stitched together to construct a complete 3D model of the scene. Compared to traditional 3D reconstruction technologies, our method offers significant advantages in terms of viewing angle range, dynamic 3D reconstruction, and integration. It paving a new way for the development of 3D devices, and having profound implications for future technological innovations.