Wei Yin, Hang Zhao, Yifan Ji, ZhongDa Deng, Ziheng Jin, Shijie Feng*, Xiaolei Zhang, Huai Wang, Qian Chen and Chao Zuo*,
{"title":"基于 VCSEL 投影仪阵列的时空斑点投影轮廓测量法的高分辨率、宽视场和实时 3D 成像技术","authors":"Wei Yin, Hang Zhao, Yifan Ji, ZhongDa Deng, Ziheng Jin, Shijie Feng*, Xiaolei Zhang, Huai Wang, Qian Chen and Chao Zuo*, ","doi":"10.1021/acsphotonics.3c01341","DOIUrl":null,"url":null,"abstract":"<p >Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.</p>","PeriodicalId":23,"journal":{"name":"ACS Photonics","volume":"11 2","pages":"498–511"},"PeriodicalIF":6.7000,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array\",\"authors\":\"Wei Yin, Hang Zhao, Yifan Ji, ZhongDa Deng, Ziheng Jin, Shijie Feng*, Xiaolei Zhang, Huai Wang, Qian Chen and Chao Zuo*, \",\"doi\":\"10.1021/acsphotonics.3c01341\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.</p>\",\"PeriodicalId\":23,\"journal\":{\"name\":\"ACS Photonics\",\"volume\":\"11 2\",\"pages\":\"498–511\"},\"PeriodicalIF\":6.7000,\"publicationDate\":\"2024-01-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Photonics\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acsphotonics.3c01341\",\"RegionNum\":1,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Photonics","FirstCategoryId":"101","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acsphotonics.3c01341","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array
Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.
期刊介绍:
Published as soon as accepted and summarized in monthly issues, ACS Photonics will publish Research Articles, Letters, Perspectives, and Reviews, to encompass the full scope of published research in this field.