基于 VCSEL 投影仪阵列的时空斑点投影轮廓测量法的高分辨率、宽视场和实时 3D 成像技术

IF 6.7 1区 物理与天体物理 Q1 MATERIALS SCIENCE, MULTIDISCIPLINARY
Wei Yin, Hang Zhao, Yifan Ji, ZhongDa Deng, Ziheng Jin, Shijie Feng*, Xiaolei Zhang, Huai Wang, Qian Chen and Chao Zuo*, 
{"title":"基于 VCSEL 投影仪阵列的时空斑点投影轮廓测量法的高分辨率、宽视场和实时 3D 成像技术","authors":"Wei Yin,&nbsp;Hang Zhao,&nbsp;Yifan Ji,&nbsp;ZhongDa Deng,&nbsp;Ziheng Jin,&nbsp;Shijie Feng*,&nbsp;Xiaolei Zhang,&nbsp;Huai Wang,&nbsp;Qian Chen and Chao Zuo*,&nbsp;","doi":"10.1021/acsphotonics.3c01341","DOIUrl":null,"url":null,"abstract":"<p >Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.</p>","PeriodicalId":23,"journal":{"name":"ACS Photonics","volume":"11 2","pages":"498–511"},"PeriodicalIF":6.7000,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array\",\"authors\":\"Wei Yin,&nbsp;Hang Zhao,&nbsp;Yifan Ji,&nbsp;ZhongDa Deng,&nbsp;Ziheng Jin,&nbsp;Shijie Feng*,&nbsp;Xiaolei Zhang,&nbsp;Huai Wang,&nbsp;Qian Chen and Chao Zuo*,&nbsp;\",\"doi\":\"10.1021/acsphotonics.3c01341\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p >Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.</p>\",\"PeriodicalId\":23,\"journal\":{\"name\":\"ACS Photonics\",\"volume\":\"11 2\",\"pages\":\"498–511\"},\"PeriodicalIF\":6.7000,\"publicationDate\":\"2024-01-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Photonics\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://pubs.acs.org/doi/10.1021/acsphotonics.3c01341\",\"RegionNum\":1,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Photonics","FirstCategoryId":"101","ListUrlMain":"https://pubs.acs.org/doi/10.1021/acsphotonics.3c01341","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

结构光投影,尤其是条纹投影轮廓仪(FPP),是一种主流的高精度非接触式三维成像技术,可用于制造、基础研究和工程应用。然而,用于投射高质量条纹图案的高分辨率空间光调制设备结构复杂、成本高昂,严重限制了 FPP 方法的发展,给微型化和低成本三维成像应用带来了巨大挑战。另一方面,得益于先进的制造工艺,斑点投影轮廓仪(SPP)利用基于垂直腔表面发射激光器(VCSEL)的高集成度斑点投影设备,只需投影单个斑点图案即可实现快速三维重建,为场景重建和人脸识别等微型化深度传感应用开辟了新途径。然而,由于单帧斑点匹配性能较差以及被测表面的复杂反射特性,SPP 得到的三维测量结果较为粗糙,精度和分辨率较低。在本文中,我们提出了一种利用空间-时间斑点投影轮廓仪(ST-SPP)的高分辨率、宽视场实时三维成像方法,该方法集成了一组基于 VCSEL 的微型斑点投影仪,对测量场景的深度信息进行空间和时间编码。为了克服将斑点匹配应用于复杂表面的困难,提出了一种利用数字图像相关性的从粗到细的时空匹配策略,从而实现了高精度和高效率的子像素差异估计。实验结果证明,在 1 米(长)×1.2 米(宽)×2 米(深)的测量范围内,ST-SPP 实现了精确且计算效率高的三维成像,相对精度高于 0.05%,展示了其在每秒 30 帧的远距离实时三维精细重建方面的先进性能。所提出的 ST-SPP 适用于动态场景和形状复杂的大型物体的快速三维建模,进一步提高了基于 SPP 的光学计量仪器在精度、分辨率、测量范围和便携性方面的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array

High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array

High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array

Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) × 1.2 m (width) × 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACS Photonics
ACS Photonics NANOSCIENCE & NANOTECHNOLOGY-MATERIALS SCIENCE, MULTIDISCIPLINARY
CiteScore
11.90
自引率
5.70%
发文量
438
审稿时长
2.3 months
期刊介绍: Published as soon as accepted and summarized in monthly issues, ACS Photonics will publish Research Articles, Letters, Perspectives, and Reviews, to encompass the full scope of published research in this field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信