基于多视点图像融合的弱纹理物体高质量偏振三维重建。

IF 3.3 2区 物理与天体物理 Q2 OPTICS
Optics express Pub Date : 2025-09-08 DOI:10.1364/OE.570825
Jintao Zhu, Luoying Peng, Hui Du, Zhiqiang Liu, Yudong Cai, Cunying Pan, Xuan Li, Xiaopeng Shao
{"title":"基于多视点图像融合的弱纹理物体高质量偏振三维重建。","authors":"Jintao Zhu, Luoying Peng, Hui Du, Zhiqiang Liu, Yudong Cai, Cunying Pan, Xuan Li, Xiaopeng Shao","doi":"10.1364/OE.570825","DOIUrl":null,"url":null,"abstract":"<p><p>Multi-view stereo (MVS) estimates depth by matching features across calibrated views. Though highly accurate on textured surfaces, it is prone to holes and coarse geometry in the case of weak textures or limited viewpoints. Shape-from-polarization (SfP) recovers dense normals from polarized reflections regardless of texture but causes ambiguities in angle inversion, demanding additional disambiguation. Based on these complementary strengths, this paper proposes a passive 3D reconstruction framework that fuses coarse but globally consistent depth priors from a self-attention-enhanced PatchMatch network with fine-grained normal gradients recovered from calibrated polarization measurements. These cues are incorporated into a joint optimization that improves linear consistency between depth and polarization-derived normals while applying a robust, graph-based spatial smoothness constraint to address azimuthal ambiguities and suppress outliers. The final surface is acquired by integrating the optimized normal gradient field in the Fourier domain. Experimental results on different weakly textured objects indicate that our method obtains finer details and fewer artifacts than advanced multi-view stereo and deep learning-based methods, with significantly fewer viewpoints and less computational overhead.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"33 18","pages":"38749-38763"},"PeriodicalIF":3.3000,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-quality polarization 3D reconstruction of weakly textured objects by fusing multi-view images.\",\"authors\":\"Jintao Zhu, Luoying Peng, Hui Du, Zhiqiang Liu, Yudong Cai, Cunying Pan, Xuan Li, Xiaopeng Shao\",\"doi\":\"10.1364/OE.570825\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Multi-view stereo (MVS) estimates depth by matching features across calibrated views. Though highly accurate on textured surfaces, it is prone to holes and coarse geometry in the case of weak textures or limited viewpoints. Shape-from-polarization (SfP) recovers dense normals from polarized reflections regardless of texture but causes ambiguities in angle inversion, demanding additional disambiguation. Based on these complementary strengths, this paper proposes a passive 3D reconstruction framework that fuses coarse but globally consistent depth priors from a self-attention-enhanced PatchMatch network with fine-grained normal gradients recovered from calibrated polarization measurements. These cues are incorporated into a joint optimization that improves linear consistency between depth and polarization-derived normals while applying a robust, graph-based spatial smoothness constraint to address azimuthal ambiguities and suppress outliers. The final surface is acquired by integrating the optimized normal gradient field in the Fourier domain. Experimental results on different weakly textured objects indicate that our method obtains finer details and fewer artifacts than advanced multi-view stereo and deep learning-based methods, with significantly fewer viewpoints and less computational overhead.</p>\",\"PeriodicalId\":19691,\"journal\":{\"name\":\"Optics express\",\"volume\":\"33 18\",\"pages\":\"38749-38763\"},\"PeriodicalIF\":3.3000,\"publicationDate\":\"2025-09-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics express\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/OE.570825\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.570825","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

摘要

多视图立体(MVS)通过匹配校准视图之间的特征来估计深度。虽然在纹理表面上精度很高,但在纹理弱或视点有限的情况下,它容易出现孔洞和粗糙的几何形状。偏振形状(SfP)从偏振反射中恢复密集法线,而不考虑纹理,但在角度反演中会产生歧义,需要额外的消歧义。基于这些互补优势,本文提出了一种被动3D重建框架,该框架融合了来自自注意增强PatchMatch网络的粗糙但全局一致的深度先验和从校准偏振测量中恢复的细粒度正态梯度。这些线索被整合到一个联合优化中,提高了深度和偏振衍生法线之间的线性一致性,同时应用一个鲁棒的、基于图形的空间平滑约束来解决方位模糊性和抑制异常值。在傅里叶域中对优化后的法向梯度场进行积分,得到最终曲面。在不同弱纹理对象上的实验结果表明,与先进的多视点立体和基于深度学习的方法相比,我们的方法获得了更精细的细节和更少的伪影,大大减少了视点和计算开销。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
High-quality polarization 3D reconstruction of weakly textured objects by fusing multi-view images.

Multi-view stereo (MVS) estimates depth by matching features across calibrated views. Though highly accurate on textured surfaces, it is prone to holes and coarse geometry in the case of weak textures or limited viewpoints. Shape-from-polarization (SfP) recovers dense normals from polarized reflections regardless of texture but causes ambiguities in angle inversion, demanding additional disambiguation. Based on these complementary strengths, this paper proposes a passive 3D reconstruction framework that fuses coarse but globally consistent depth priors from a self-attention-enhanced PatchMatch network with fine-grained normal gradients recovered from calibrated polarization measurements. These cues are incorporated into a joint optimization that improves linear consistency between depth and polarization-derived normals while applying a robust, graph-based spatial smoothness constraint to address azimuthal ambiguities and suppress outliers. The final surface is acquired by integrating the optimized normal gradient field in the Fourier domain. Experimental results on different weakly textured objects indicate that our method obtains finer details and fewer artifacts than advanced multi-view stereo and deep learning-based methods, with significantly fewer viewpoints and less computational overhead.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Optics express
Optics express 物理-光学
CiteScore
6.60
自引率
15.80%
发文量
5182
审稿时长
2.1 months
期刊介绍: Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信