APS-NeuS: Adaptive planar and skip-sampling for 3D object surface reconstruction in high-specular scenes

IF 4.2 3区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Wei Gao, Li Jin, Youssef Akoudad, Yang Yang
{"title":"APS-NeuS: Adaptive planar and skip-sampling for 3D object surface reconstruction in high-specular scenes","authors":"Wei Gao,&nbsp;Li Jin,&nbsp;Youssef Akoudad,&nbsp;Yang Yang","doi":"10.1016/j.imavis.2025.105665","DOIUrl":null,"url":null,"abstract":"<div><div>High-fidelity 3D object surface reconstruction remains challenging in real-world scenes with strong specular reflections, where multi-view consistency is disrupted by reflection artifacts. To address this, we propose APS-NeuS, an implicit neural rendering framework designed to robustly separate target objects from reflective interference. Specifically, we establish a pixel-wise auxiliary mirror plane to differentiate reflections from target objects and incorporate a Laplacian gradient to better recover their edges and fine structures. Additionally, we introduce a skip-sampling strategy to reduce the impact of reflective interference, further enhancing multi-view consistency and surface fidelity. Finally, we introduce an exclusion loss to help the model more accurately separate the target objects from the reflective parts during initialization by comparing the gradient differences. Extensive experiments on synthetic and real-world datasets show that APS-NeuS achieves superior reconstruction quality under high-specular reflection conditions, demonstrating its practical applicability to complex environments. Code is available at <span><span>https://github.com/ujsjl/APS-NeuS</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50374,"journal":{"name":"Image and Vision Computing","volume":"162 ","pages":"Article 105665"},"PeriodicalIF":4.2000,"publicationDate":"2025-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Image and Vision Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0262885625002537","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

High-fidelity 3D object surface reconstruction remains challenging in real-world scenes with strong specular reflections, where multi-view consistency is disrupted by reflection artifacts. To address this, we propose APS-NeuS, an implicit neural rendering framework designed to robustly separate target objects from reflective interference. Specifically, we establish a pixel-wise auxiliary mirror plane to differentiate reflections from target objects and incorporate a Laplacian gradient to better recover their edges and fine structures. Additionally, we introduce a skip-sampling strategy to reduce the impact of reflective interference, further enhancing multi-view consistency and surface fidelity. Finally, we introduce an exclusion loss to help the model more accurately separate the target objects from the reflective parts during initialization by comparing the gradient differences. Extensive experiments on synthetic and real-world datasets show that APS-NeuS achieves superior reconstruction quality under high-specular reflection conditions, demonstrating its practical applicability to complex environments. Code is available at https://github.com/ujsjl/APS-NeuS.

Abstract Image

aps - news:用于高镜面场景中3D物体表面重建的自适应平面和跳过采样
在具有强烈镜面反射的真实场景中,高保真3D物体表面重建仍然具有挑战性,其中多视图一致性被反射伪影破坏。为了解决这个问题,我们提出了aps - news,这是一个隐式神经渲染框架,旨在将目标物体从反射干扰中健壮地分离出来。具体来说,我们建立了一个逐像素的辅助镜面来区分来自目标物体的反射,并结合拉普拉斯梯度来更好地恢复其边缘和精细结构。此外,我们引入了跳过采样策略,以减少反射干扰的影响,进一步提高多视图一致性和表面保真度。最后,我们引入了排除损失,通过比较梯度差,帮助模型在初始化过程中更准确地分离目标物体和反射部分。在合成数据集和真实数据集上的大量实验表明,aps - news在高镜面反射条件下获得了优异的重建质量,证明了其在复杂环境中的实际适用性。代码可从https://github.com/ujsjl/APS-NeuS获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Image and Vision Computing
Image and Vision Computing 工程技术-工程:电子与电气
CiteScore
8.50
自引率
8.50%
发文量
143
审稿时长
7.8 months
期刊介绍: Image and Vision Computing has as a primary aim the provision of an effective medium of interchange for the results of high quality theoretical and applied research fundamental to all aspects of image interpretation and computer vision. The journal publishes work that proposes new image interpretation and computer vision methodology or addresses the application of such methods to real world scenes. It seeks to strengthen a deeper understanding in the discipline by encouraging the quantitative comparison and performance evaluation of the proposed methodology. The coverage includes: image interpretation, scene modelling, object recognition and tracking, shape analysis, monitoring and surveillance, active vision and robotic systems, SLAM, biologically-inspired computer vision, motion analysis, stereo vision, document image understanding, character and handwritten text recognition, face and gesture recognition, biometrics, vision-based human-computer interaction, human activity and behavior understanding, data fusion from multiple sensor inputs, image databases.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信