Efficient neural RGB-D indoor scene reconstruction based on normal features

IF 1.7 4区 计算机科学 Q3 COMPUTER SCIENCE, SOFTWARE ENGINEERING
Xiaoqun Wu, Xin Liu, Yumeng Cao, Haisheng Li
{"title":"Efficient neural RGB-D indoor scene reconstruction based on normal features","authors":"Xiaoqun Wu,&nbsp;Xin Liu,&nbsp;Yumeng Cao,&nbsp;Haisheng Li","doi":"10.1016/j.cagd.2025.102452","DOIUrl":null,"url":null,"abstract":"<div><div>Reconstructing large-scale indoor scenes from 2D images to 3D models presents substantial challenges, particularly in handling texture-less regions and extensive scene sizes with both accuracy and efficiency. This paper introduces a novel method for efficient and high-quality geometric reconstruction of indoor scenes using RGB-D images. Our approach integrates normal features as prior information into the RGB-D data and employs a truncated signed distance function (TSDF) to represent scene surfaces. Combined with multi-resolution hash encoding, the proposed method achieves both high reconstruction quality and computational efficiency. Specifically, we estimate normal vectors from RGB images as feature priors to guide surface fitting. To address the inaccuracies of normal estimation in regions with small objects or complex geometric details, we incorporate depth information to better constrain the surface fitting process. Additionally, multi-resolution hash encoding is used to stratify sampling points, enabling rapid feature lookups via hash functions. Experimental results demonstrate that the proposed method significantly outperforms existing approaches in terms of both reconstruction quality and computational efficiency.</div></div>","PeriodicalId":55226,"journal":{"name":"Computer Aided Geometric Design","volume":"119 ","pages":"Article 102452"},"PeriodicalIF":1.7000,"publicationDate":"2025-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Aided Geometric Design","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016783962500041X","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

Reconstructing large-scale indoor scenes from 2D images to 3D models presents substantial challenges, particularly in handling texture-less regions and extensive scene sizes with both accuracy and efficiency. This paper introduces a novel method for efficient and high-quality geometric reconstruction of indoor scenes using RGB-D images. Our approach integrates normal features as prior information into the RGB-D data and employs a truncated signed distance function (TSDF) to represent scene surfaces. Combined with multi-resolution hash encoding, the proposed method achieves both high reconstruction quality and computational efficiency. Specifically, we estimate normal vectors from RGB images as feature priors to guide surface fitting. To address the inaccuracies of normal estimation in regions with small objects or complex geometric details, we incorporate depth information to better constrain the surface fitting process. Additionally, multi-resolution hash encoding is used to stratify sampling points, enabling rapid feature lookups via hash functions. Experimental results demonstrate that the proposed method significantly outperforms existing approaches in terms of both reconstruction quality and computational efficiency.
基于正常特征的高效神经RGB-D室内场景重建
从2D图像到3D模型重建大规模室内场景提出了巨大的挑战,特别是在处理无纹理区域和具有准确性和效率的广泛场景尺寸方面。本文介绍了一种利用RGB-D图像对室内场景进行高效、高质量几何重建的新方法。我们的方法将常规特征作为先验信息集成到RGB-D数据中,并使用截断符号距离函数(TSDF)来表示场景表面。结合多分辨率哈希编码,该方法具有较高的重建质量和计算效率。具体来说,我们从RGB图像中估计法向量作为特征先验来指导表面拟合。为了解决在具有小目标或复杂几何细节的区域中正态估计的不准确性,我们结合了深度信息来更好地约束表面拟合过程。此外,多分辨率哈希编码用于分层采样点,通过哈希函数实现快速特征查找。实验结果表明,该方法在重建质量和计算效率方面都明显优于现有方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Aided Geometric Design
Computer Aided Geometric Design 工程技术-计算机:软件工程
CiteScore
3.50
自引率
13.30%
发文量
57
审稿时长
60 days
期刊介绍: The journal Computer Aided Geometric Design is for researchers, scholars, and software developers dealing with mathematical and computational methods for the description of geometric objects as they arise in areas ranging from CAD/CAM to robotics and scientific visualization. The journal publishes original research papers, survey papers and with quick editorial decisions short communications of at most 3 pages. The primary objects of interest are curves, surfaces, and volumes such as splines (NURBS), meshes, subdivision surfaces as well as algorithms to generate, analyze, and manipulate them. This journal will report on new developments in CAGD and its applications, including but not restricted to the following: -Mathematical and Geometric Foundations- Curve, Surface, and Volume generation- CAGD applications in Numerical Analysis, Computational Geometry, Computer Graphics, or Computer Vision- Industrial, medical, and scientific applications. The aim is to collect and disseminate information on computer aided design in one journal. To provide the user community with methods and algorithms for representing curves and surfaces. To illustrate computer aided geometric design by means of interesting applications. To combine curve and surface methods with computer graphics. To explain scientific phenomena by means of computer graphics. To concentrate on the interaction between theory and application. To expose unsolved problems of the practice. To develop new methods in computer aided geometry.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信