Back to geometry: Efficient indoor space segmentation from point clouds by 2D–3D geometry constrains

IF 7.6 Q1 REMOTE SENSING
Shengjun Tang , Junjie Huang , Benhe Cai , Han Du , Baoding Zhou , Zhigang Zhao , You Li , Weixi Wang , Renzhong Guo
{"title":"Back to geometry: Efficient indoor space segmentation from point clouds by 2D–3D geometry constrains","authors":"Shengjun Tang ,&nbsp;Junjie Huang ,&nbsp;Benhe Cai ,&nbsp;Han Du ,&nbsp;Baoding Zhou ,&nbsp;Zhigang Zhao ,&nbsp;You Li ,&nbsp;Weixi Wang ,&nbsp;Renzhong Guo","doi":"10.1016/j.jag.2024.104265","DOIUrl":null,"url":null,"abstract":"<div><div>This paper addresses the challenge of indoor space segmentation from 3D point clouds, which is essential for understanding interior layouts, reconstructing 3D structures, and developing indoor navigation maps. While current deep learning-based methods rely on projecting 3D point clouds into 2D for instance extraction, they often fail to capture the local and global 3D features necessary for effectively segmenting complex indoor spaces, such as multi-ring nested structures. These methods also struggle with generalization across different scenes. In response, this paper proposes an efficient indoor space segmentation method that integrates both 2D and 3D geometric constraints. By leveraging the distribution characteristics of point clouds in 2D and the local and global features in 3D, the method achieves reliable extraction of vertical structural information in complex indoor environments. To address under-segmentation in small spaces due to varying scales, the paper introduces an adaptive extraction method for space partition anchors, guided by local features. During instance-level space segmentation, a hierarchical contour tree structure is employed to precisely partition complex indoor spaces, effectively handling circular and composite structures. The proposed approach was tested on 96 RGB-D scans from the Beike dataset and 6 large-scale indoor scenes from the S3DIS dataset, covering a range of complexities, sizes, and structures. The experimental section includes ablation studies and thorough comparisons with existing state-of-the-art spatial partitioning algorithms based on morphology and deep learning. Results demonstrate that the proposed method significantly outperforms existing approaches in terms of accuracy, robustness, and generalization ability, providing a solid foundation for indoor space modeling and robotic navigation. The source code and datasets will be made publicly available via the “<span><span>EISPGeo</span><svg><path></path></svg></span>” link.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"135 ","pages":"Article 104265"},"PeriodicalIF":7.6000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224006216","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0

Abstract

This paper addresses the challenge of indoor space segmentation from 3D point clouds, which is essential for understanding interior layouts, reconstructing 3D structures, and developing indoor navigation maps. While current deep learning-based methods rely on projecting 3D point clouds into 2D for instance extraction, they often fail to capture the local and global 3D features necessary for effectively segmenting complex indoor spaces, such as multi-ring nested structures. These methods also struggle with generalization across different scenes. In response, this paper proposes an efficient indoor space segmentation method that integrates both 2D and 3D geometric constraints. By leveraging the distribution characteristics of point clouds in 2D and the local and global features in 3D, the method achieves reliable extraction of vertical structural information in complex indoor environments. To address under-segmentation in small spaces due to varying scales, the paper introduces an adaptive extraction method for space partition anchors, guided by local features. During instance-level space segmentation, a hierarchical contour tree structure is employed to precisely partition complex indoor spaces, effectively handling circular and composite structures. The proposed approach was tested on 96 RGB-D scans from the Beike dataset and 6 large-scale indoor scenes from the S3DIS dataset, covering a range of complexities, sizes, and structures. The experimental section includes ablation studies and thorough comparisons with existing state-of-the-art spatial partitioning algorithms based on morphology and deep learning. Results demonstrate that the proposed method significantly outperforms existing approaches in terms of accuracy, robustness, and generalization ability, providing a solid foundation for indoor space modeling and robotic navigation. The source code and datasets will be made publicly available via the “EISPGeo” link.
回到几何:通过二维三维几何约束从点云中高效分割室内空间
这对于理解室内布局、重建三维结构和开发室内导航地图至关重要。虽然目前基于深度学习的方法依赖于将三维点云投影到二维来提取实例,但它们往往无法捕捉到有效分割复杂室内空间(如多环嵌套结构)所需的局部和全局三维特征。这些方法也很难在不同场景中进行泛化。为此,本文提出了一种集成二维和三维几何约束的高效室内空间分割方法。通过利用二维点云的分布特征以及三维的局部和全局特征,该方法可以在复杂的室内环境中可靠地提取垂直结构信息。为了解决因尺度不同而导致的小空间分割不足问题,本文介绍了一种以局部特征为指导的空间分割锚点自适应提取方法。在实例级空间分割过程中,采用分层轮廓树结构精确分割复杂的室内空间,有效处理圆形和复合结构。所提出的方法在北科数据集的 96 个 RGB-D 扫描和 S3DIS 数据集的 6 个大型室内场景上进行了测试,涵盖了各种复杂程度、尺寸和结构。实验部分包括烧蚀研究以及与现有基于形态学和深度学习的最先进空间分区算法的全面比较。结果表明,所提出的方法在准确性、鲁棒性和泛化能力方面明显优于现有方法,为室内空间建模和机器人导航奠定了坚实的基础。源代码和数据集将通过 "EISPGeo "链接公开发布。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International journal of applied earth observation and geoinformation : ITC journal
International journal of applied earth observation and geoinformation : ITC journal Global and Planetary Change, Management, Monitoring, Policy and Law, Earth-Surface Processes, Computers in Earth Sciences
CiteScore
12.00
自引率
0.00%
发文量
0
审稿时长
77 days
期刊介绍: The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信