DetailPoint: detailed feature learning on point clouds with attention mechanism

IF 2.4 4区 计算机科学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Ying Li, Jincheng Bai, Huankun Sheng
{"title":"DetailPoint: detailed feature learning on point clouds with attention mechanism","authors":"Ying Li, Jincheng Bai, Huankun Sheng","doi":"10.1007/s00138-023-01491-2","DOIUrl":null,"url":null,"abstract":"<p>Point cloud analysis is an important part of 3D geometric processing. It has been widely used in many fields, such as automatic driving and robots. Although great progress has been made in recent years, there are still some unresolved problems. For example, current methods devote employing MLP to extract local features after search k neighbor points, they cannot effectively model the dependency relationship between the anchor point and k neighboring points. In addition, the prevailing models may not exploit the inherent structural similarities present in the global scope. To solve these issues, we propose a feature extraction model named DetailPoint to get detailed local information and long-range global dependency of point clouds. DetailPoint possess three units: the shallow local learning unit, the deep local learning unit and the deep global learning unit. We first use the SLL to extract shallow local features, and then use the DLL to learn deep local features. In these two units, we design a dual-path extraction method to acquire detail local features with dependencies. Finally, the DGL unit is employed to improve the generalization ability of local features and establish global interaction. These three units are connected in series to form our DetailPoint. We evaluated the performance of our model on four datasets, ScanObjectNN and ModelNet40 for shape classification, the ShapeNet dataset for part segmentation, and the S3DIS dataset for sementatic segmentations. The experimental results demonstrate that DetailPoint is capable of expressing point clouds more effectively, resulting in superior performance compared to existing methods.</p>","PeriodicalId":51116,"journal":{"name":"Machine Vision and Applications","volume":"72 1","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2023-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine Vision and Applications","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s00138-023-01491-2","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Point cloud analysis is an important part of 3D geometric processing. It has been widely used in many fields, such as automatic driving and robots. Although great progress has been made in recent years, there are still some unresolved problems. For example, current methods devote employing MLP to extract local features after search k neighbor points, they cannot effectively model the dependency relationship between the anchor point and k neighboring points. In addition, the prevailing models may not exploit the inherent structural similarities present in the global scope. To solve these issues, we propose a feature extraction model named DetailPoint to get detailed local information and long-range global dependency of point clouds. DetailPoint possess three units: the shallow local learning unit, the deep local learning unit and the deep global learning unit. We first use the SLL to extract shallow local features, and then use the DLL to learn deep local features. In these two units, we design a dual-path extraction method to acquire detail local features with dependencies. Finally, the DGL unit is employed to improve the generalization ability of local features and establish global interaction. These three units are connected in series to form our DetailPoint. We evaluated the performance of our model on four datasets, ScanObjectNN and ModelNet40 for shape classification, the ShapeNet dataset for part segmentation, and the S3DIS dataset for sementatic segmentations. The experimental results demonstrate that DetailPoint is capable of expressing point clouds more effectively, resulting in superior performance compared to existing methods.

Abstract Image

DetailPoint:利用注意力机制对点云进行详细特征学习
点云分析是三维几何处理的重要组成部分。它已被广泛应用于自动驾驶和机器人等多个领域。尽管近年来点云分析取得了长足进步,但仍存在一些尚未解决的问题。例如,目前的方法致力于在搜索 k 个邻近点后采用 MLP 提取局部特征,但无法有效地模拟锚点与 k 个邻近点之间的依赖关系。此外,现有模型可能无法利用全局范围内存在的固有结构相似性。为了解决这些问题,我们提出了一种名为 DetailPoint 的特征提取模型,用于获取点云的详细局部信息和长距离全局依赖关系。DetailPoint 拥有三个单元:浅层局部学习单元、深层局部学习单元和深层全局学习单元。我们首先使用 SLL 提取浅层局部特征,然后使用 DLL 学习深层局部特征。在这两个单元中,我们设计了一种双路径提取方法,以获取具有依赖性的局部细节特征。最后,利用 DGL 单元提高局部特征的泛化能力,并建立全局交互。这三个单元串联起来就形成了我们的 DetailPoint。我们在四个数据集上评估了模型的性能:ScanObjectNN 和 ModelNet40 用于形状分类,ShapeNet 数据集用于部件分割,S3DIS 数据集用于静态分割。实验结果表明,DetailPoint 能够更有效地表达点云,与现有方法相比性能更优。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Machine Vision and Applications
Machine Vision and Applications 工程技术-工程:电子与电气
CiteScore
6.30
自引率
3.00%
发文量
84
审稿时长
8.7 months
期刊介绍: Machine Vision and Applications publishes high-quality technical contributions in machine vision research and development. Specifically, the editors encourage submittals in all applications and engineering aspects of image-related computing. In particular, original contributions dealing with scientific, commercial, industrial, military, and biomedical applications of machine vision, are all within the scope of the journal. Particular emphasis is placed on engineering and technology aspects of image processing and computer vision. The following aspects of machine vision applications are of interest: algorithms, architectures, VLSI implementations, AI techniques and expert systems for machine vision, front-end sensing, multidimensional and multisensor machine vision, real-time techniques, image databases, virtual reality and visualization. Papers must include a significant experimental validation component.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信