{"title":"LFA-Net:用于部分对部分点云注册的增强型点网和可分配权重变换器网络","authors":"Zongyang Zhao;Jiehu Kang;Luyuan Feng;Jian Liang;Yuqi Ren;Bin Wu","doi":"10.1109/TCSVT.2024.3454601","DOIUrl":null,"url":null,"abstract":"Partial point cloud registration is an essential and fundamental component of generating complete 3D shapes, aiming at converting partial scans into a unified coordinate system. However, existing point cloud registration methods suffer from inadequately rich local feature extraction and feature interaction. In addition, these methods still face challenges in modeling the global contextual information of point clouds sufficiently, which limits the improvement in registration effectiveness, especially for partial-to-partial point cloud registration with high noise. To overcome these issues, this paper proposes an enhanced PointNet and assignable weights transformer network (LFA-Net) for partial point cloud registration. The model achieves coarse-to-fine point cloud registration through three core modules. First, the Sufficient Local Feature Extraction Module (LFM) is constructed to extract various local feature information. Then, the Adequate Feature Aggregation Module (FAM) is designed to integrate the feature information from different point clouds. Finally, the Assignable Weights Transformer Module (ATM) is presented to stimulate the model’s global modeling ability during the registration process, enabling the selection of representative points for optimal point cloud registration. Extensive experiments conducted on ModelNet40 using partially overlapping point clouds illustrate the superior registration performance of LFA-Net compared with other state-of-the-art methods. Moreover, Numerous experiments on synthetic and real-word datasets further indicate that LFA-Net also has significant advantages in registering partial point clouds with noise and unseen categories, which demonstrates its excellent robustness and generalization ability for real-world practical application.","PeriodicalId":13082,"journal":{"name":"IEEE Transactions on Circuits and Systems for Video Technology","volume":"35 1","pages":"162-177"},"PeriodicalIF":8.3000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LFA-Net: Enhanced PointNet and Assignable Weights Transformer Network for Partial-to-Partial Point Cloud Registration\",\"authors\":\"Zongyang Zhao;Jiehu Kang;Luyuan Feng;Jian Liang;Yuqi Ren;Bin Wu\",\"doi\":\"10.1109/TCSVT.2024.3454601\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Partial point cloud registration is an essential and fundamental component of generating complete 3D shapes, aiming at converting partial scans into a unified coordinate system. However, existing point cloud registration methods suffer from inadequately rich local feature extraction and feature interaction. In addition, these methods still face challenges in modeling the global contextual information of point clouds sufficiently, which limits the improvement in registration effectiveness, especially for partial-to-partial point cloud registration with high noise. To overcome these issues, this paper proposes an enhanced PointNet and assignable weights transformer network (LFA-Net) for partial point cloud registration. The model achieves coarse-to-fine point cloud registration through three core modules. First, the Sufficient Local Feature Extraction Module (LFM) is constructed to extract various local feature information. Then, the Adequate Feature Aggregation Module (FAM) is designed to integrate the feature information from different point clouds. Finally, the Assignable Weights Transformer Module (ATM) is presented to stimulate the model’s global modeling ability during the registration process, enabling the selection of representative points for optimal point cloud registration. Extensive experiments conducted on ModelNet40 using partially overlapping point clouds illustrate the superior registration performance of LFA-Net compared with other state-of-the-art methods. Moreover, Numerous experiments on synthetic and real-word datasets further indicate that LFA-Net also has significant advantages in registering partial point clouds with noise and unseen categories, which demonstrates its excellent robustness and generalization ability for real-world practical application.\",\"PeriodicalId\":13082,\"journal\":{\"name\":\"IEEE Transactions on Circuits and Systems for Video Technology\",\"volume\":\"35 1\",\"pages\":\"162-177\"},\"PeriodicalIF\":8.3000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Circuits and Systems for Video Technology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10666783/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems for Video Technology","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10666783/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
LFA-Net: Enhanced PointNet and Assignable Weights Transformer Network for Partial-to-Partial Point Cloud Registration
Partial point cloud registration is an essential and fundamental component of generating complete 3D shapes, aiming at converting partial scans into a unified coordinate system. However, existing point cloud registration methods suffer from inadequately rich local feature extraction and feature interaction. In addition, these methods still face challenges in modeling the global contextual information of point clouds sufficiently, which limits the improvement in registration effectiveness, especially for partial-to-partial point cloud registration with high noise. To overcome these issues, this paper proposes an enhanced PointNet and assignable weights transformer network (LFA-Net) for partial point cloud registration. The model achieves coarse-to-fine point cloud registration through three core modules. First, the Sufficient Local Feature Extraction Module (LFM) is constructed to extract various local feature information. Then, the Adequate Feature Aggregation Module (FAM) is designed to integrate the feature information from different point clouds. Finally, the Assignable Weights Transformer Module (ATM) is presented to stimulate the model’s global modeling ability during the registration process, enabling the selection of representative points for optimal point cloud registration. Extensive experiments conducted on ModelNet40 using partially overlapping point clouds illustrate the superior registration performance of LFA-Net compared with other state-of-the-art methods. Moreover, Numerous experiments on synthetic and real-word datasets further indicate that LFA-Net also has significant advantages in registering partial point clouds with noise and unseen categories, which demonstrates its excellent robustness and generalization ability for real-world practical application.
期刊介绍:
The IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) is dedicated to covering all aspects of video technologies from a circuits and systems perspective. We encourage submissions of general, theoretical, and application-oriented papers related to image and video acquisition, representation, presentation, and display. Additionally, we welcome contributions in areas such as processing, filtering, and transforms; analysis and synthesis; learning and understanding; compression, transmission, communication, and networking; as well as storage, retrieval, indexing, and search. Furthermore, papers focusing on hardware and software design and implementation are highly valued. Join us in advancing the field of video technology through innovative research and insights.