Co-Fix3D: Enhancing 3D Object Detection With Collaborative Refinement

IF 4.6 2区 计算机科学 Q2 ROBOTICS
Wenxuan Li;Qin Zou;Chi Chen;Bo Du;Long Chen;Jian Zhou;Hongkai Yu
{"title":"Co-Fix3D: Enhancing 3D Object Detection With Collaborative Refinement","authors":"Wenxuan Li;Qin Zou;Chi Chen;Bo Du;Long Chen;Jian Zhou;Hongkai Yu","doi":"10.1109/LRA.2025.3555859","DOIUrl":null,"url":null,"abstract":"3D object detection in driving scenarios is particularly challenging due to factors such as sensor noise, occlusions, and the inherent sparsity of LiDAR point clouds, which can lead to the loss or incompleteness of key features, in turn affecting perception performance. To address these challenges, we propose Co-Fix3D, an advanced detection framework that integrates Local and Global Enhancement (LGE) modules to refine Bird's Eye View (BEV) features. The LGE module employs Discrete Wavelet Transform (DWT) to refine local features at a fine scale, which helps capture frequency details and subtle variations in the environment, and incorporates an attention mechanism to enhance global feature representations across the entire scene. Moreover, we adopt multi-head LGE modules that each concentrate on targets with varying levels of detection difficulty, further improving our overall perception performance. On the nuScenes dataset, Co-Fix3D achieves a new SOTA performance with 69.4% mAP and 73.5% NDS compared to other competing methods, while on the multimodal benchmark, it achieves 72.3% mAP and 74.7% NDS, respectively.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 5","pages":"4970-4977"},"PeriodicalIF":4.6000,"publicationDate":"2025-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10945409/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

3D object detection in driving scenarios is particularly challenging due to factors such as sensor noise, occlusions, and the inherent sparsity of LiDAR point clouds, which can lead to the loss or incompleteness of key features, in turn affecting perception performance. To address these challenges, we propose Co-Fix3D, an advanced detection framework that integrates Local and Global Enhancement (LGE) modules to refine Bird's Eye View (BEV) features. The LGE module employs Discrete Wavelet Transform (DWT) to refine local features at a fine scale, which helps capture frequency details and subtle variations in the environment, and incorporates an attention mechanism to enhance global feature representations across the entire scene. Moreover, we adopt multi-head LGE modules that each concentrate on targets with varying levels of detection difficulty, further improving our overall perception performance. On the nuScenes dataset, Co-Fix3D achieves a new SOTA performance with 69.4% mAP and 73.5% NDS compared to other competing methods, while on the multimodal benchmark, it achieves 72.3% mAP and 74.7% NDS, respectively.
Co-Fix3D:通过协作细化增强3D对象检测
由于传感器噪声、遮挡和LiDAR点云固有的稀疏性等因素,驾驶场景中的3D物体检测尤其具有挑战性,这些因素可能导致关键特征的丢失或不完整,从而影响感知性能。为了应对这些挑战,我们提出了Co-Fix3D,这是一种先进的检测框架,集成了局部和全局增强(LGE)模块,以完善鸟瞰(BEV)功能。LGE模块采用离散小波变换(DWT)在精细尺度上细化局部特征,这有助于捕获环境中的频率细节和微妙变化,并结合注意机制来增强整个场景的全局特征表示。此外,我们采用了多头LGE模块,每个模块专注于不同检测难度的目标,进一步提高了我们的整体感知性能。在nuScenes数据集上,与其他竞争方法相比,Co-Fix3D的SOTA性能达到了69.4%的mAP和73.5%的NDS,而在多模态基准上,它的mAP和NDS分别达到了72.3%和74.7%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Robotics and Automation Letters
IEEE Robotics and Automation Letters Computer Science-Computer Science Applications
CiteScore
9.60
自引率
15.40%
发文量
1428
期刊介绍: The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信