Object detection based on image pyramid feature fusion and shared detection head

Xiao-Sa Liu, Siyao Chen
{"title":"Object detection based on image pyramid feature fusion and shared detection head","authors":"Xiao-Sa Liu, Siyao Chen","doi":"10.1117/12.2685780","DOIUrl":null,"url":null,"abstract":"In the object detection, the processing of feature fusion and the structure of detection head have an important impact on the detection performance. The current detectors often use the detection pipeline of ‘backbone-feature fusion network-head’. We first propose the Feature Fusion (FF), which constructs a lightweight branching network based on the image pyramid and fuses its extracted features with those of the backbone network, providing a new idea for the focus of feature fusion. In addition, we design the Shared Detector Head (SDH). The main purpose of SDH is to reduce the inconsistency of predictions on feature maps between classification and regression tasks, enhance the interaction between the two, and enhance the detection performance. Our experiments on MS COCO2017 and PASCAL VOC0712 datasets support the above analysis. Based on the above improvements, our approach achieves 0.8% mAP improvements on MS COCO2017. The above experiments prove the effectiveness of our approach.","PeriodicalId":305812,"journal":{"name":"International Conference on Electronic Information Technology","volume":"43 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Electronic Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2685780","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In the object detection, the processing of feature fusion and the structure of detection head have an important impact on the detection performance. The current detectors often use the detection pipeline of ‘backbone-feature fusion network-head’. We first propose the Feature Fusion (FF), which constructs a lightweight branching network based on the image pyramid and fuses its extracted features with those of the backbone network, providing a new idea for the focus of feature fusion. In addition, we design the Shared Detector Head (SDH). The main purpose of SDH is to reduce the inconsistency of predictions on feature maps between classification and regression tasks, enhance the interaction between the two, and enhance the detection performance. Our experiments on MS COCO2017 and PASCAL VOC0712 datasets support the above analysis. Based on the above improvements, our approach achieves 0.8% mAP improvements on MS COCO2017. The above experiments prove the effectiveness of our approach.
基于图像金字塔特征融合和共享检测头的目标检测
在目标检测中,特征融合的处理和检测头的结构对检测性能有重要影响。目前的检测器通常采用“骨干-特征融合网头”的检测管道。首先提出了基于图像金字塔构建轻量级分支网络并将其提取的特征与骨干网络的特征进行融合的特征融合方法(Feature Fusion, FF),为特征融合的焦点提供了新的思路。此外,我们还设计了共享检测器头(SDH)。SDH的主要目的是减少分类任务和回归任务在特征映射上的预测不一致,增强两者之间的交互性,提高检测性能。我们在MS COCO2017和PASCAL VOC0712数据集上的实验支持上述分析。基于上述改进,我们的方法在MS COCO2017上实现了0.8%的mAP改进。以上实验证明了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信