ViDroneNet:一种高效的探测器,专门用于航空图像中的目标检测

IF 2.9 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Haiyu Liao, Yaorui Tang, Yu Liu, Xiaohui Luo
{"title":"ViDroneNet:一种高效的探测器,专门用于航空图像中的目标检测","authors":"Haiyu Liao,&nbsp;Yaorui Tang,&nbsp;Yu Liu,&nbsp;Xiaohui Luo","doi":"10.1016/j.dsp.2025.105270","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, the widespread use of Unmanned Aerial Vehicles (UAV) has made UAV target recognition particularly critical. However, images captured by UAV are characterized by non-uniform object distribution, multi-scale changes, complex backgrounds, and flexible viewpoints, which is a great challenge for general object detectors based on common convolutional networks. To address these issues, we propose ViDroneNet (Vison Drone Network), an efficient framework specifically designed for target detection by UAV. Firstly, to overcome the challenges posed by multi-scale target, we design the Multi-Head Self-Attention darknet (MHSA-darknet) module and applied it to the backbone network. Then, for the problem of small target aggregation, we add a specialized probe head to deepen the understanding of the detailed information of dense small targets. Finally, we designed a Channel-space deformable convolution module (CSDC) and a new approach to feature fusion, both improved sensitivity to spatially distributed inhomogeneous targets and enhanced model robustness. Experimental results show that ViDroneNet outperforms state-of-the-art methods on the VisDrone and UAVDT datases, which were compared to achieve the highest mAP.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"164 ","pages":"Article 105270"},"PeriodicalIF":2.9000,"publicationDate":"2025-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ViDroneNet: An efficient detector specialized for target detection in aerial images\",\"authors\":\"Haiyu Liao,&nbsp;Yaorui Tang,&nbsp;Yu Liu,&nbsp;Xiaohui Luo\",\"doi\":\"10.1016/j.dsp.2025.105270\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In recent years, the widespread use of Unmanned Aerial Vehicles (UAV) has made UAV target recognition particularly critical. However, images captured by UAV are characterized by non-uniform object distribution, multi-scale changes, complex backgrounds, and flexible viewpoints, which is a great challenge for general object detectors based on common convolutional networks. To address these issues, we propose ViDroneNet (Vison Drone Network), an efficient framework specifically designed for target detection by UAV. Firstly, to overcome the challenges posed by multi-scale target, we design the Multi-Head Self-Attention darknet (MHSA-darknet) module and applied it to the backbone network. Then, for the problem of small target aggregation, we add a specialized probe head to deepen the understanding of the detailed information of dense small targets. Finally, we designed a Channel-space deformable convolution module (CSDC) and a new approach to feature fusion, both improved sensitivity to spatially distributed inhomogeneous targets and enhanced model robustness. Experimental results show that ViDroneNet outperforms state-of-the-art methods on the VisDrone and UAVDT datases, which were compared to achieve the highest mAP.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"164 \",\"pages\":\"Article 105270\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2025-04-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200425002921\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200425002921","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

近年来,无人机的广泛应用使得无人机目标识别变得尤为重要。然而,无人机捕获的图像具有目标分布不均匀、多尺度变化、背景复杂、视点灵活等特点,这对基于通用卷积网络的一般目标检测器来说是一个很大的挑战。为了解决这些问题,我们提出了ViDroneNet(视觉无人机网络),这是一个专门为无人机目标检测设计的高效框架。首先,为了克服多尺度目标带来的挑战,我们设计了多头自关注暗网(MHSA-darknet)模块,并将其应用于骨干网。然后,针对小目标聚集问题,我们增加了专门的探针头,加深对密集小目标详细信息的了解。最后,我们设计了通道空间可变形卷积模块(CSDC)和一种新的特征融合方法,既提高了对空间分布非均匀目标的敏感性,又增强了模型的鲁棒性。实验结果表明,ViDroneNet在VisDrone和UAVDT数据库上的表现优于最先进的方法,并将其进行了比较,以获得最高的mAP。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ViDroneNet: An efficient detector specialized for target detection in aerial images
In recent years, the widespread use of Unmanned Aerial Vehicles (UAV) has made UAV target recognition particularly critical. However, images captured by UAV are characterized by non-uniform object distribution, multi-scale changes, complex backgrounds, and flexible viewpoints, which is a great challenge for general object detectors based on common convolutional networks. To address these issues, we propose ViDroneNet (Vison Drone Network), an efficient framework specifically designed for target detection by UAV. Firstly, to overcome the challenges posed by multi-scale target, we design the Multi-Head Self-Attention darknet (MHSA-darknet) module and applied it to the backbone network. Then, for the problem of small target aggregation, we add a specialized probe head to deepen the understanding of the detailed information of dense small targets. Finally, we designed a Channel-space deformable convolution module (CSDC) and a new approach to feature fusion, both improved sensitivity to spatially distributed inhomogeneous targets and enhanced model robustness. Experimental results show that ViDroneNet outperforms state-of-the-art methods on the VisDrone and UAVDT datases, which were compared to achieve the highest mAP.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信