基于 YOLOv5 的改进型小型异物碎片探测网络

IF 2.9 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Heng Zhang, Wei Fu, Dong Li, Xiaoming Wang, Tengda Xu
{"title":"基于 YOLOv5 的改进型小型异物碎片探测网络","authors":"Heng Zhang, Wei Fu, Dong Li, Xiaoming Wang, Tengda Xu","doi":"10.1007/s11554-023-01399-0","DOIUrl":null,"url":null,"abstract":"<p>In response to the challenges of detecting foreign object debris (FOD) on airport runways, where the objects are small in size and have indistinct features leading to false detections and missed detections, significant improvements were made to the YOLOv5 algorithm. First, the original YOLOv5-n model was optimized by incorporating multi-scale fusion and detection enhancements. To improve detection speed and reduce parameters, the detection head for large objects was removed. Second, the C3 module in the backbone network was replaced with the C2f module, resulting in enhanced gradient flow and improved feature representation capabilities. Additionally, the spatial pyramid pooling-fast (SPPF) module in the backbone network was refined to expand the receptive field and enhance the model’s perception of dependencies between targets and backgrounds. Furthermore, the coordinate attention (CA) mechanism was introduced in the neck layer to further enhance the model's perception of small FOD items. Lastly, the SCYLLA-IoU (SIoU) loss function was introduced to further improve the speed and accuracy of bounding box regression. Moreover, the nearest neighbor interpolation upsampling method was substituted with the lightweight Content-Aware ReAssembly of FEatures (CARAFE) upsampling operator to better exploit global information. Experimental results on the Fod_Tiny dataset, which consists of small FOD items in airports, demonstrated a significant 5.4% improvement over the baseline algorithm. To validate the generalizability of the algorithm, experiments were conducted on the Mirco_COCO dataset, resulting in a notable 1.9% improvement compared to the baseline algorithm.</p>","PeriodicalId":51224,"journal":{"name":"Journal of Real-Time Image Processing","volume":"12 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improved small foreign object debris detection network based on YOLOv5\",\"authors\":\"Heng Zhang, Wei Fu, Dong Li, Xiaoming Wang, Tengda Xu\",\"doi\":\"10.1007/s11554-023-01399-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In response to the challenges of detecting foreign object debris (FOD) on airport runways, where the objects are small in size and have indistinct features leading to false detections and missed detections, significant improvements were made to the YOLOv5 algorithm. First, the original YOLOv5-n model was optimized by incorporating multi-scale fusion and detection enhancements. To improve detection speed and reduce parameters, the detection head for large objects was removed. Second, the C3 module in the backbone network was replaced with the C2f module, resulting in enhanced gradient flow and improved feature representation capabilities. Additionally, the spatial pyramid pooling-fast (SPPF) module in the backbone network was refined to expand the receptive field and enhance the model’s perception of dependencies between targets and backgrounds. Furthermore, the coordinate attention (CA) mechanism was introduced in the neck layer to further enhance the model's perception of small FOD items. Lastly, the SCYLLA-IoU (SIoU) loss function was introduced to further improve the speed and accuracy of bounding box regression. Moreover, the nearest neighbor interpolation upsampling method was substituted with the lightweight Content-Aware ReAssembly of FEatures (CARAFE) upsampling operator to better exploit global information. Experimental results on the Fod_Tiny dataset, which consists of small FOD items in airports, demonstrated a significant 5.4% improvement over the baseline algorithm. To validate the generalizability of the algorithm, experiments were conducted on the Mirco_COCO dataset, resulting in a notable 1.9% improvement compared to the baseline algorithm.</p>\",\"PeriodicalId\":51224,\"journal\":{\"name\":\"Journal of Real-Time Image Processing\",\"volume\":\"12 1\",\"pages\":\"\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-01-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Real-Time Image Processing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s11554-023-01399-0\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Real-Time Image Processing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11554-023-01399-0","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

机场跑道上的异物碎片(FOD)体积小、特征不明显,容易造成误探测和漏探测,为了应对这些探测难题,我们对 YOLOv5 算法进行了重大改进。首先,通过整合多尺度融合和检测增强功能,对原始 YOLOv5-n 模型进行了优化。为了提高检测速度和减少参数,删除了大型物体的检测头。其次,用 C2f 模块取代了主干网络中的 C3 模块,从而增强了梯度流并提高了特征表示能力。此外,主干网络中的空间金字塔快速汇集(SPPF)模块也得到了改进,以扩大感受野,增强模型对目标和背景之间依赖关系的感知。此外,还在颈部层引入了协调注意(CA)机制,以进一步增强模型对小型 FOD 项目的感知能力。最后,还引入了 SCYLLA-IoU (SIoU) 损失函数,以进一步提高边界框回归的速度和准确性。此外,为了更好地利用全局信息,还用轻量级的内容感知特征再组装(CARAFE)上采样算子取代了近邻插值上采样方法。在 Fod_Tiny 数据集(由机场中的小型 FOD 物品组成)上的实验结果表明,该算法比基线算法显著提高了 5.4%。为了验证该算法的通用性,还在 Mirco_COCO 数据集上进行了实验,结果比基准算法显著提高了 1.9%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Improved small foreign object debris detection network based on YOLOv5

Improved small foreign object debris detection network based on YOLOv5

In response to the challenges of detecting foreign object debris (FOD) on airport runways, where the objects are small in size and have indistinct features leading to false detections and missed detections, significant improvements were made to the YOLOv5 algorithm. First, the original YOLOv5-n model was optimized by incorporating multi-scale fusion and detection enhancements. To improve detection speed and reduce parameters, the detection head for large objects was removed. Second, the C3 module in the backbone network was replaced with the C2f module, resulting in enhanced gradient flow and improved feature representation capabilities. Additionally, the spatial pyramid pooling-fast (SPPF) module in the backbone network was refined to expand the receptive field and enhance the model’s perception of dependencies between targets and backgrounds. Furthermore, the coordinate attention (CA) mechanism was introduced in the neck layer to further enhance the model's perception of small FOD items. Lastly, the SCYLLA-IoU (SIoU) loss function was introduced to further improve the speed and accuracy of bounding box regression. Moreover, the nearest neighbor interpolation upsampling method was substituted with the lightweight Content-Aware ReAssembly of FEatures (CARAFE) upsampling operator to better exploit global information. Experimental results on the Fod_Tiny dataset, which consists of small FOD items in airports, demonstrated a significant 5.4% improvement over the baseline algorithm. To validate the generalizability of the algorithm, experiments were conducted on the Mirco_COCO dataset, resulting in a notable 1.9% improvement compared to the baseline algorithm.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Real-Time Image Processing
Journal of Real-Time Image Processing COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
6.80
自引率
6.70%
发文量
68
审稿时长
6 months
期刊介绍: Due to rapid advancements in integrated circuit technology, the rich theoretical results that have been developed by the image and video processing research community are now being increasingly applied in practical systems to solve real-world image and video processing problems. Such systems involve constraints placed not only on their size, cost, and power consumption, but also on the timeliness of the image data processed. Examples of such systems are mobile phones, digital still/video/cell-phone cameras, portable media players, personal digital assistants, high-definition television, video surveillance systems, industrial visual inspection systems, medical imaging devices, vision-guided autonomous robots, spectral imaging systems, and many other real-time embedded systems. In these real-time systems, strict timing requirements demand that results are available within a certain interval of time as imposed by the application. It is often the case that an image processing algorithm is developed and proven theoretically sound, presumably with a specific application in mind, but its practical applications and the detailed steps, methodology, and trade-off analysis required to achieve its real-time performance are not fully explored, leaving these critical and usually non-trivial issues for those wishing to employ the algorithm in a real-time system. The Journal of Real-Time Image Processing is intended to bridge the gap between the theory and practice of image processing, serving the greater community of researchers, practicing engineers, and industrial professionals who deal with designing, implementing or utilizing image processing systems which must satisfy real-time design constraints.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信