Mi Wen , ChenYang Li , YunSheng Xue , Man Xu , ZengHui Xi , WeiDong Qiu
{"title":"YOFIR:基于 YOLO 和 FasterNet 的高精度红外物体检测算法","authors":"Mi Wen , ChenYang Li , YunSheng Xue , Man Xu , ZengHui Xi , WeiDong Qiu","doi":"10.1016/j.infrared.2024.105627","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared images often suffer from issues such as blurriness and unclear object boundaries, and existing object detection algorithms are developed based on visible light images, which makes infrared object detection more challenging. Therefore, this paper proposes an infrared image enhancement method and an infrared object detection algorithm based on YOLO and FasterNet, named YOFIR. Specifically, we apply CHALE, Auto Gamma, histogram equalization, and bilateral filtering to process images individually, then fuse the results with different weights to address the poor imaging quality of infrared images. Moreover, we utilize the FasterNet network for multi-scale feature extraction to adapt to low-resolution infrared images. We also reduce model parameters through GSConv and propose a novel Efficient Multi-Scale Group Convolution module, EMSGC, which enhances feature fusion by processing feature maps from different channels, effectively improving detection accuracy. Finally, the DyHead Block is incorporated into the head to enhance the capability of infrared object detection. Experimental results on the HIT-UAV infrared remote sensing dataset show that the proposed algorithm achieves a 4% improvement in <span><math><mrow><mi>m</mi><mi>A</mi><msub><mrow><mi>P</mi></mrow><mrow><mn>0</mn><mo>.</mo><mn>5</mn></mrow></msub></mrow></math></span> compared to YOLOv8. Moreover, on the FLIR dataset, the algorithm shows a 1.6% improvement in <span><math><mrow><mi>m</mi><mi>A</mi><msub><mrow><mi>P</mi></mrow><mrow><mn>0</mn><mo>.</mo><mn>95</mn></mrow></msub></mrow></math></span> over YOLOv8, with significant advantages in terms of model parameters and FLOPs.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"144 ","pages":"Article 105627"},"PeriodicalIF":3.1000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"YOFIR: High precise infrared object detection algorithm based on YOLO and FasterNet\",\"authors\":\"Mi Wen , ChenYang Li , YunSheng Xue , Man Xu , ZengHui Xi , WeiDong Qiu\",\"doi\":\"10.1016/j.infrared.2024.105627\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Infrared images often suffer from issues such as blurriness and unclear object boundaries, and existing object detection algorithms are developed based on visible light images, which makes infrared object detection more challenging. Therefore, this paper proposes an infrared image enhancement method and an infrared object detection algorithm based on YOLO and FasterNet, named YOFIR. Specifically, we apply CHALE, Auto Gamma, histogram equalization, and bilateral filtering to process images individually, then fuse the results with different weights to address the poor imaging quality of infrared images. Moreover, we utilize the FasterNet network for multi-scale feature extraction to adapt to low-resolution infrared images. We also reduce model parameters through GSConv and propose a novel Efficient Multi-Scale Group Convolution module, EMSGC, which enhances feature fusion by processing feature maps from different channels, effectively improving detection accuracy. Finally, the DyHead Block is incorporated into the head to enhance the capability of infrared object detection. Experimental results on the HIT-UAV infrared remote sensing dataset show that the proposed algorithm achieves a 4% improvement in <span><math><mrow><mi>m</mi><mi>A</mi><msub><mrow><mi>P</mi></mrow><mrow><mn>0</mn><mo>.</mo><mn>5</mn></mrow></msub></mrow></math></span> compared to YOLOv8. Moreover, on the FLIR dataset, the algorithm shows a 1.6% improvement in <span><math><mrow><mi>m</mi><mi>A</mi><msub><mrow><mi>P</mi></mrow><mrow><mn>0</mn><mo>.</mo><mn>95</mn></mrow></msub></mrow></math></span> over YOLOv8, with significant advantages in terms of model parameters and FLOPs.</div></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"144 \",\"pages\":\"Article 105627\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449524005115\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449524005115","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
YOFIR: High precise infrared object detection algorithm based on YOLO and FasterNet
Infrared images often suffer from issues such as blurriness and unclear object boundaries, and existing object detection algorithms are developed based on visible light images, which makes infrared object detection more challenging. Therefore, this paper proposes an infrared image enhancement method and an infrared object detection algorithm based on YOLO and FasterNet, named YOFIR. Specifically, we apply CHALE, Auto Gamma, histogram equalization, and bilateral filtering to process images individually, then fuse the results with different weights to address the poor imaging quality of infrared images. Moreover, we utilize the FasterNet network for multi-scale feature extraction to adapt to low-resolution infrared images. We also reduce model parameters through GSConv and propose a novel Efficient Multi-Scale Group Convolution module, EMSGC, which enhances feature fusion by processing feature maps from different channels, effectively improving detection accuracy. Finally, the DyHead Block is incorporated into the head to enhance the capability of infrared object detection. Experimental results on the HIT-UAV infrared remote sensing dataset show that the proposed algorithm achieves a 4% improvement in compared to YOLOv8. Moreover, on the FLIR dataset, the algorithm shows a 1.6% improvement in over YOLOv8, with significant advantages in terms of model parameters and FLOPs.
期刊介绍:
The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region.
Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine.
Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.