{"title":"YOLO-SGF:基于改进型 YOLOv8 的用于复杂红外图像中物体检测的轻量级网络","authors":"Cong Guo, Kan Ren, Qian Chen","doi":"10.1016/j.infrared.2024.105539","DOIUrl":null,"url":null,"abstract":"<div><p>The current mainstream object detection networks perform well in RGB visible images, but they require high computational resource and degrade in performance when applied to low-resolution infrared images. To address above issues, we propose a lightweight algorithm YOLO-SGF based on you-only-look-once version8 (YOLOv8). Firstly, the lightweight cross-scale feature map fusion network GCFVoV designed as neck to solve poor detection accuracy and maintain low complexity in lightweight networks. And a lightweight GCVF module in GCFVoV neck uses GSConv and Conv to process deep and shallow features respectively, which maximally preserves implicit connections between each channel and integrates multi-scale features. Secondly, we utilize ShuffleNetV2-block1 in combination with C2f for feature extraction, making the algorithm more lightweight and effectively. Finally, we propose the FIMPDIoU loss function, which focuses on overlooked objects in complex backgrounds and adjusts the prediction boxes using ratios specific to different sizes of objects. Compared with YOLOv8 in our infrared dataset, YOLO-SGF reduces the computational space complexity by 50 % and time complexity by 42 %, increases FPS<sub>32</sub> by 36.3 % and improves [email protected] ∼ 0.95 by 1.1 % in object detection. Our algorithm enhances the capability of object detection in infrared images especially in nighttime, low light, and occluded conditions. YOLO-SGF enables deployment on embedded edge devices with limited computing power, and provides a new idea for lightweight networks.</p></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"142 ","pages":"Article 105539"},"PeriodicalIF":3.1000,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"YOLO-SGF: Lightweight network for object detection in complex infrared images based on improved YOLOv8\",\"authors\":\"Cong Guo, Kan Ren, Qian Chen\",\"doi\":\"10.1016/j.infrared.2024.105539\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The current mainstream object detection networks perform well in RGB visible images, but they require high computational resource and degrade in performance when applied to low-resolution infrared images. To address above issues, we propose a lightweight algorithm YOLO-SGF based on you-only-look-once version8 (YOLOv8). Firstly, the lightweight cross-scale feature map fusion network GCFVoV designed as neck to solve poor detection accuracy and maintain low complexity in lightweight networks. And a lightweight GCVF module in GCFVoV neck uses GSConv and Conv to process deep and shallow features respectively, which maximally preserves implicit connections between each channel and integrates multi-scale features. Secondly, we utilize ShuffleNetV2-block1 in combination with C2f for feature extraction, making the algorithm more lightweight and effectively. Finally, we propose the FIMPDIoU loss function, which focuses on overlooked objects in complex backgrounds and adjusts the prediction boxes using ratios specific to different sizes of objects. Compared with YOLOv8 in our infrared dataset, YOLO-SGF reduces the computational space complexity by 50 % and time complexity by 42 %, increases FPS<sub>32</sub> by 36.3 % and improves [email protected] ∼ 0.95 by 1.1 % in object detection. Our algorithm enhances the capability of object detection in infrared images especially in nighttime, low light, and occluded conditions. YOLO-SGF enables deployment on embedded edge devices with limited computing power, and provides a new idea for lightweight networks.</p></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"142 \",\"pages\":\"Article 105539\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-08-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449524004237\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449524004237","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
YOLO-SGF: Lightweight network for object detection in complex infrared images based on improved YOLOv8
The current mainstream object detection networks perform well in RGB visible images, but they require high computational resource and degrade in performance when applied to low-resolution infrared images. To address above issues, we propose a lightweight algorithm YOLO-SGF based on you-only-look-once version8 (YOLOv8). Firstly, the lightweight cross-scale feature map fusion network GCFVoV designed as neck to solve poor detection accuracy and maintain low complexity in lightweight networks. And a lightweight GCVF module in GCFVoV neck uses GSConv and Conv to process deep and shallow features respectively, which maximally preserves implicit connections between each channel and integrates multi-scale features. Secondly, we utilize ShuffleNetV2-block1 in combination with C2f for feature extraction, making the algorithm more lightweight and effectively. Finally, we propose the FIMPDIoU loss function, which focuses on overlooked objects in complex backgrounds and adjusts the prediction boxes using ratios specific to different sizes of objects. Compared with YOLOv8 in our infrared dataset, YOLO-SGF reduces the computational space complexity by 50 % and time complexity by 42 %, increases FPS32 by 36.3 % and improves [email protected] ∼ 0.95 by 1.1 % in object detection. Our algorithm enhances the capability of object detection in infrared images especially in nighttime, low light, and occluded conditions. YOLO-SGF enables deployment on embedded edge devices with limited computing power, and provides a new idea for lightweight networks.
期刊介绍:
The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region.
Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine.
Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.