Yingying Ji , Kechen Song , Hongwei Wen , Xiaotong Xue , Yunhui Yan , Qinggang Meng
{"title":"无人机在智能交通中的应用:RGBT 图像特征注册与互补感知","authors":"Yingying Ji , Kechen Song , Hongwei Wen , Xiaotong Xue , Yunhui Yan , Qinggang Meng","doi":"10.1016/j.aei.2024.102953","DOIUrl":null,"url":null,"abstract":"<div><div>The flexibility of unmanned aerial vehicles (UAVs) has led to a wide range of applications in the field of intelligent traffic detection. In order to cope with the detection needs of various scenarios in all-weather, more and more attention has been focused on methods that incorporate RGB and thermal(T) images. The existing research focuses on manually registered RGBT image detection methods. However, for mobile devices such as UAVs, strict registration is almost impossible, and the detection performance of existing methods without registration is greatly reduced. In order to improve the efficiency, we consider the direct detection of unregistered raw images acquired by UAVs. Therefore, this paper introduces RGBT salient object detection and proposes a feature registration and complementary perception network (FRCPNet). To achieve accurate RGB-T SOD in the presence of misregistration issues, we progressively perform pixel-level alignment of multi-level features for each modality, while enhancing the semantic correlation between the two modalities. This is followed by complementary perception of global information, leading to improved detection performance. Experiments demonstrate that our proposed method is competitive with the current state-of-the-art methods on RGBT image pairs acquired in real scenes with large parallax. In addition, our method has application value in scenes such as automatic driving and intelligent monitoring in intelligent traffic. The source code will be published at <span><span>https://github.com/VDT-2048/FRCPNet</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"63 ","pages":"Article 102953"},"PeriodicalIF":8.0000,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"UAV applications in intelligent traffic: RGBT image feature registration and complementary perception\",\"authors\":\"Yingying Ji , Kechen Song , Hongwei Wen , Xiaotong Xue , Yunhui Yan , Qinggang Meng\",\"doi\":\"10.1016/j.aei.2024.102953\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The flexibility of unmanned aerial vehicles (UAVs) has led to a wide range of applications in the field of intelligent traffic detection. In order to cope with the detection needs of various scenarios in all-weather, more and more attention has been focused on methods that incorporate RGB and thermal(T) images. The existing research focuses on manually registered RGBT image detection methods. However, for mobile devices such as UAVs, strict registration is almost impossible, and the detection performance of existing methods without registration is greatly reduced. In order to improve the efficiency, we consider the direct detection of unregistered raw images acquired by UAVs. Therefore, this paper introduces RGBT salient object detection and proposes a feature registration and complementary perception network (FRCPNet). To achieve accurate RGB-T SOD in the presence of misregistration issues, we progressively perform pixel-level alignment of multi-level features for each modality, while enhancing the semantic correlation between the two modalities. This is followed by complementary perception of global information, leading to improved detection performance. Experiments demonstrate that our proposed method is competitive with the current state-of-the-art methods on RGBT image pairs acquired in real scenes with large parallax. In addition, our method has application value in scenes such as automatic driving and intelligent monitoring in intelligent traffic. The source code will be published at <span><span>https://github.com/VDT-2048/FRCPNet</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"63 \",\"pages\":\"Article 102953\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2024-11-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034624006049\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034624006049","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
UAV applications in intelligent traffic: RGBT image feature registration and complementary perception
The flexibility of unmanned aerial vehicles (UAVs) has led to a wide range of applications in the field of intelligent traffic detection. In order to cope with the detection needs of various scenarios in all-weather, more and more attention has been focused on methods that incorporate RGB and thermal(T) images. The existing research focuses on manually registered RGBT image detection methods. However, for mobile devices such as UAVs, strict registration is almost impossible, and the detection performance of existing methods without registration is greatly reduced. In order to improve the efficiency, we consider the direct detection of unregistered raw images acquired by UAVs. Therefore, this paper introduces RGBT salient object detection and proposes a feature registration and complementary perception network (FRCPNet). To achieve accurate RGB-T SOD in the presence of misregistration issues, we progressively perform pixel-level alignment of multi-level features for each modality, while enhancing the semantic correlation between the two modalities. This is followed by complementary perception of global information, leading to improved detection performance. Experiments demonstrate that our proposed method is competitive with the current state-of-the-art methods on RGBT image pairs acquired in real scenes with large parallax. In addition, our method has application value in scenes such as automatic driving and intelligent monitoring in intelligent traffic. The source code will be published at https://github.com/VDT-2048/FRCPNet.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.