{"title":"基于生成对抗网络的红外与可见光图像融合算法","authors":"Wencheng Zhuang, Xiaona Tang, Binquan Zhang, Guangming Yuan","doi":"10.1109/AEMCSE55572.2022.00113","DOIUrl":null,"url":null,"abstract":"Visible images have good contour and texture information, while infrared images have the advantage of working in all weather. Therefore, for the detection and analysis of targets in low illumination at night, the information from visible and infrared images can be fused to improve the detection accuracy and anti-interference capability of detection systems for nighttime targets. In this paper, we propose a generative adversarial network-based fusion algorithm for IR and visible images, which can effectively extract the feature information of IR and visible images by adversarial training of two discriminators and generators, improve the feature extraction ability and the quality of fused images by introducing attention mechanism and structural similarity loss function, and enhance the stability of network training by TTUR. The experimental results show that the algorithm in this paper outperforms other typical algorithms in both subjective and objective evaluations.","PeriodicalId":309096,"journal":{"name":"2022 5th International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE)","volume":"86 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Infrared and visible image fusion algorithms based on generative adversarial networks\",\"authors\":\"Wencheng Zhuang, Xiaona Tang, Binquan Zhang, Guangming Yuan\",\"doi\":\"10.1109/AEMCSE55572.2022.00113\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Visible images have good contour and texture information, while infrared images have the advantage of working in all weather. Therefore, for the detection and analysis of targets in low illumination at night, the information from visible and infrared images can be fused to improve the detection accuracy and anti-interference capability of detection systems for nighttime targets. In this paper, we propose a generative adversarial network-based fusion algorithm for IR and visible images, which can effectively extract the feature information of IR and visible images by adversarial training of two discriminators and generators, improve the feature extraction ability and the quality of fused images by introducing attention mechanism and structural similarity loss function, and enhance the stability of network training by TTUR. The experimental results show that the algorithm in this paper outperforms other typical algorithms in both subjective and objective evaluations.\",\"PeriodicalId\":309096,\"journal\":{\"name\":\"2022 5th International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE)\",\"volume\":\"86 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 5th International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AEMCSE55572.2022.00113\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 5th International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AEMCSE55572.2022.00113","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Infrared and visible image fusion algorithms based on generative adversarial networks
Visible images have good contour and texture information, while infrared images have the advantage of working in all weather. Therefore, for the detection and analysis of targets in low illumination at night, the information from visible and infrared images can be fused to improve the detection accuracy and anti-interference capability of detection systems for nighttime targets. In this paper, we propose a generative adversarial network-based fusion algorithm for IR and visible images, which can effectively extract the feature information of IR and visible images by adversarial training of two discriminators and generators, improve the feature extraction ability and the quality of fused images by introducing attention mechanism and structural similarity loss function, and enhance the stability of network training by TTUR. The experimental results show that the algorithm in this paper outperforms other typical algorithms in both subjective and objective evaluations.