基于改进生成对抗网络的红外与可见光图像融合

Shengchen Wang, Xisheng Li, Wenyu Huo, Jia You
{"title":"基于改进生成对抗网络的红外与可见光图像融合","authors":"Shengchen Wang, Xisheng Li, Wenyu Huo, Jia You","doi":"10.1109/ISPDS56360.2022.9874034","DOIUrl":null,"url":null,"abstract":"In order to improve the fusion quality of infrared and visible light images, enhance the visual effect of fused images, and solve the problems that traditional fusion methods need to manually set fusion rules and the background details of fused images are poorly preserved, this paper proposes an improved generative adversarial network that combines multi-scale information. The generator used in this method is a typical encoder and decoder structure, and the discriminator uses a dual discriminator to establish the confrontation relationship between the infrared source image, the visible light source image and the fusion image respectively. Before the source image is input to the encoder, multi-scale information is introduced through the Inception network, which effectively extracts the multi-scale features of the image, which ensures the subsequent improvement of the quality of the fusion image. In addition, the loss function is improved to retain more background details and highlight infrared feature information. The control experiment results show that the method in this paper obtains better fusion effect in subjective and objective evaluation.","PeriodicalId":280244,"journal":{"name":"2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS)","volume":"175 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Fusion of Infrared and Visible Images Based on Improved Generative Adversarial Networks\",\"authors\":\"Shengchen Wang, Xisheng Li, Wenyu Huo, Jia You\",\"doi\":\"10.1109/ISPDS56360.2022.9874034\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to improve the fusion quality of infrared and visible light images, enhance the visual effect of fused images, and solve the problems that traditional fusion methods need to manually set fusion rules and the background details of fused images are poorly preserved, this paper proposes an improved generative adversarial network that combines multi-scale information. The generator used in this method is a typical encoder and decoder structure, and the discriminator uses a dual discriminator to establish the confrontation relationship between the infrared source image, the visible light source image and the fusion image respectively. Before the source image is input to the encoder, multi-scale information is introduced through the Inception network, which effectively extracts the multi-scale features of the image, which ensures the subsequent improvement of the quality of the fusion image. In addition, the loss function is improved to retain more background details and highlight infrared feature information. The control experiment results show that the method in this paper obtains better fusion effect in subjective and objective evaluation.\",\"PeriodicalId\":280244,\"journal\":{\"name\":\"2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS)\",\"volume\":\"175 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-07-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISPDS56360.2022.9874034\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISPDS56360.2022.9874034","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了提高红外与可见光图像的融合质量,增强融合图像的视觉效果,解决传统融合方法需要手动设置融合规则以及融合图像背景细节保存较差的问题,本文提出了一种多尺度信息结合的改进生成对抗网络。该方法使用的发生器是典型的编码器和解码器结构,鉴别器采用双鉴别器分别建立红外源图像、可见光源图像和融合图像的对抗关系。在将源图像输入到编码器之前,通过Inception网络引入多尺度信息,有效地提取了图像的多尺度特征,保证了后续融合图像质量的提升。此外,改进了损失函数,保留了更多的背景细节,突出了红外特征信息。控制实验结果表明,本文方法在主客观评价方面取得了较好的融合效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Fusion of Infrared and Visible Images Based on Improved Generative Adversarial Networks
In order to improve the fusion quality of infrared and visible light images, enhance the visual effect of fused images, and solve the problems that traditional fusion methods need to manually set fusion rules and the background details of fused images are poorly preserved, this paper proposes an improved generative adversarial network that combines multi-scale information. The generator used in this method is a typical encoder and decoder structure, and the discriminator uses a dual discriminator to establish the confrontation relationship between the infrared source image, the visible light source image and the fusion image respectively. Before the source image is input to the encoder, multi-scale information is introduced through the Inception network, which effectively extracts the multi-scale features of the image, which ensures the subsequent improvement of the quality of the fusion image. In addition, the loss function is improved to retain more background details and highlight infrared feature information. The control experiment results show that the method in this paper obtains better fusion effect in subjective and objective evaluation.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信