Zhang Xiong, Xiaohui Zhang, Qingping Hu, Hongwei Han
{"title":"RepVGGFuse:一种基于RepVGG架构的红外与可见光图像融合网络方法","authors":"Zhang Xiong, Xiaohui Zhang, Qingping Hu, Hongwei Han","doi":"10.1145/3603781.3603847","DOIUrl":null,"url":null,"abstract":"In this paper, we propose an infrared and visible image fusion network based on RepVGG architecture. This network adopts an encoder-decoder structure. The encoding network, which contains five RepVGG blocks, is utilized to extract deep features of infrared and visible images. Each layer of RepVGG blocks is constructed with 3x3, 1x1 and identity branches while training and converted to single-branch architecture constructed with 3x3 convolutional layers while inferring. These extracted features are added and the fusion image is reconstructed by the decoding network. The proposed method was compared with seven fusion methods and the result shows that the proposed fusion method can retain more contour and texture information with less noise. The proposed method is superior to the comparison methods. The code of the proposed fusion network is available at https://github.com/xiongzhangzzz/repvggfuse.","PeriodicalId":391180,"journal":{"name":"Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"RepVGGFuse: an approach for infrared and visible image fusion network based on RepVGG architecture\",\"authors\":\"Zhang Xiong, Xiaohui Zhang, Qingping Hu, Hongwei Han\",\"doi\":\"10.1145/3603781.3603847\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we propose an infrared and visible image fusion network based on RepVGG architecture. This network adopts an encoder-decoder structure. The encoding network, which contains five RepVGG blocks, is utilized to extract deep features of infrared and visible images. Each layer of RepVGG blocks is constructed with 3x3, 1x1 and identity branches while training and converted to single-branch architecture constructed with 3x3 convolutional layers while inferring. These extracted features are added and the fusion image is reconstructed by the decoding network. The proposed method was compared with seven fusion methods and the result shows that the proposed fusion method can retain more contour and texture information with less noise. The proposed method is superior to the comparison methods. The code of the proposed fusion network is available at https://github.com/xiongzhangzzz/repvggfuse.\",\"PeriodicalId\":391180,\"journal\":{\"name\":\"Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things\",\"volume\":\"9 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3603781.3603847\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3603781.3603847","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
RepVGGFuse: an approach for infrared and visible image fusion network based on RepVGG architecture
In this paper, we propose an infrared and visible image fusion network based on RepVGG architecture. This network adopts an encoder-decoder structure. The encoding network, which contains five RepVGG blocks, is utilized to extract deep features of infrared and visible images. Each layer of RepVGG blocks is constructed with 3x3, 1x1 and identity branches while training and converted to single-branch architecture constructed with 3x3 convolutional layers while inferring. These extracted features are added and the fusion image is reconstructed by the decoding network. The proposed method was compared with seven fusion methods and the result shows that the proposed fusion method can retain more contour and texture information with less noise. The proposed method is superior to the comparison methods. The code of the proposed fusion network is available at https://github.com/xiongzhangzzz/repvggfuse.