Infrared and visible image fusion based on spatial correlation attention

IF 3.1 3区 物理与天体物理 Q2 INSTRUMENTS & INSTRUMENTATION
Kewei Liu , Dongliang Peng , Tao Li , Yu Gu , Huajie Chen
{"title":"Infrared and visible image fusion based on spatial correlation attention","authors":"Kewei Liu ,&nbsp;Dongliang Peng ,&nbsp;Tao Li ,&nbsp;Yu Gu ,&nbsp;Huajie Chen","doi":"10.1016/j.infrared.2025.105985","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared and visible image fusion plays a crucial role in enhancing scene understanding and improving the detection performance of infrared imaging systems. One major challenge in image fusion is the loss of fine-grained details from the source images during the fusion process. To tackle this issue, we introduce IVFSCA—an image fusion method based on spatially correlated attention. Specifically, we design a spatial correlation attention mechanism to preserve spatial dependencies during feature extraction and fusion. This helps reduce the loss of fine-grained information. We further develop a multi-source feature fusion network with a cross-residual structure that effectively integrates multi-scale features from infrared and visible images, producing high-quality and robust fusion representations. A structurally symmetric encoder–decoder architecture is also adopted to improve the robustness of feature extraction and image reconstruction. Extensive experiments on public benchmark datasets demonstrate that the proposed IVFSCA achieves competitive performance compared to state-of-the-art fusion methods in both visual quality and quantitative metrics.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"150 ","pages":"Article 105985"},"PeriodicalIF":3.1000,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449525002786","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0

Abstract

Infrared and visible image fusion plays a crucial role in enhancing scene understanding and improving the detection performance of infrared imaging systems. One major challenge in image fusion is the loss of fine-grained details from the source images during the fusion process. To tackle this issue, we introduce IVFSCA—an image fusion method based on spatially correlated attention. Specifically, we design a spatial correlation attention mechanism to preserve spatial dependencies during feature extraction and fusion. This helps reduce the loss of fine-grained information. We further develop a multi-source feature fusion network with a cross-residual structure that effectively integrates multi-scale features from infrared and visible images, producing high-quality and robust fusion representations. A structurally symmetric encoder–decoder architecture is also adopted to improve the robustness of feature extraction and image reconstruction. Extensive experiments on public benchmark datasets demonstrate that the proposed IVFSCA achieves competitive performance compared to state-of-the-art fusion methods in both visual quality and quantitative metrics.
基于空间相关关注的红外与可见光图像融合
红外图像与可见光图像融合对于增强红外成像系统的场景理解能力和提高红外成像系统的检测性能具有至关重要的作用。图像融合的一个主要挑战是在融合过程中丢失源图像的细粒度细节。为了解决这一问题,我们引入了一种基于空间相关注意力的图像融合方法——ivfsca。具体而言,我们设计了一种空间相关注意机制,以保持特征提取和融合过程中的空间依赖性。这有助于减少细粒度信息的丢失。我们进一步开发了一种具有交叉残差结构的多源特征融合网络,该网络有效地集成了来自红外和可见光图像的多尺度特征,产生了高质量和鲁棒的融合表示。采用结构对称的编码器-解码器结构,提高了特征提取和图像重建的鲁棒性。在公共基准数据集上进行的大量实验表明,与最先进的融合方法相比,所提出的IVFSCA在视觉质量和定量指标方面都具有竞争力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.70
自引率
12.10%
发文量
400
审稿时长
67 days
期刊介绍: The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region. Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine. Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信