Kewei Liu , Dongliang Peng , Tao Li , Yu Gu , Huajie Chen
{"title":"基于空间相关关注的红外与可见光图像融合","authors":"Kewei Liu , Dongliang Peng , Tao Li , Yu Gu , Huajie Chen","doi":"10.1016/j.infrared.2025.105985","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared and visible image fusion plays a crucial role in enhancing scene understanding and improving the detection performance of infrared imaging systems. One major challenge in image fusion is the loss of fine-grained details from the source images during the fusion process. To tackle this issue, we introduce IVFSCA—an image fusion method based on spatially correlated attention. Specifically, we design a spatial correlation attention mechanism to preserve spatial dependencies during feature extraction and fusion. This helps reduce the loss of fine-grained information. We further develop a multi-source feature fusion network with a cross-residual structure that effectively integrates multi-scale features from infrared and visible images, producing high-quality and robust fusion representations. A structurally symmetric encoder–decoder architecture is also adopted to improve the robustness of feature extraction and image reconstruction. Extensive experiments on public benchmark datasets demonstrate that the proposed IVFSCA achieves competitive performance compared to state-of-the-art fusion methods in both visual quality and quantitative metrics.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"150 ","pages":"Article 105985"},"PeriodicalIF":3.1000,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Infrared and visible image fusion based on spatial correlation attention\",\"authors\":\"Kewei Liu , Dongliang Peng , Tao Li , Yu Gu , Huajie Chen\",\"doi\":\"10.1016/j.infrared.2025.105985\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Infrared and visible image fusion plays a crucial role in enhancing scene understanding and improving the detection performance of infrared imaging systems. One major challenge in image fusion is the loss of fine-grained details from the source images during the fusion process. To tackle this issue, we introduce IVFSCA—an image fusion method based on spatially correlated attention. Specifically, we design a spatial correlation attention mechanism to preserve spatial dependencies during feature extraction and fusion. This helps reduce the loss of fine-grained information. We further develop a multi-source feature fusion network with a cross-residual structure that effectively integrates multi-scale features from infrared and visible images, producing high-quality and robust fusion representations. A structurally symmetric encoder–decoder architecture is also adopted to improve the robustness of feature extraction and image reconstruction. Extensive experiments on public benchmark datasets demonstrate that the proposed IVFSCA achieves competitive performance compared to state-of-the-art fusion methods in both visual quality and quantitative metrics.</div></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"150 \",\"pages\":\"Article 105985\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449525002786\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449525002786","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
Infrared and visible image fusion based on spatial correlation attention
Infrared and visible image fusion plays a crucial role in enhancing scene understanding and improving the detection performance of infrared imaging systems. One major challenge in image fusion is the loss of fine-grained details from the source images during the fusion process. To tackle this issue, we introduce IVFSCA—an image fusion method based on spatially correlated attention. Specifically, we design a spatial correlation attention mechanism to preserve spatial dependencies during feature extraction and fusion. This helps reduce the loss of fine-grained information. We further develop a multi-source feature fusion network with a cross-residual structure that effectively integrates multi-scale features from infrared and visible images, producing high-quality and robust fusion representations. A structurally symmetric encoder–decoder architecture is also adopted to improve the robustness of feature extraction and image reconstruction. Extensive experiments on public benchmark datasets demonstrate that the proposed IVFSCA achieves competitive performance compared to state-of-the-art fusion methods in both visual quality and quantitative metrics.
期刊介绍:
The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region.
Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine.
Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.