FoggyFuse: Infrared and visible image fusion method based on saturation line prior in foggy conditions

IF 4.6 2区 物理与天体物理 Q1 OPTICS
Shengkun Wu , Hao Li , Lei Deng , Heng Yu , Hanrui Chen , Zhixiang Chen , Mingli Dong , Lianqing Zhu
{"title":"FoggyFuse: Infrared and visible image fusion method based on saturation line prior in foggy conditions","authors":"Shengkun Wu ,&nbsp;Hao Li ,&nbsp;Lei Deng ,&nbsp;Heng Yu ,&nbsp;Hanrui Chen ,&nbsp;Zhixiang Chen ,&nbsp;Mingli Dong ,&nbsp;Lianqing Zhu","doi":"10.1016/j.optlastec.2025.113075","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared and visible image fusion is widely used to enhance image details and information. However, in foggy environments or military smoke bomb scenarios, the scattering and absorption of light significantly degrade the quality of both infrared and visible images, leading to poor fusion performance. Existing fusion methods struggle to effectively restore degraded image details, making them unsuitable for practical applications in such adverse conditions. To address this challenge, we propose a novel fusion architecture based on the saturation line prior (SLP). This method consists of three main modules: the Dehazing Module (DM), the Auxiliary Enhancement Module (AEM), and the Edge Enhancement Module (EEM). The DM optimizes SLP using weighted guided filtering to obtain refined transmission maps for visible images, which are then used to further enhance the infrared image. The AEM and EEM, combined with a non-subsampled shearlet transform (NSST), further process the enhanced visible and infrared images. This approach effectively restores intricate details and achieves natural color reproduction in hazy environments, significantly improving the visual quality of fused images. Given the limited research in this area and the absence of relevant datasets, we constructed an infrared and visible image pair dataset, Foggy, specifically designed for foggy conditions. Qualitative and quantitative evaluations demonstrate that the proposed method outperforms state-of-the-art fusion techniques on the Foggy dataset.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"190 ","pages":"Article 113075"},"PeriodicalIF":4.6000,"publicationDate":"2025-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399225006668","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Infrared and visible image fusion is widely used to enhance image details and information. However, in foggy environments or military smoke bomb scenarios, the scattering and absorption of light significantly degrade the quality of both infrared and visible images, leading to poor fusion performance. Existing fusion methods struggle to effectively restore degraded image details, making them unsuitable for practical applications in such adverse conditions. To address this challenge, we propose a novel fusion architecture based on the saturation line prior (SLP). This method consists of three main modules: the Dehazing Module (DM), the Auxiliary Enhancement Module (AEM), and the Edge Enhancement Module (EEM). The DM optimizes SLP using weighted guided filtering to obtain refined transmission maps for visible images, which are then used to further enhance the infrared image. The AEM and EEM, combined with a non-subsampled shearlet transform (NSST), further process the enhanced visible and infrared images. This approach effectively restores intricate details and achieves natural color reproduction in hazy environments, significantly improving the visual quality of fused images. Given the limited research in this area and the absence of relevant datasets, we constructed an infrared and visible image pair dataset, Foggy, specifically designed for foggy conditions. Qualitative and quantitative evaluations demonstrate that the proposed method outperforms state-of-the-art fusion techniques on the Foggy dataset.
FoggyFuse:雾天条件下基于饱和度线先验的红外和可见光图像融合方法
红外和可见光图像融合被广泛用于增强图像的细节和信息。然而,在多雾环境或军用烟雾弹场景下,光的散射和吸收会显著降低红外和可见光图像的质量,导致融合性能不佳。现有的融合方法很难有效地恢复退化的图像细节,使得它们不适合在这种不利条件下的实际应用。为了解决这一挑战,我们提出了一种基于饱和线先验(SLP)的新型融合架构。该方法由三个主要模块组成:除雾模块(DM)、辅助增强模块(AEM)和边缘增强模块(EEM)。DM利用加权制导滤波对SLP进行优化,获得可见光图像的精细透射图,然后用于进一步增强红外图像。AEM和EEM结合非下采样shearlet变换(NSST)对增强后的可见光和红外图像进行进一步处理。该方法有效地还原了复杂的细节,实现了朦胧环境下的自然色彩再现,显著提高了融合图像的视觉质量。鉴于该领域的研究有限且缺乏相关数据集,我们构建了一个专门为大雾条件设计的红外和可见光图像对数据集fog。定性和定量评估表明,该方法在fog数据集上优于最先进的融合技术。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.50
自引率
10.00%
发文量
1060
审稿时长
3.4 months
期刊介绍: Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication. The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas: •development in all types of lasers •developments in optoelectronic devices and photonics •developments in new photonics and optical concepts •developments in conventional optics, optical instruments and components •techniques of optical metrology, including interferometry and optical fibre sensors •LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow •applications of lasers to materials processing, optical NDT display (including holography) and optical communication •research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume) •developments in optical computing and optical information processing •developments in new optical materials •developments in new optical characterization methods and techniques •developments in quantum optics •developments in light assisted micro and nanofabrication methods and techniques •developments in nanophotonics and biophotonics •developments in imaging processing and systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信