Blind super-resolution reconstruction of infrared images based on dual-domain feature extraction

IF 3.5 2区 工程技术 Q2 OPTICS
Huizhou Liu, Kui Yuan, Bowen Shen, Wei Xing, Mengxing Huang
{"title":"Blind super-resolution reconstruction of infrared images based on dual-domain feature extraction","authors":"Huizhou Liu,&nbsp;Kui Yuan,&nbsp;Bowen Shen,&nbsp;Wei Xing,&nbsp;Mengxing Huang","doi":"10.1016/j.optlaseng.2025.109109","DOIUrl":null,"url":null,"abstract":"<div><div>Existing infrared image super-resolution (SR) reconstruction methods typically employ a single degradation model to characterize image degradation, which often fails to reconstruct high-quality clear images in real-world scenarios effectively. Compared to visible light images, infrared or infrared thermal imaging images have lower resolution, fewer textures and details, and are more susceptible to noise interference. To address the challenges associated with the reconstruction of infrared images under complex degradation conditions, this paper proposes a novel wavelet transform-based blind super-resolution network (WTB-Net). WTB-Net can effectively realize multi-type degenerate kernel estimation, alternating optimization, and subsequent super-resolution image reconstruction under a unified framework. Firstly, to better extract the feature and detailed features of infrared images, we designed a bi-domain feature extraction module (BDFE), which is composed of multi-scale frequency domain feature extraction blocks (FDB) and spatial domain feature extraction blocks (SDB). In addition, we propose an edge attention mechanism to improve the reconstruction of edges and details. The above features will be input into the restorer and estimator for multiple super-resolution reconstructions, and the reconstruction results will be applied to the estimation and updating of a multi-class degraded fuzzy kernel. Finally, with the input of the low-resolution (LR) image, the high-resolution (HR) image can be generated based on the degraded fuzzy kernel and reconstruction network to complete the blind super-resolution reconstruction process. The proposed method is systematically compared with both classical and common super-resolution reconstruction methods using the Airai Electro-Optics Database and the LLVIP Database. The qualitative and quantitative results consistently validate the effectiveness of WTB-Net.</div></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":"193 ","pages":"Article 109109"},"PeriodicalIF":3.5000,"publicationDate":"2025-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816625002945","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Existing infrared image super-resolution (SR) reconstruction methods typically employ a single degradation model to characterize image degradation, which often fails to reconstruct high-quality clear images in real-world scenarios effectively. Compared to visible light images, infrared or infrared thermal imaging images have lower resolution, fewer textures and details, and are more susceptible to noise interference. To address the challenges associated with the reconstruction of infrared images under complex degradation conditions, this paper proposes a novel wavelet transform-based blind super-resolution network (WTB-Net). WTB-Net can effectively realize multi-type degenerate kernel estimation, alternating optimization, and subsequent super-resolution image reconstruction under a unified framework. Firstly, to better extract the feature and detailed features of infrared images, we designed a bi-domain feature extraction module (BDFE), which is composed of multi-scale frequency domain feature extraction blocks (FDB) and spatial domain feature extraction blocks (SDB). In addition, we propose an edge attention mechanism to improve the reconstruction of edges and details. The above features will be input into the restorer and estimator for multiple super-resolution reconstructions, and the reconstruction results will be applied to the estimation and updating of a multi-class degraded fuzzy kernel. Finally, with the input of the low-resolution (LR) image, the high-resolution (HR) image can be generated based on the degraded fuzzy kernel and reconstruction network to complete the blind super-resolution reconstruction process. The proposed method is systematically compared with both classical and common super-resolution reconstruction methods using the Airai Electro-Optics Database and the LLVIP Database. The qualitative and quantitative results consistently validate the effectiveness of WTB-Net.
基于双域特征提取的红外图像盲超分辨重建
现有的红外图像超分辨率(SR)重建方法通常采用单一的退化模型来表征图像的退化,这往往不能有效地重建真实场景下的高质量清晰图像。与可见光图像相比,红外或红外热成像图像的分辨率较低,纹理和细节较少,并且更容易受到噪声干扰。针对复杂退化条件下红外图像的重建问题,提出了一种基于小波变换的盲超分辨网络(WTB-Net)。WTB-Net可以在统一的框架下有效地实现多类型退化核估计、交替优化以及后续的超分辨率图像重建。首先,为了更好地提取红外图像的特征和细节特征,设计了由多尺度频域特征提取块(FDB)和空间域特征提取块(SDB)组成的双域特征提取模块(BDFE)。此外,我们提出了一种边缘注意机制,以改善边缘和细节的重建。将上述特征输入到恢复器和估计器中进行多次超分辨率重建,将重建结果应用于多类退化模糊核的估计和更新。最后,以低分辨率(LR)图像为输入,基于退化模糊核和重建网络生成高分辨率(HR)图像,完成盲超分辨率重建过程。利用Airai光电数据库和LLVIP数据库,将该方法与经典和常用的超分辨率重建方法进行了系统比较。定性和定量结果一致地验证了WTB-Net的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Optics and Lasers in Engineering
Optics and Lasers in Engineering 工程技术-光学
CiteScore
8.90
自引率
8.70%
发文量
384
审稿时长
42 days
期刊介绍: Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods. Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following: -Optical Metrology- Optical Methods for 3D visualization and virtual engineering- Optical Techniques for Microsystems- Imaging, Microscopy and Adaptive Optics- Computational Imaging- Laser methods in manufacturing- Integrated optical and photonic sensors- Optics and Photonics in Life Science- Hyperspectral and spectroscopic methods- Infrared and Terahertz techniques
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信