Multi-scale large receptive field feature distillation network for lightweight infrared image super-resolution

IF 4.6 2区 物理与天体物理 Q1 OPTICS
Yuchen Bai, Lianqing Zhu, Yichen Sun, Mingli Dong, Mingxing Yu
{"title":"Multi-scale large receptive field feature distillation network for lightweight infrared image super-resolution","authors":"Yuchen Bai,&nbsp;Lianqing Zhu,&nbsp;Yichen Sun,&nbsp;Mingli Dong,&nbsp;Mingxing Yu","doi":"10.1016/j.optlastec.2025.112814","DOIUrl":null,"url":null,"abstract":"<div><div>Infrared imaging plays a pivotal role in applications such as remote sensing, unmanned aerial vehicles, and security surveillance. However, current infrared detectors have low resolution, and improving resolution from the hardware perspective is expensive. To address issues such as low resolution and significant loss of high-frequency information in infrared images, this study introduces a lightweight neural network model. Compared to existing super-resolution models, the proposed model exhibits lower complexity and is convenient for edge deployment, enabling real-time processing which extends the application scope of infrared imaging. This approach employs a novel architecture specially designed for the characteristics of infrared data, which significantly enhances the image clarity with a minimal increase in parameters, thereby making it suitable for resource-constrained real-time applications. Specifically, we design a lightweight multi-scale feature extraction module that utilizes group convolutions with varying kernel sizes across groups to realize efficient feature extraction. In addition, we introduce a multi-scale feature fusion module that adaptively integrates features harvested from preceding layers. To enhance the network’s ability to learn high-frequency information, we added a Fourier transform branch to the network and incorporated a frequency loss function into the loss function. Extensive experimental results demonstrate that our proposed approach achieves superior performance with fewer parameters compared to existing lightweight super-resolution methods. Our code is available at <span><span>https://github.com/clelevo/MSLRSR</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"188 ","pages":"Article 112814"},"PeriodicalIF":4.6000,"publicationDate":"2025-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399225004050","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Infrared imaging plays a pivotal role in applications such as remote sensing, unmanned aerial vehicles, and security surveillance. However, current infrared detectors have low resolution, and improving resolution from the hardware perspective is expensive. To address issues such as low resolution and significant loss of high-frequency information in infrared images, this study introduces a lightweight neural network model. Compared to existing super-resolution models, the proposed model exhibits lower complexity and is convenient for edge deployment, enabling real-time processing which extends the application scope of infrared imaging. This approach employs a novel architecture specially designed for the characteristics of infrared data, which significantly enhances the image clarity with a minimal increase in parameters, thereby making it suitable for resource-constrained real-time applications. Specifically, we design a lightweight multi-scale feature extraction module that utilizes group convolutions with varying kernel sizes across groups to realize efficient feature extraction. In addition, we introduce a multi-scale feature fusion module that adaptively integrates features harvested from preceding layers. To enhance the network’s ability to learn high-frequency information, we added a Fourier transform branch to the network and incorporated a frequency loss function into the loss function. Extensive experimental results demonstrate that our proposed approach achieves superior performance with fewer parameters compared to existing lightweight super-resolution methods. Our code is available at https://github.com/clelevo/MSLRSR.
面向轻量红外图像超分辨率的多尺度大感受野特征蒸馏网络
红外成像在遥感、无人驾驶飞行器和安全监控等应用中发挥着举足轻重的作用。然而,目前的红外探测器分辨率较低,而且从硬件角度提高分辨率成本高昂。为了解决红外图像分辨率低、高频信息丢失严重等问题,本研究引入了一种轻量级神经网络模型。与现有的超分辨率模型相比,该模型的复杂度更低,便于边缘部署,可进行实时处理,从而扩展了红外成像的应用范围。这种方法采用了专门针对红外数据特性设计的新型架构,只需增加极少的参数就能显著提高图像的清晰度,因此适用于资源受限的实时应用。具体来说,我们设计了一个轻量级的多尺度特征提取模块,该模块利用各组不同内核大小的组卷积来实现高效的特征提取。此外,我们还引入了一个多尺度特征融合模块,它能自适应地整合从前面各层获取的特征。为了增强网络学习高频信息的能力,我们在网络中加入了傅立叶变换分支,并在损失函数中加入了频率损失函数。广泛的实验结果表明,与现有的轻量级超分辨率方法相比,我们提出的方法只需较少的参数就能实现卓越的性能。我们的代码见 https://github.com/clelevo/MSLRSR。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.50
自引率
10.00%
发文量
1060
审稿时长
3.4 months
期刊介绍: Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication. The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas: •development in all types of lasers •developments in optoelectronic devices and photonics •developments in new photonics and optical concepts •developments in conventional optics, optical instruments and components •techniques of optical metrology, including interferometry and optical fibre sensors •LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow •applications of lasers to materials processing, optical NDT display (including holography) and optical communication •research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume) •developments in optical computing and optical information processing •developments in new optical materials •developments in new optical characterization methods and techniques •developments in quantum optics •developments in light assisted micro and nanofabrication methods and techniques •developments in nanophotonics and biophotonics •developments in imaging processing and systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信