基于梯度制导的高效盲超分辨率协同双分支网络

IF 5.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Haoran Yang;Shipeng Fu;Kai Liu;Xiaomin Yang
{"title":"基于梯度制导的高效盲超分辨率协同双分支网络","authors":"Haoran Yang;Shipeng Fu;Kai Liu;Xiaomin Yang","doi":"10.1109/TIM.2025.3573339","DOIUrl":null,"url":null,"abstract":"Existing degradation kernel-based image super-resolution (SR) algorithms have achieved favorable performance in blind SR measurement. This addresses the limitation where bicubic kernel-based SR methods suffer performance degradation when the input image’s degradation kernel deviates from the assumed kernel. However, predicting the degradation kernel demands additional computational resources beyond the SR model. Moreover, imprecise degradation kernel estimation often results in restored images with visible artifacts and distorted structural details. To mitigate the above limitations, we introduce an efficient collaborative dual-branch network via gradient guidance for blind SR measurement. Concretely, without relying on degradation kernel estimation, we utilize the gradient spatial feature transform (GSFT) layer to enable mutual collaboration between features extracted from the restored branch and gradient prior features. These gradient prior features effectively capture the structural details of the input low-resolution (LR) image. To reduce model complexity, we adopt an information distillation mechanism in both channel and spatial attention mechanisms as the feature extractor, allowing the network to focus on essential features while bypassing redundant ones. Furthermore, to thoroughly exploit degradation priors during training without kernel estimation, we introduce a calibration mechanism. In this mechanism, the studied LR image degraded from the SR image by using the degradation kernel prior, is aligned with the ground-truth LR image under the constraints of <inline-formula> <tex-math>$L1$ </tex-math></inline-formula> loss and a second-order gradient loss. Under this constraint, the SR image can be indirectly aligned with the high-resolution (HR) image. Extensive experimental results demonstrate that our network significantly economizes model parameters and computational costs by eliminating the degradation kernel estimation process. Meanwhile, it maintains competitive blind SR performance compared to other state-of-the-art (SOTA) methods.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-15"},"PeriodicalIF":5.6000,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"CDBGrad-BlindSR: Collaborative Dual-Branch Network via Gradient Guidance for Efficient Blind Super Resolution\",\"authors\":\"Haoran Yang;Shipeng Fu;Kai Liu;Xiaomin Yang\",\"doi\":\"10.1109/TIM.2025.3573339\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Existing degradation kernel-based image super-resolution (SR) algorithms have achieved favorable performance in blind SR measurement. This addresses the limitation where bicubic kernel-based SR methods suffer performance degradation when the input image’s degradation kernel deviates from the assumed kernel. However, predicting the degradation kernel demands additional computational resources beyond the SR model. Moreover, imprecise degradation kernel estimation often results in restored images with visible artifacts and distorted structural details. To mitigate the above limitations, we introduce an efficient collaborative dual-branch network via gradient guidance for blind SR measurement. Concretely, without relying on degradation kernel estimation, we utilize the gradient spatial feature transform (GSFT) layer to enable mutual collaboration between features extracted from the restored branch and gradient prior features. These gradient prior features effectively capture the structural details of the input low-resolution (LR) image. To reduce model complexity, we adopt an information distillation mechanism in both channel and spatial attention mechanisms as the feature extractor, allowing the network to focus on essential features while bypassing redundant ones. Furthermore, to thoroughly exploit degradation priors during training without kernel estimation, we introduce a calibration mechanism. In this mechanism, the studied LR image degraded from the SR image by using the degradation kernel prior, is aligned with the ground-truth LR image under the constraints of <inline-formula> <tex-math>$L1$ </tex-math></inline-formula> loss and a second-order gradient loss. Under this constraint, the SR image can be indirectly aligned with the high-resolution (HR) image. Extensive experimental results demonstrate that our network significantly economizes model parameters and computational costs by eliminating the degradation kernel estimation process. Meanwhile, it maintains competitive blind SR performance compared to other state-of-the-art (SOTA) methods.\",\"PeriodicalId\":13341,\"journal\":{\"name\":\"IEEE Transactions on Instrumentation and Measurement\",\"volume\":\"74 \",\"pages\":\"1-15\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2025-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Instrumentation and Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11018875/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11018875/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

现有的基于退化核的图像超分辨率(SR)算法在盲测量中取得了较好的效果。这解决了基于双三次核的SR方法在输入图像的退化核偏离假设核时遭受性能下降的限制。然而,预测退化核需要超出SR模型的额外计算资源。此外,不精确的退化核估计往往导致恢复图像具有可见的伪影和扭曲的结构细节。为了消除上述限制,我们引入了一种基于梯度制导的高效协同双分支网络,用于盲SR测量。具体而言,在不依赖退化核估计的情况下,利用梯度空间特征变换(GSFT)层实现从恢复的分支中提取的特征与梯度先验特征之间的相互协作。这些梯度先验特征有效地捕获了输入低分辨率(LR)图像的结构细节。为了降低模型的复杂性,我们在通道和空间注意机制中都采用了信息蒸馏机制作为特征提取器,使网络能够专注于基本特征而绕过冗余特征。此外,为了在没有核估计的情况下充分利用训练过程中的退化先验,我们引入了校准机制。在该机制下,研究的LR图像在L1损失和二阶梯度损失的约束下,使用退化核先验对SR图像进行退化,并与真地LR图像对齐。在此约束下,SR图像可以与高分辨率(HR)图像间接对齐。大量的实验结果表明,我们的网络通过消除退化核估计过程,显著节约了模型参数和计算成本。同时,与其他最先进的(SOTA)方法相比,它保持了具有竞争力的盲SR性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
CDBGrad-BlindSR: Collaborative Dual-Branch Network via Gradient Guidance for Efficient Blind Super Resolution
Existing degradation kernel-based image super-resolution (SR) algorithms have achieved favorable performance in blind SR measurement. This addresses the limitation where bicubic kernel-based SR methods suffer performance degradation when the input image’s degradation kernel deviates from the assumed kernel. However, predicting the degradation kernel demands additional computational resources beyond the SR model. Moreover, imprecise degradation kernel estimation often results in restored images with visible artifacts and distorted structural details. To mitigate the above limitations, we introduce an efficient collaborative dual-branch network via gradient guidance for blind SR measurement. Concretely, without relying on degradation kernel estimation, we utilize the gradient spatial feature transform (GSFT) layer to enable mutual collaboration between features extracted from the restored branch and gradient prior features. These gradient prior features effectively capture the structural details of the input low-resolution (LR) image. To reduce model complexity, we adopt an information distillation mechanism in both channel and spatial attention mechanisms as the feature extractor, allowing the network to focus on essential features while bypassing redundant ones. Furthermore, to thoroughly exploit degradation priors during training without kernel estimation, we introduce a calibration mechanism. In this mechanism, the studied LR image degraded from the SR image by using the degradation kernel prior, is aligned with the ground-truth LR image under the constraints of $L1$ loss and a second-order gradient loss. Under this constraint, the SR image can be indirectly aligned with the high-resolution (HR) image. Extensive experimental results demonstrate that our network significantly economizes model parameters and computational costs by eliminating the degradation kernel estimation process. Meanwhile, it maintains competitive blind SR performance compared to other state-of-the-art (SOTA) methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Instrumentation and Measurement
IEEE Transactions on Instrumentation and Measurement 工程技术-工程:电子与电气
CiteScore
9.00
自引率
23.20%
发文量
1294
审稿时长
3.9 months
期刊介绍: Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信