基于分裂的图像超分辨率反馈网络

Hongyang Zhou, Yi Ma, Yan Ma, Xiaobin Zhu
{"title":"基于分裂的图像超分辨率反馈网络","authors":"Hongyang Zhou, Yi Ma, Yan Ma, Xiaobin Zhu","doi":"10.1109/CoST57098.2022.00015","DOIUrl":null,"url":null,"abstract":"Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.","PeriodicalId":135595,"journal":{"name":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Split-based Feedback Network for Image Super-Resolution\",\"authors\":\"Hongyang Zhou, Yi Ma, Yan Ma, Xiaobin Zhu\",\"doi\":\"10.1109/CoST57098.2022.00015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.\",\"PeriodicalId\":135595,\"journal\":{\"name\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"volume\":\"54 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CoST57098.2022.00015\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CoST57098.2022.00015","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

大多数现有的图像超分辨率方法都取得了优异的性能。然而,通常用于高级任务的对比学习在现有的基于深度学习的图像SR方法中尚未得到充分利用。在本文中,我们提出了一种基于图像超分辨率网络的反馈机制来学习抽象表示,以探索表示空间中的高信息。具体来说,我们首先利用RNN中的隐藏状态和约束来实现反馈网络。然后,采用对比学习进行表征学习,将最终SR图像拉入高分辨率图像,再将最终SR图像推入中间图像。此外,我们引入了基于分裂的反馈块(SPFB)来减少推理加速模型的冗余,其中容忍特征具有相似的模式,但需要较少的计算。大量的实验结果证明了该方法与现有方法相比的优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Split-based Feedback Network for Image Super-Resolution
Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信