{"title":"基于分裂的图像超分辨率反馈网络","authors":"Hongyang Zhou, Yi Ma, Yan Ma, Xiaobin Zhu","doi":"10.1109/CoST57098.2022.00015","DOIUrl":null,"url":null,"abstract":"Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.","PeriodicalId":135595,"journal":{"name":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","volume":"54 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Split-based Feedback Network for Image Super-Resolution\",\"authors\":\"Hongyang Zhou, Yi Ma, Yan Ma, Xiaobin Zhu\",\"doi\":\"10.1109/CoST57098.2022.00015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.\",\"PeriodicalId\":135595,\"journal\":{\"name\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"volume\":\"54 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Culture-Oriented Science and Technology (CoST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CoST57098.2022.00015\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Culture-Oriented Science and Technology (CoST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CoST57098.2022.00015","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Split-based Feedback Network for Image Super-Resolution
Most existing image super-resolution (SR) methods has achieved superior performance. However, the contrastive learning, which commonly be used in high-level tasks, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super-resolution network based feedback mechanism to learn abstract representations to explore high information in the representation space. Specifically, we first use the hidden states and constraints in RNN to achieve feedback network. Then, a contrastive learning is used to conduct representation learning by pulling the final SR image to the high resolution image and push the final image to intermediate images. In addition, we introduce a split based feedback block (SPFB) to reduce the redundancy of models for inference acceleration, where the tolerate features with similar patterns but require less computation. Extensive experimental results demonstrate the superiority of the proposed method in comparison with the state-of-the-art methods.