Research on Image Super-Resolution Reconstruction Based on Transformer

Haiyong Wang, Kai Jiang
{"title":"Research on Image Super-Resolution Reconstruction Based on Transformer","authors":"Haiyong Wang, Kai Jiang","doi":"10.1109/AIID51893.2021.9456580","DOIUrl":null,"url":null,"abstract":"The existing super-resolution methods have the problems of blurring contour and losing details, which cannot make full use of the internal and external information of the image. On the basis of convolutional neural network, a super-resolution model embedded in Transformer module is proposed. Through the fusion of CNN and Transformer, image feature extraction and corrupted information recovery are performed. The training process is divided into an unsupervised pre-training process on the ImageNet subset and a supervised fine-tuning training process on the DIV2K data set. Contrastive loss is introduced into the loss function to achieve the consistency of super-resolution image category and texture. It is compared with the current mainstream image super-resolution methods on the standard 5 benchmark data sets. Experiments show that compared with other algorithms, this algorithm can better recover the high-frequency information of the image, and generate super-resolution results with clear details and fine structure.","PeriodicalId":412698,"journal":{"name":"2021 IEEE International Conference on Artificial Intelligence and Industrial Design (AIID)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Artificial Intelligence and Industrial Design (AIID)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIID51893.2021.9456580","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

Abstract

The existing super-resolution methods have the problems of blurring contour and losing details, which cannot make full use of the internal and external information of the image. On the basis of convolutional neural network, a super-resolution model embedded in Transformer module is proposed. Through the fusion of CNN and Transformer, image feature extraction and corrupted information recovery are performed. The training process is divided into an unsupervised pre-training process on the ImageNet subset and a supervised fine-tuning training process on the DIV2K data set. Contrastive loss is introduced into the loss function to achieve the consistency of super-resolution image category and texture. It is compared with the current mainstream image super-resolution methods on the standard 5 benchmark data sets. Experiments show that compared with other algorithms, this algorithm can better recover the high-frequency information of the image, and generate super-resolution results with clear details and fine structure.
基于变压器的图像超分辨率重建研究
现有的超分辨率方法存在轮廓模糊和细节丢失等问题,不能充分利用图像的内外信息。在卷积神经网络的基础上,提出了一种嵌入Transformer模块的超分辨率模型。通过融合CNN和Transformer,进行图像特征提取和损坏信息恢复。训练过程分为ImageNet子集上的无监督预训练过程和DIV2K数据集上的监督微调训练过程。在损失函数中引入对比损失,实现了超分辨率图像类别和纹理的一致性。在标准的5个基准数据集上,与目前主流的图像超分辨方法进行了比较。实验表明,与其他算法相比,该算法能更好地恢复图像的高频信息,生成细节清晰、结构精细的超分辨率结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信