基于圆形LBP先验的图像风格转移增强GAN

IF 4.1 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Wenguang Qian, Hua Li, Haiping Mu
{"title":"基于圆形LBP先验的图像风格转移增强GAN","authors":"Wenguang Qian, Hua Li, Haiping Mu","doi":"10.4018/ijswis.315601","DOIUrl":null,"url":null,"abstract":"Image style transfer (IST) has drawn broad attention recently. At present, convolutional neural network (CNN)-based methods and generative adversarial network (GAN)-based methods have been broadly utilized in IST. However, the texture of images obtained by most methods presents a lower definition, which leads to insufficient details of IST. To this end, the authors present a new IST method based on an enhanced GAN with a prior circular local binary pattern (LBP). They utilize circular LBP in a GAN generator as a texture prior to improve the detailed textures of the generated style images. Meanwhile, they integrate a dense connection residual block and an attention mechanism into the generator to further improve high-frequency feature extraction. In addition, the total variation (TV) regularizer is integrated into the loss function to smooth the training results and restrain the noise. The qualitative and quantitative experimental results demonstrate that the metric quality of the generated images can achieve better effects by the proposed strategy compared with other popular approaches.","PeriodicalId":54934,"journal":{"name":"International Journal on Semantic Web and Information Systems","volume":"128 1","pages":"1-15"},"PeriodicalIF":4.1000,"publicationDate":"2022-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Circular LBP Prior-Based Enhanced GAN for Image Style Transfer\",\"authors\":\"Wenguang Qian, Hua Li, Haiping Mu\",\"doi\":\"10.4018/ijswis.315601\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Image style transfer (IST) has drawn broad attention recently. At present, convolutional neural network (CNN)-based methods and generative adversarial network (GAN)-based methods have been broadly utilized in IST. However, the texture of images obtained by most methods presents a lower definition, which leads to insufficient details of IST. To this end, the authors present a new IST method based on an enhanced GAN with a prior circular local binary pattern (LBP). They utilize circular LBP in a GAN generator as a texture prior to improve the detailed textures of the generated style images. Meanwhile, they integrate a dense connection residual block and an attention mechanism into the generator to further improve high-frequency feature extraction. In addition, the total variation (TV) regularizer is integrated into the loss function to smooth the training results and restrain the noise. The qualitative and quantitative experimental results demonstrate that the metric quality of the generated images can achieve better effects by the proposed strategy compared with other popular approaches.\",\"PeriodicalId\":54934,\"journal\":{\"name\":\"International Journal on Semantic Web and Information Systems\",\"volume\":\"128 1\",\"pages\":\"1-15\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2022-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal on Semantic Web and Information Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.4018/ijswis.315601\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal on Semantic Web and Information Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.4018/ijswis.315601","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 2

摘要

近年来,图像风格迁移(IST)引起了广泛的关注。目前,基于卷积神经网络(CNN)的方法和基于生成对抗网络(GAN)的方法在IST中得到了广泛的应用。然而,大多数方法获得的图像纹理清晰度较低,导致IST的细节不足。为此,作者提出了一种新的基于增强GAN的IST方法,该方法具有先验圆形局部二值模式(LBP)。他们利用GAN生成器中的圆形LBP作为纹理,以改善生成的样式图像的详细纹理。同时,他们在生成器中集成了密集连接残差块和注意机制,进一步提高了高频特征提取。此外,将总变差(TV)正则化器集成到损失函数中,以平滑训练结果并抑制噪声。定性和定量实验结果表明,与其他常用方法相比,所提出的策略可以获得更好的度量图像质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Circular LBP Prior-Based Enhanced GAN for Image Style Transfer
Image style transfer (IST) has drawn broad attention recently. At present, convolutional neural network (CNN)-based methods and generative adversarial network (GAN)-based methods have been broadly utilized in IST. However, the texture of images obtained by most methods presents a lower definition, which leads to insufficient details of IST. To this end, the authors present a new IST method based on an enhanced GAN with a prior circular local binary pattern (LBP). They utilize circular LBP in a GAN generator as a texture prior to improve the detailed textures of the generated style images. Meanwhile, they integrate a dense connection residual block and an attention mechanism into the generator to further improve high-frequency feature extraction. In addition, the total variation (TV) regularizer is integrated into the loss function to smooth the training results and restrain the noise. The qualitative and quantitative experimental results demonstrate that the metric quality of the generated images can achieve better effects by the proposed strategy compared with other popular approaches.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.20
自引率
12.50%
发文量
51
审稿时长
20 months
期刊介绍: The International Journal on Semantic Web and Information Systems (IJSWIS) promotes a knowledge transfer channel where academics, practitioners, and researchers can discuss, analyze, criticize, synthesize, communicate, elaborate, and simplify the more-than-promising technology of the semantic Web in the context of information systems. The journal aims to establish value-adding knowledge transfer and personal development channels in three distinctive areas: academia, industry, and government.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信