基于坐标注意力损失的生成对抗网络的非配对图像到图像翻译

Xiangdan Hou, Jinlin Song, Hongpu Liu
{"title":"基于坐标注意力损失的生成对抗网络的非配对图像到图像翻译","authors":"Xiangdan Hou, Jinlin Song, Hongpu Liu","doi":"10.1109/IIP57348.2022.00021","DOIUrl":null,"url":null,"abstract":"Image stylization is an important research direction in image processing, graphics, and computer vision. At present, methods based on deep learning, especially generative adversarial network, have made great progress in image stylization migration. However, there are several limitations to the current mainstream methods, the biggest of which is the inability to perform geometry changes, remove large objects, or ignore irrelevant textures in unpaired scenarios. This paper proposes a style transfer algorithm CAGAN based on Adversarial Consistency Loss Generative Adversarial Network and Coordinate Attention. The stylized transfer of high perceptual quality in mismatched scenes is achieved by combating consistency loss and attention mechanism, and the Laplacian noise module is added to generate multi-modal output. Through a lot of experiments, it is verified that the algorithm can achieve high quality stylization effect.","PeriodicalId":412907,"journal":{"name":"2022 4th International Conference on Intelligent Information Processing (IIP)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Unpaired Image-To-Image Translation Using Generative Adversarial Networks With Coordinate Attention Loss\",\"authors\":\"Xiangdan Hou, Jinlin Song, Hongpu Liu\",\"doi\":\"10.1109/IIP57348.2022.00021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Image stylization is an important research direction in image processing, graphics, and computer vision. At present, methods based on deep learning, especially generative adversarial network, have made great progress in image stylization migration. However, there are several limitations to the current mainstream methods, the biggest of which is the inability to perform geometry changes, remove large objects, or ignore irrelevant textures in unpaired scenarios. This paper proposes a style transfer algorithm CAGAN based on Adversarial Consistency Loss Generative Adversarial Network and Coordinate Attention. The stylized transfer of high perceptual quality in mismatched scenes is achieved by combating consistency loss and attention mechanism, and the Laplacian noise module is added to generate multi-modal output. Through a lot of experiments, it is verified that the algorithm can achieve high quality stylization effect.\",\"PeriodicalId\":412907,\"journal\":{\"name\":\"2022 4th International Conference on Intelligent Information Processing (IIP)\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 4th International Conference on Intelligent Information Processing (IIP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IIP57348.2022.00021\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 4th International Conference on Intelligent Information Processing (IIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IIP57348.2022.00021","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

图像风格化是图像处理、图形学和计算机视觉领域的一个重要研究方向。目前,基于深度学习的方法,特别是生成式对抗网络在图像风格化迁移方面取得了很大进展。然而,目前的主流方法有一些限制,其中最大的限制是无法执行几何变化,移除大型物体,或者忽略非配对场景中的无关纹理。提出了一种基于对抗一致性损失生成对抗网络和协调注意的风格迁移算法CAGAN。通过对抗一致性损失和注意机制,在不匹配场景中实现高感知质量的程式化转移,并加入拉普拉斯噪声模块生成多模态输出。通过大量的实验,验证了该算法能够达到高质量的风格化效果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Unpaired Image-To-Image Translation Using Generative Adversarial Networks With Coordinate Attention Loss
Image stylization is an important research direction in image processing, graphics, and computer vision. At present, methods based on deep learning, especially generative adversarial network, have made great progress in image stylization migration. However, there are several limitations to the current mainstream methods, the biggest of which is the inability to perform geometry changes, remove large objects, or ignore irrelevant textures in unpaired scenarios. This paper proposes a style transfer algorithm CAGAN based on Adversarial Consistency Loss Generative Adversarial Network and Coordinate Attention. The stylized transfer of high perceptual quality in mismatched scenes is achieved by combating consistency loss and attention mechanism, and the Laplacian noise module is added to generate multi-modal output. Through a lot of experiments, it is verified that the algorithm can achieve high quality stylization effect.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信