任意风格转换与语义内容增强

Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen
{"title":"任意风格转换与语义内容增强","authors":"Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen","doi":"10.1145/3574131.3574454","DOIUrl":null,"url":null,"abstract":"Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.","PeriodicalId":111802,"journal":{"name":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","volume":"115 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Arbitrary Style Transfer with Semantic Content Enhancement\",\"authors\":\"Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen\",\"doi\":\"10.1145/3574131.3574454\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.\",\"PeriodicalId\":111802,\"journal\":{\"name\":\"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry\",\"volume\":\"115 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3574131.3574454\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3574131.3574454","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

任意样式转换是一个重要的主题,它根据参考图像改变源图像的样式。它在艺术创作和智能成像应用中非常有用。风格迁移的主要挑战是难以平衡语义特征转换与原始语义内容之间的关系。本文引入语义内容增强模块,在尽可能保持原有语义结构的前提下,减轻颜色分布和语义特征变换对风格传递的影响。同时,我们还引入了一个通道关注模块,通过与风格关注网络的融合来增强风格特征。通过这两种特征的增强,我们的网络达到了平衡原始语义结构和传递风格化可视化的优异效果。此外,我们还将该算法移植到3D空间中,并且在基于3D场景的风格转移中也表现稳定。实验表明,该方法可以处理各种风格迁移任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Arbitrary Style Transfer with Semantic Content Enhancement
Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信