Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen
{"title":"任意风格转换与语义内容增强","authors":"Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen","doi":"10.1145/3574131.3574454","DOIUrl":null,"url":null,"abstract":"Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.","PeriodicalId":111802,"journal":{"name":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","volume":"115 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Arbitrary Style Transfer with Semantic Content Enhancement\",\"authors\":\"Guoshuai Li, Bin Cheng, Luoyu Cheng, Chongbin Xu, Xiaomin Sun, Pu Ren, Yong Yang, Qian Chen\",\"doi\":\"10.1145/3574131.3574454\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.\",\"PeriodicalId\":111802,\"journal\":{\"name\":\"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry\",\"volume\":\"115 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3574131.3574454\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3574131.3574454","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Arbitrary Style Transfer with Semantic Content Enhancement
Arbitrary style transfer is an import topic which changes the style of a source image according to a reference one. It is useful for artistic creation and intelligent imaging applications. The main challenge of the style transfer is that it is difficult to balance the semantic feature transformation and original semantic content. In this paper, we introduce a semantic content enhancement module to mitigate the affect of color distribution and semantic feature transformation for the style transfer while keeping the original semantic structure as much as possible. Meanwhile, we also introduce a channel attention module to enhance the style features by fusing with the style attention network. With the enhancement of both features, our network achieves excellent result that balances original semantic structure and transfer stylized visualization. In addition, we also migrate the algorithm to 3D space and it also performs stably for 3D scene-based style transfer. Experiments show that our method can handle various style transfer tasks.