Exploiting the power of StarGANv2 in the wild

Gengjun Huang, Xiaosheng Long, Yiming Mao
{"title":"Exploiting the power of StarGANv2 in the wild","authors":"Gengjun Huang, Xiaosheng Long, Yiming Mao","doi":"10.1117/12.2671374","DOIUrl":null,"url":null,"abstract":"With wide-spread usage of style transfer, numerous methods for style transfer draw an increasing attention. Several methods to enhance the efficiency of style transformers have been made, one of them is StarGANv2, a method for multiple-style transfer, which can transform a batch of source pictures into other pictures with different styles. The main difference of StarGANv2 with other style transformers is that it uses style code to represent the styles to enable StarGANv2 to complete multiple-style transformation. The authors of StarGANv2 use CelebA-HQ and AFHQ dataset to train the model and test the model, and the results are pretty better than other style transformers. The goal of this paper is to exploit the effectiveness of StarGANv2 in the real-world scenes, such as over exposure or the angle facing the camera. The results validate the power of StarGANv2 where the model is robust enough to transfer the pictures into other styles. To achieve this, the authors of StarGANv2 use the photo clipped in videos which record real-world animals and form a new dataset. Then, the authors of StarGANv2 use the dataset to test the pre-trained model which is trained by AFHQ dataset and evaluate it according to FID metric. The authors of StarGANv2 draw a conclusion that StarGANv2 is robust in real world scenes. The meaning of this paper is that the authors get the real-world usage of StarGANv2 and have a test of StarGANv2’s robustness in real world photos and validate the potential of StarGANv2 in real-world applications.","PeriodicalId":227528,"journal":{"name":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2671374","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

With wide-spread usage of style transfer, numerous methods for style transfer draw an increasing attention. Several methods to enhance the efficiency of style transformers have been made, one of them is StarGANv2, a method for multiple-style transfer, which can transform a batch of source pictures into other pictures with different styles. The main difference of StarGANv2 with other style transformers is that it uses style code to represent the styles to enable StarGANv2 to complete multiple-style transformation. The authors of StarGANv2 use CelebA-HQ and AFHQ dataset to train the model and test the model, and the results are pretty better than other style transformers. The goal of this paper is to exploit the effectiveness of StarGANv2 in the real-world scenes, such as over exposure or the angle facing the camera. The results validate the power of StarGANv2 where the model is robust enough to transfer the pictures into other styles. To achieve this, the authors of StarGANv2 use the photo clipped in videos which record real-world animals and form a new dataset. Then, the authors of StarGANv2 use the dataset to test the pre-trained model which is trained by AFHQ dataset and evaluate it according to FID metric. The authors of StarGANv2 draw a conclusion that StarGANv2 is robust in real world scenes. The meaning of this paper is that the authors get the real-world usage of StarGANv2 and have a test of StarGANv2’s robustness in real world photos and validate the potential of StarGANv2 in real-world applications.
在野外利用StarGANv2的力量
随着风格迁移的广泛使用,许多风格迁移的方法越来越受到人们的关注。提出了几种提高样式转换效率的方法,其中一种是StarGANv2,它是一种多样式转换方法,可以将一批源图片转换为具有不同样式的其他图片。StarGANv2与其他样式转换器的主要区别在于,它使用样式代码来表示样式,使StarGANv2能够完成多样式转换。StarGANv2的作者使用CelebA-HQ和AFHQ数据集对模型进行训练和测试,结果比其他风格变形器要好得多。本文的目标是利用StarGANv2在现实世界场景中的有效性,例如过度曝光或面向相机的角度。结果验证了StarGANv2的强大功能,该模型具有足够的鲁棒性,可以将图像转换为其他样式。为了实现这一目标,StarGANv2的作者使用了记录现实世界动物的视频剪辑的照片,并形成了一个新的数据集。然后,StarGANv2使用该数据集对AFHQ数据集训练的预训练模型进行测试,并根据FID度量对其进行评估。StarGANv2的作者得出结论,StarGANv2在现实世界场景中是健壮的。本文的意义在于,作者获得了StarGANv2在现实世界中的使用情况,并在真实世界的照片中测试了StarGANv2的鲁棒性,验证了StarGANv2在现实应用中的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信