WeaGAN:Generative Adversarial Network for Weather Translation of Image among Multi-domain

Yating Lin, Yidong Li, Haidong Cui, Z. Feng
{"title":"WeaGAN:Generative Adversarial Network for Weather Translation of Image among Multi-domain","authors":"Yating Lin, Yidong Li, Haidong Cui, Z. Feng","doi":"10.1109/BESC48373.2019.8963257","DOIUrl":null,"url":null,"abstract":"Weather translation of image refers to the task of changing the weather of an input image to desired weather while preserving the structure of the image's content, which belongs to a task of image-to-image translation. Recent works have made great process in image-to-image translation between two domains and some works have even achieved multi-domain translation within a single model. However, existing works have limited robustness in handling weather translation among multi-domain, since bad weather produces a loud noise and it is challenging to process scene images without fixed pattern in a unified model. In this paper, we propose WeaGAN based on encoder-decoder architecture and generative adversarial training process to translate the weather of image among multi-domain. In particular, We employ SE block in generator and combine adversarial loss, classification loss and content loss for visually detailed and realistic result. Experience in qualitative and quantitative aspect on synthetic dataset and real dataset show the effectiveness and competitiveness of our method compared with state-of-the-art works.","PeriodicalId":190867,"journal":{"name":"2019 6th International Conference on Behavioral, Economic and Socio-Cultural Computing (BESC)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 6th International Conference on Behavioral, Economic and Socio-Cultural Computing (BESC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BESC48373.2019.8963257","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

Weather translation of image refers to the task of changing the weather of an input image to desired weather while preserving the structure of the image's content, which belongs to a task of image-to-image translation. Recent works have made great process in image-to-image translation between two domains and some works have even achieved multi-domain translation within a single model. However, existing works have limited robustness in handling weather translation among multi-domain, since bad weather produces a loud noise and it is challenging to process scene images without fixed pattern in a unified model. In this paper, we propose WeaGAN based on encoder-decoder architecture and generative adversarial training process to translate the weather of image among multi-domain. In particular, We employ SE block in generator and combine adversarial loss, classification loss and content loss for visually detailed and realistic result. Experience in qualitative and quantitative aspect on synthetic dataset and real dataset show the effectiveness and competitiveness of our method compared with state-of-the-art works.
基于生成对抗网络的多域气象图像翻译
图像的天气翻译是指在保持图像内容结构的同时,将输入图像的天气改变为期望的天气的任务,属于图像到图像的翻译任务。近年来的研究在两个领域之间的图像到图像的翻译方面取得了很大的进展,有些研究甚至在一个模型内实现了多领域的翻译。然而,由于恶劣天气会产生较大的噪声,并且难以在统一的模型中处理无固定模式的场景图像,现有的工作在处理多域天气转换方面的鲁棒性有限。在本文中,我们提出了基于编码器-解码器架构和生成对抗训练过程的WeaGAN来实现图像天气在多域间的翻译。特别地,我们在生成器中使用了SE块,并将对抗损失、分类损失和内容损失结合起来,得到了视觉上详细、真实的结果。在合成数据集和真实数据集的定性和定量方面的经验表明,与目前的研究成果相比,我们的方法具有有效性和竞争力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信