A Co-Attention Method Based on Generative Adversarial Networks for Multi-view Images

Qi-Xian Huang, Shu-Pei Shi, Guo-Shiang Lin, D. Shen, Hung-Min Sun
{"title":"A Co-Attention Method Based on Generative Adversarial Networks for Multi-view Images","authors":"Qi-Xian Huang, Shu-Pei Shi, Guo-Shiang Lin, D. Shen, Hung-Min Sun","doi":"10.1109/SNPD51163.2021.9704964","DOIUrl":null,"url":null,"abstract":"In this paper, we use Deep Convolutional Generative Adversarial Networks (DCGANs) method to generate more images with multiple views to increase our dataset diversity. We use 3D-model different views for training DCGAN to make interpolation between the leftest and rightest random vectors, which means it can generate leftest to rightest images. After producing many of multi-view images, we combine with CNN based modules called co-attention map generator to look for common features of the same class but in different views clothing. By applying the learned generator to all images, the corresponding co-attention maps are obtained. we can fluently apply the proposed method can function well for multi-view objects on different types of clothing classes.","PeriodicalId":235370,"journal":{"name":"2021 IEEE/ACIS 22nd International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACIS 22nd International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SNPD51163.2021.9704964","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, we use Deep Convolutional Generative Adversarial Networks (DCGANs) method to generate more images with multiple views to increase our dataset diversity. We use 3D-model different views for training DCGAN to make interpolation between the leftest and rightest random vectors, which means it can generate leftest to rightest images. After producing many of multi-view images, we combine with CNN based modules called co-attention map generator to look for common features of the same class but in different views clothing. By applying the learned generator to all images, the corresponding co-attention maps are obtained. we can fluently apply the proposed method can function well for multi-view objects on different types of clothing classes.
基于生成对抗网络的多视角图像协同关注方法
在本文中,我们使用深度卷积生成对抗网络(dcgan)方法生成更多具有多个视图的图像,以增加我们的数据集多样性。我们使用3d模型的不同视图来训练DCGAN,在最左和最右的随机向量之间进行插值,这意味着它可以生成最左到最右的图像。在生成许多多视图图像后,我们结合基于CNN的共关注地图生成器模块来寻找相同类别但不同视图服装的共同特征。将学习到的生成器应用于所有图像,得到相应的共同关注图。该方法可以很好地应用于不同类型的服装类上的多视图对象。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信