3D Grid Based Virtual Trial Room

Debangana Ram, Bholanath Roy, Vaibhav Soni
{"title":"3D Grid Based Virtual Trial Room","authors":"Debangana Ram, Bholanath Roy, Vaibhav Soni","doi":"10.1109/AIC55036.2022.9848947","DOIUrl":null,"url":null,"abstract":"Image based virtual trial room technologies are used for integrating modern in-store clothes into a person image which have caught the interest of research as well as representatives of the multimedia and computer vision communities. However, it’s indeed challenging. However, most existing image-based virtual trial room techniques combine both person and in-store clothes images without taking into consideration of mutual relation. An ideal process will not only change the target clothing into the best suitable shape but it will maintain the cloth uniqueness in the resulting image like color, shade, logos and texture of the material that represent the primary clothes. Prior Generative Adversarial Network (GAN) approaches failed to achieve the above essential performance requirements for realistic virtual trial room performance because they do-not manage considerable spatial misalignment between the primary image and targeted cloth. We present a novel fully-learn-able 3D grid virtual trial room for overcoming all significant barriers in this project. In the first stage, it performs an affine transformation and then thin plate spline transformation for matching the in-store clothes to the target person’s body shape using the Geometry Matching Component. As a result, the warped clothes in the shop appear more realistic. We use Transformation Guided Component that generates a composition mask to blend the warped garments and the image produced is guarantee smoothness, which reduces borderline distortions of warped clothes and creates its outcomes more realistic. Numerous trials on the fashion data-set show that our model delivers decent performance in both qualitative and quantitative terms.","PeriodicalId":433590,"journal":{"name":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE World Conference on Applied Intelligence and Computing (AIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AIC55036.2022.9848947","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Image based virtual trial room technologies are used for integrating modern in-store clothes into a person image which have caught the interest of research as well as representatives of the multimedia and computer vision communities. However, it’s indeed challenging. However, most existing image-based virtual trial room techniques combine both person and in-store clothes images without taking into consideration of mutual relation. An ideal process will not only change the target clothing into the best suitable shape but it will maintain the cloth uniqueness in the resulting image like color, shade, logos and texture of the material that represent the primary clothes. Prior Generative Adversarial Network (GAN) approaches failed to achieve the above essential performance requirements for realistic virtual trial room performance because they do-not manage considerable spatial misalignment between the primary image and targeted cloth. We present a novel fully-learn-able 3D grid virtual trial room for overcoming all significant barriers in this project. In the first stage, it performs an affine transformation and then thin plate spline transformation for matching the in-store clothes to the target person’s body shape using the Geometry Matching Component. As a result, the warped clothes in the shop appear more realistic. We use Transformation Guided Component that generates a composition mask to blend the warped garments and the image produced is guarantee smoothness, which reduces borderline distortions of warped clothes and creates its outcomes more realistic. Numerous trials on the fashion data-set show that our model delivers decent performance in both qualitative and quantitative terms.
基于三维网格的虚拟试验室
基于图像的虚拟试验室技术用于将现代店内服装集成到人的图像中,这引起了研究人员的兴趣,也是多媒体和计算机视觉界的代表。然而,它确实具有挑战性。然而,现有的基于图像的虚拟试衣间技术大多将人与店内服装图像结合在一起,没有考虑到两者之间的相互关系。一个理想的工艺不仅会把目标服装变成最合适的形状,而且会在最终的图像中保持布料的独特性,比如代表原始服装的材料的颜色、阴影、标志和纹理。先前的生成对抗网络(GAN)方法未能达到上述对现实虚拟试验室性能的基本性能要求,因为它们不能处理主图像和目标布料之间的相当大的空间错位。我们提出了一种新颖的完全可学习的三维网格虚拟试验室,以克服该项目中的所有重大障碍。首先进行仿射变换,然后进行薄板样条变换,利用几何匹配组件将店内服装与目标人的体型进行匹配。因此,商店里的变形衣服显得更加逼真。我们使用变换引导组件生成合成蒙版来混合扭曲的衣服,生成的图像保证平滑,减少了扭曲衣服的边缘扭曲,使其结果更加逼真。对时尚数据集的大量试验表明,我们的模型在定性和定量方面都有不错的表现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信