A Separating Embedding Space Based Relation Network with RGB Modality Only for Cloth-Changing Person Re-Identification

Jian Xu, Bo Liu, Yanshan Xiao
{"title":"A Separating Embedding Space Based Relation Network with RGB Modality Only for Cloth-Changing Person Re-Identification","authors":"Jian Xu, Bo Liu, Yanshan Xiao","doi":"10.1145/3565387.3565397","DOIUrl":null,"url":null,"abstract":"The Cloth-changing person re-identification (CC-ReID) is more challenging than person re-identification (Re-ID) since the cloth-relevant features are unreliable. The current CC-ReID methods usually utilize some human parsing techniques such as semantic segmentation to guide the model to learn more cloth-irrelevant feature cues. However, the human parsing models are not necessarily reliable. For this, we propose a Separating Embedding Space based Relation Network (SESRN) for CC-ReID. Firstly, we use pairs of images as input of the model and consider the relation between them in SESRN instead of a single image that the existing CC-ReID models use. Secondly, we propose to separate the common feature embedding space outputted from the common backbone into two embedding subspaces including the cloth-irrelevant feature embedding subspace and cloth-related feature embedding subspace without using any human parsing techniques since we think that they are unreliable and introduce noise into model. Thirdly, we generate the different feature map weights on different subspaces or different comparison pairs on the same subspace, which is a simple and effective feature map visualization and analysis framework in CC-ReID. Finally, the extensive experiments show the effectiveness and robustness of our method.","PeriodicalId":182491,"journal":{"name":"Proceedings of the 6th International Conference on Computer Science and Application Engineering","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 6th International Conference on Computer Science and Application Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3565387.3565397","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The Cloth-changing person re-identification (CC-ReID) is more challenging than person re-identification (Re-ID) since the cloth-relevant features are unreliable. The current CC-ReID methods usually utilize some human parsing techniques such as semantic segmentation to guide the model to learn more cloth-irrelevant feature cues. However, the human parsing models are not necessarily reliable. For this, we propose a Separating Embedding Space based Relation Network (SESRN) for CC-ReID. Firstly, we use pairs of images as input of the model and consider the relation between them in SESRN instead of a single image that the existing CC-ReID models use. Secondly, we propose to separate the common feature embedding space outputted from the common backbone into two embedding subspaces including the cloth-irrelevant feature embedding subspace and cloth-related feature embedding subspace without using any human parsing techniques since we think that they are unreliable and introduce noise into model. Thirdly, we generate the different feature map weights on different subspaces or different comparison pairs on the same subspace, which is a simple and effective feature map visualization and analysis framework in CC-ReID. Finally, the extensive experiments show the effectiveness and robustness of our method.
基于RGB模态分离嵌入空间的换布人再识别关系网络
由于布料相关特征不可靠,换布人再识别(CC-ReID)比人再识别(Re-ID)更具挑战性。当前的CC-ReID方法通常利用语义分割等人工解析技术来指导模型学习更多与布料无关的特征线索。然而,人工解析模型并不一定可靠。为此,我们提出了一种基于分离嵌入空间的CC-ReID关系网络(SESRN)。首先,我们使用成对的图像作为模型的输入,并在SESRN中考虑它们之间的关系,而不是现有CC-ReID模型使用的单个图像。其次,我们提出将公共主干输出的公共特征嵌入空间分离为两个嵌入子空间,包括布无关特征嵌入子空间和布相关特征嵌入子空间,而不使用任何人工解析技术,因为我们认为它们是不可靠的,并且会给模型引入噪声。第三,我们在不同的子空间上生成不同的特征映射权值,或者在同一子空间上生成不同的比较对,这是CC-ReID中一个简单有效的特征映射可视化分析框架。最后,通过大量的实验验证了该方法的有效性和鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信