基于补丁增强和层次融合网络的鲁棒车辆再识别

IF 8.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo
{"title":"基于补丁增强和层次融合网络的鲁棒车辆再识别","authors":"Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo","doi":"10.1109/JIOT.2025.3561186","DOIUrl":null,"url":null,"abstract":"Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at <uri>https://github.com/711L/PEFN</uri>.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 14","pages":"26898-26910"},"PeriodicalIF":8.9000,"publicationDate":"2025-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PEFN: A Patches Enhancement and Hierarchical Fusion Network for Robust Vehicle Reidentification\",\"authors\":\"Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo\",\"doi\":\"10.1109/JIOT.2025.3561186\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at <uri>https://github.com/711L/PEFN</uri>.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 14\",\"pages\":\"26898-26910\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-04-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10965722/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10965722/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

车辆再识别(Re-ID)是物联网中的一个重要应用,旨在准确检索给定车辆在不同摄像头视图下的剩余图像。车辆Re-ID性能的提高很大程度上源于更好地解决类间相似性和类内方差问题。现有方法在使用注意力模块后,仅依靠最大池化或平均池化,无法获得明显完整纯粹的全局和局部特征,忽略了图像上某些独特的个体信息给Re-ID带来的错误引导。此外,结合全局和局部特征的模型在车辆Re-ID中显示出良好的结果,但这些成功忽略了不同卷积层特征之间的相互作用,导致车辆Re-ID的关键细节丢失。为了解决这些问题,我们引入了一种基于多分支架构的补丁增强和分层融合网络(PEFN),该网络分为全局和局部注意力补充(GLAS)分支和增强的分层特征融合(EnHi)分支。GLAS分支通过身份相关特征重构(identity-related feature remodeling, IDFR)模块对空间特征和通道特征的阶段性补充,实现了全局特征和局部特征的增强,有效缓解了个体信息的负面影响。EnHi分支通过层次化特征交互来增强特征表示的鲁棒性。在两个大规模车辆Re-ID数据集上进行的大量实验表明,我们的PEFN方法优于最先进的车辆Re-ID方法。具体来说,在不使用额外数据和重新排序的情况下,我们的模型在VeRi776数据集上达到了85.15%的平均精度。代码可从https://github.com/711L/PEFN获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
PEFN: A Patches Enhancement and Hierarchical Fusion Network for Robust Vehicle Reidentification
Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at https://github.com/711L/PEFN.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Internet of Things Journal
IEEE Internet of Things Journal Computer Science-Information Systems
CiteScore
17.60
自引率
13.20%
发文量
1982
期刊介绍: The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信