Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo
{"title":"基于补丁增强和层次融合网络的鲁棒车辆再识别","authors":"Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo","doi":"10.1109/JIOT.2025.3561186","DOIUrl":null,"url":null,"abstract":"Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at <uri>https://github.com/711L/PEFN</uri>.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 14","pages":"26898-26910"},"PeriodicalIF":8.9000,"publicationDate":"2025-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PEFN: A Patches Enhancement and Hierarchical Fusion Network for Robust Vehicle Reidentification\",\"authors\":\"Wenying He;Feiyu Wang;Yude Bai;Neal N. Xiong;Guangquan Xu;Fei Guo\",\"doi\":\"10.1109/JIOT.2025.3561186\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at <uri>https://github.com/711L/PEFN</uri>.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 14\",\"pages\":\"26898-26910\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-04-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10965722/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10965722/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
PEFN: A Patches Enhancement and Hierarchical Fusion Network for Robust Vehicle Reidentification
Vehicle reidentification (Re-ID), which is a significant application in the Internet of Things, aims to accurately retrieve the remaining images of a given vehicle across different cameras views. The improvement in vehicle Re-ID performance largely stems from better addressing the issues of interclass similarity and intraclass variance. Existing methods, relying solely on max or average pooling after using attention modules, fail to obtain significantly complete and pure global and local features, and neglect the false guidance that some unique individual information on images bring to Re-ID. Moreover, models combining global and local features have shown good results in vehicle Re-ID, but these successes neglect the interaction between features across different convolutional layers, resulting in the loss of crucial details for vehicle Re-ID. To tackle these issues, we introduce a patches enhancement and hierarchical fusion network (PEFN) based on a multibranch architecture, divided into a global and local attention supplement (GLAS) branch, and an enhanced hierarchical feature fusion (EnHi) branch. The GLAS branch, through the identity-related feature remodeling (IDFR) module’s staged supplementation of spatial and channel features, has achieved the enhancement of both global and local features and effectively mitigated the negative impacts of individual information. The EnHi branch enhances the robustness of feature representation by interacting hierarchical features. Extensive experiments on two large-scale vehicle Re-ID datasets demonstrate that our PEFN method outperforms state-of-the-art vehicle Re-ID approaches. Specifically, without utilizing extra data and reranking, our model achieves 85.15% mean average precision on the VeRi776 dataset. Code is available at https://github.com/711L/PEFN.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.