Wei Li;Shitong Shao;Ziming Qiu;Zhihao Zhu;Aiguo Song
{"title":"2D-SNet: A Lightweight Network for Person Re-Identification on the Small Data Regime","authors":"Wei Li;Shitong Shao;Ziming Qiu;Zhihao Zhu;Aiguo Song","doi":"10.1109/TBIOM.2023.3332285","DOIUrl":null,"url":null,"abstract":"Currently, researchers incline to employ large-scale datasets as benchmarks for pre-training and fine-tuning models on small-scale datasets to achieve superior performance. However, many researchers cannot afford the enormous computational overhead that pre-training entails, and fine-tuning is easy to compromise the generalization ability of models for the target dataset. Therefore, model learning on the small challenging data regime should be given renewed attention, which will benefit many tasks such as person re-identification. To this end, we propose a novel model named “Two-Dimensional Serpentine Network (2D-SNet)”, which is constructed by multiple lightweight and effective “Two-Dimensional Serpentine Blocks (2D-SBlocks)”. The generalization ability of 2D-SNet stems from three points: (a) 2D-SBlock utilizes multi-scale convolution kernels to extract the multi-scale information from images on the small data regime; (b) 2D-SBlock has a serpentine calculation order, which significantly reduces the number of skip connections and can thereby save many computational and storage resources; (c) 2D-SBlock improves the discrimination ability of 2D-SNet via BN-Depthwise Conv or MSA. As experimentally demonstrated, our proposed 2D-SNet has superiority outstrips closely-related advanced approaches for person re-identification on datasets Market-1501 and CUHK03.","PeriodicalId":73307,"journal":{"name":"IEEE transactions on biometrics, behavior, and identity science","volume":"6 1","pages":"68-78"},"PeriodicalIF":0.0000,"publicationDate":"2023-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on biometrics, behavior, and identity science","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10315712/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Currently, researchers incline to employ large-scale datasets as benchmarks for pre-training and fine-tuning models on small-scale datasets to achieve superior performance. However, many researchers cannot afford the enormous computational overhead that pre-training entails, and fine-tuning is easy to compromise the generalization ability of models for the target dataset. Therefore, model learning on the small challenging data regime should be given renewed attention, which will benefit many tasks such as person re-identification. To this end, we propose a novel model named “Two-Dimensional Serpentine Network (2D-SNet)”, which is constructed by multiple lightweight and effective “Two-Dimensional Serpentine Blocks (2D-SBlocks)”. The generalization ability of 2D-SNet stems from three points: (a) 2D-SBlock utilizes multi-scale convolution kernels to extract the multi-scale information from images on the small data regime; (b) 2D-SBlock has a serpentine calculation order, which significantly reduces the number of skip connections and can thereby save many computational and storage resources; (c) 2D-SBlock improves the discrimination ability of 2D-SNet via BN-Depthwise Conv or MSA. As experimentally demonstrated, our proposed 2D-SNet has superiority outstrips closely-related advanced approaches for person re-identification on datasets Market-1501 and CUHK03.