{"title":"结合轻量级混合注意力连体网络的目标跟踪方法","authors":"Ruoyu Lou, Wu Yang, Yingjiang Li, Ling Lu","doi":"10.1109/ACAIT56212.2022.10137999","DOIUrl":null,"url":null,"abstract":"Aiming at the problem that the target tracking method of deep learning has a large number of model parameters and insufficient real-time performance, it is difficult to apply to mobile terminals or embedded devices with insufficient computing power. A lightweight hybrid attention-based twin network tracking algorithm is proposed. Firstly, based on MobileNetv3-Large network, group convolution and channel rearrangement are performed; then, in view of the problem that traditional attention mechanism only considers a single scope, this paper proposes a lightweight group-gated mixed attention (Group-gated mixed attention, GG); finally, GG is embedded in the Siamese network structure of this paper and the hierarchical feature fusion strategy is used to improve the tracking accuracy. Experiments show that the parameters of the proposed GG decrease by 26.2% compared with CBAM, decrease by 6.50% compared with SE, and increase Top-1 by 2.59% and 2.68% respectively; the experiments on the OTB100 and VOT2018 datasets demonstrate that the proposed algorithm is comparable to traditional tracking Compared with the algorithm, the accuracy and real-time performance have great advantages.","PeriodicalId":398228,"journal":{"name":"2022 6th Asian Conference on Artificial Intelligence Technology (ACAIT)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Object Tracking Method Combined with Lightweight Hybrid Attention Siamese Network\",\"authors\":\"Ruoyu Lou, Wu Yang, Yingjiang Li, Ling Lu\",\"doi\":\"10.1109/ACAIT56212.2022.10137999\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problem that the target tracking method of deep learning has a large number of model parameters and insufficient real-time performance, it is difficult to apply to mobile terminals or embedded devices with insufficient computing power. A lightweight hybrid attention-based twin network tracking algorithm is proposed. Firstly, based on MobileNetv3-Large network, group convolution and channel rearrangement are performed; then, in view of the problem that traditional attention mechanism only considers a single scope, this paper proposes a lightweight group-gated mixed attention (Group-gated mixed attention, GG); finally, GG is embedded in the Siamese network structure of this paper and the hierarchical feature fusion strategy is used to improve the tracking accuracy. Experiments show that the parameters of the proposed GG decrease by 26.2% compared with CBAM, decrease by 6.50% compared with SE, and increase Top-1 by 2.59% and 2.68% respectively; the experiments on the OTB100 and VOT2018 datasets demonstrate that the proposed algorithm is comparable to traditional tracking Compared with the algorithm, the accuracy and real-time performance have great advantages.\",\"PeriodicalId\":398228,\"journal\":{\"name\":\"2022 6th Asian Conference on Artificial Intelligence Technology (ACAIT)\",\"volume\":\"15 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 6th Asian Conference on Artificial Intelligence Technology (ACAIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ACAIT56212.2022.10137999\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 6th Asian Conference on Artificial Intelligence Technology (ACAIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ACAIT56212.2022.10137999","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Object Tracking Method Combined with Lightweight Hybrid Attention Siamese Network
Aiming at the problem that the target tracking method of deep learning has a large number of model parameters and insufficient real-time performance, it is difficult to apply to mobile terminals or embedded devices with insufficient computing power. A lightweight hybrid attention-based twin network tracking algorithm is proposed. Firstly, based on MobileNetv3-Large network, group convolution and channel rearrangement are performed; then, in view of the problem that traditional attention mechanism only considers a single scope, this paper proposes a lightweight group-gated mixed attention (Group-gated mixed attention, GG); finally, GG is embedded in the Siamese network structure of this paper and the hierarchical feature fusion strategy is used to improve the tracking accuracy. Experiments show that the parameters of the proposed GG decrease by 26.2% compared with CBAM, decrease by 6.50% compared with SE, and increase Top-1 by 2.59% and 2.68% respectively; the experiments on the OTB100 and VOT2018 datasets demonstrate that the proposed algorithm is comparable to traditional tracking Compared with the algorithm, the accuracy and real-time performance have great advantages.