基于语义交流的低碳可持续人物再识别框架

IF 3.9 3区 计算机科学 Q2 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Hao Liu;Wenhan Long;Xinlong Wen;Zhida Guo;Lu Liu;Rongbo Zhu
{"title":"基于语义交流的低碳可持续人物再识别框架","authors":"Hao Liu;Wenhan Long;Xinlong Wen;Zhida Guo;Lu Liu;Rongbo Zhu","doi":"10.1109/TSUSC.2025.3566622","DOIUrl":null,"url":null,"abstract":"Person re-identification (Re-ID) is a critical technology in security systems and video surveillance. However, most of the existing methods focused on precise Re-ID, which not only neglect the transmission overheads, computing energy consumption and carbon emissions, but are unsustainable. Furthermore, the personal semantics is usually blurred and distorted in real-world scenarios due to the bird’s eye view (BEV) of cameras. Cross-illumination and face-coverings also weakened the key personal semantics. Such deficiencies have resulted in a substantial amount of carbon emissions and poor Re-ID performance. To reduce the video transmission overheads, computing energy consumption and carbon emissions yet guaranteeing the accuracy of Re-ID, this paper proposes a novel semantic communication-based low-carbon sustainable framework (SC-LCSF) for Re-ID. SC-LCSF adopts the semantic encoder based on an enhanced semantics-aware attention mechanism (ESA-SE) to extract the personal semantics. Only semantic information is transmitted at the semantic layer, which is then decoded into personal IDs by the multi-granularity semantic decoder (MG-SD). Two widely used public datasets, Market-1501 and CUHK03, and a newly curated real-world dataset, HZAU-SCUEC01, are used to train SC-LCSF and to evaluate its performance. Experimental results show that compared to the state-of-the-art (SOTA) methods, SC-LCSF achieves the best Rank-1 and mAP accuracy on all the datasets. Furthermore, SC-LCSF has a significant performance enhancement in low-carbon sustainable computing – the transmission data amount, CPU power consumption, CPU temperature, GPU power consumption, GPU temperature and Re-ID delay have a reduction of 96.8%, 39.6%, 27.9%, 40.9%, 29.7%, and 76.6%, respectively.","PeriodicalId":13268,"journal":{"name":"IEEE Transactions on Sustainable Computing","volume":"10 5","pages":"982-992"},"PeriodicalIF":3.9000,"publicationDate":"2025-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Semantic Communication-Based Low-Carbon Sustainable Framework for Person Re-Identification\",\"authors\":\"Hao Liu;Wenhan Long;Xinlong Wen;Zhida Guo;Lu Liu;Rongbo Zhu\",\"doi\":\"10.1109/TSUSC.2025.3566622\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Person re-identification (Re-ID) is a critical technology in security systems and video surveillance. However, most of the existing methods focused on precise Re-ID, which not only neglect the transmission overheads, computing energy consumption and carbon emissions, but are unsustainable. Furthermore, the personal semantics is usually blurred and distorted in real-world scenarios due to the bird’s eye view (BEV) of cameras. Cross-illumination and face-coverings also weakened the key personal semantics. Such deficiencies have resulted in a substantial amount of carbon emissions and poor Re-ID performance. To reduce the video transmission overheads, computing energy consumption and carbon emissions yet guaranteeing the accuracy of Re-ID, this paper proposes a novel semantic communication-based low-carbon sustainable framework (SC-LCSF) for Re-ID. SC-LCSF adopts the semantic encoder based on an enhanced semantics-aware attention mechanism (ESA-SE) to extract the personal semantics. Only semantic information is transmitted at the semantic layer, which is then decoded into personal IDs by the multi-granularity semantic decoder (MG-SD). Two widely used public datasets, Market-1501 and CUHK03, and a newly curated real-world dataset, HZAU-SCUEC01, are used to train SC-LCSF and to evaluate its performance. Experimental results show that compared to the state-of-the-art (SOTA) methods, SC-LCSF achieves the best Rank-1 and mAP accuracy on all the datasets. Furthermore, SC-LCSF has a significant performance enhancement in low-carbon sustainable computing – the transmission data amount, CPU power consumption, CPU temperature, GPU power consumption, GPU temperature and Re-ID delay have a reduction of 96.8%, 39.6%, 27.9%, 40.9%, 29.7%, and 76.6%, respectively.\",\"PeriodicalId\":13268,\"journal\":{\"name\":\"IEEE Transactions on Sustainable Computing\",\"volume\":\"10 5\",\"pages\":\"982-992\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-03-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Sustainable Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10982130/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Sustainable Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10982130/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

摘要

人员再识别(Re-ID)是安防系统和视频监控中的一项关键技术。然而,现有的方法大多侧重于精确的Re-ID,这不仅忽略了传输开销、计算能耗和碳排放,而且是不可持续的。此外,由于相机的鸟瞰视角(BEV),个人语义在现实场景中通常是模糊和扭曲的。交叉照明和蒙面也削弱了关键的个人语义。这些缺陷导致了大量的碳排放和较差的Re-ID性能。为了在保证Re-ID准确性的前提下降低视频传输开销、计算能耗和碳排放,本文提出了一种基于语义通信的Re-ID低碳可持续发展框架(SC-LCSF)。SC-LCSF采用基于增强型语义感知注意机制(ESA-SE)的语义编码器提取个人语义。在语义层只传输语义信息,然后由多粒度语义解码器(MG-SD)将其解码为个人id。两个广泛使用的公共数据集,Market-1501和CUHK03,以及一个新整理的真实数据集,HZAU-SCUEC01,用于训练SC-LCSF并评估其性能。实验结果表明,与最先进的SOTA方法相比,SC-LCSF在所有数据集上都达到了最佳的Rank-1和mAP精度。此外,SC-LCSF在低碳可持续计算方面具有显著的性能提升,传输数据量、CPU功耗、CPU温度、GPU功耗、GPU温度和Re-ID延迟分别降低96.8%、39.6%、27.9%、40.9%、29.7%和76.6%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Semantic Communication-Based Low-Carbon Sustainable Framework for Person Re-Identification
Person re-identification (Re-ID) is a critical technology in security systems and video surveillance. However, most of the existing methods focused on precise Re-ID, which not only neglect the transmission overheads, computing energy consumption and carbon emissions, but are unsustainable. Furthermore, the personal semantics is usually blurred and distorted in real-world scenarios due to the bird’s eye view (BEV) of cameras. Cross-illumination and face-coverings also weakened the key personal semantics. Such deficiencies have resulted in a substantial amount of carbon emissions and poor Re-ID performance. To reduce the video transmission overheads, computing energy consumption and carbon emissions yet guaranteeing the accuracy of Re-ID, this paper proposes a novel semantic communication-based low-carbon sustainable framework (SC-LCSF) for Re-ID. SC-LCSF adopts the semantic encoder based on an enhanced semantics-aware attention mechanism (ESA-SE) to extract the personal semantics. Only semantic information is transmitted at the semantic layer, which is then decoded into personal IDs by the multi-granularity semantic decoder (MG-SD). Two widely used public datasets, Market-1501 and CUHK03, and a newly curated real-world dataset, HZAU-SCUEC01, are used to train SC-LCSF and to evaluate its performance. Experimental results show that compared to the state-of-the-art (SOTA) methods, SC-LCSF achieves the best Rank-1 and mAP accuracy on all the datasets. Furthermore, SC-LCSF has a significant performance enhancement in low-carbon sustainable computing – the transmission data amount, CPU power consumption, CPU temperature, GPU power consumption, GPU temperature and Re-ID delay have a reduction of 96.8%, 39.6%, 27.9%, 40.9%, 29.7%, and 76.6%, respectively.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Sustainable Computing
IEEE Transactions on Sustainable Computing Mathematics-Control and Optimization
CiteScore
7.70
自引率
2.60%
发文量
54
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信