Learning from multi-view fragments: An adaptive consistency distillation framework for occluded person re-identification

IF 6.7 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Neurocomputing Pub Date : 2026-05-01 Epub Date: 2026-02-11 DOI:10.1016/j.neucom.2026.133015
Jianfeng Dong , Shengwei Tian , Long Yu , Hongfeng You , Qimeng Yang , Jinmiao Song , Xinjun Pei , Feng Shi , Kun Wu
{"title":"Learning from multi-view fragments: An adaptive consistency distillation framework for occluded person re-identification","authors":"Jianfeng Dong ,&nbsp;Shengwei Tian ,&nbsp;Long Yu ,&nbsp;Hongfeng You ,&nbsp;Qimeng Yang ,&nbsp;Jinmiao Song ,&nbsp;Xinjun Pei ,&nbsp;Feng Shi ,&nbsp;Kun Wu","doi":"10.1016/j.neucom.2026.133015","DOIUrl":null,"url":null,"abstract":"<div><div>Occluded person re-identification (ReID) faces an “information incompleteness paradox”: a single occluded view misses discriminative cues and yields ambiguous representations, while exploiting multi-view observations typically requires multi-branch inference with high computational cost. To address this dilemma, we propose <strong>Multi-View Consistency Distillation (MVCD)</strong>, a framework formulated under the <strong>Learning Using Privileged Information (LUPI)</strong> paradigm. Specifically, we construct a <em>training-only</em> teacher that has privileged access to multi-view fragments and identity annotations (available only during training), and transfer this privileged knowledge to a standard single-view student through consistency distillation. The teacher contains three training-only mechanisms: (1) <strong>Saliency-Guided Feature Purification (SGFP)</strong> to suppress occlusion-induced noise with label guidance; (2) <strong>Cross-View Patch Alignment (CVPA)</strong> to exploit patch correspondences for spatial rectification across views; and (3) <strong>Reliability-Guided Aggregation (RGA)</strong> to produce a low-variance, reliable supervision target. Crucially, all auxiliary components are discarded after training, enabling the student to recover more complete representations from occluded inputs with <strong>zero extra inference-time cost</strong>. Extensive experiments on five benchmarks show consistent improvements over strong baselines. On Occluded-DukeMTMC, MVCD achieves 70.4% Rank-1 accuracy and runs at 25 ms per image, outperforming prior state-of-the-art methods.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"676 ","pages":"Article 133015"},"PeriodicalIF":6.7000,"publicationDate":"2026-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231226004121","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/11 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Occluded person re-identification (ReID) faces an “information incompleteness paradox”: a single occluded view misses discriminative cues and yields ambiguous representations, while exploiting multi-view observations typically requires multi-branch inference with high computational cost. To address this dilemma, we propose Multi-View Consistency Distillation (MVCD), a framework formulated under the Learning Using Privileged Information (LUPI) paradigm. Specifically, we construct a training-only teacher that has privileged access to multi-view fragments and identity annotations (available only during training), and transfer this privileged knowledge to a standard single-view student through consistency distillation. The teacher contains three training-only mechanisms: (1) Saliency-Guided Feature Purification (SGFP) to suppress occlusion-induced noise with label guidance; (2) Cross-View Patch Alignment (CVPA) to exploit patch correspondences for spatial rectification across views; and (3) Reliability-Guided Aggregation (RGA) to produce a low-variance, reliable supervision target. Crucially, all auxiliary components are discarded after training, enabling the student to recover more complete representations from occluded inputs with zero extra inference-time cost. Extensive experiments on five benchmarks show consistent improvements over strong baselines. On Occluded-DukeMTMC, MVCD achieves 70.4% Rank-1 accuracy and runs at 25 ms per image, outperforming prior state-of-the-art methods.
从多视图片段中学习:一个自适应一致性蒸馏框架用于闭塞的人再识别
被遮挡人再识别(ReID)面临“信息不完备悖论”:单个被遮挡的视图错过了判别线索,产生了模糊的表示,而利用多视图观察通常需要多分支推理,计算成本高。为了解决这一困境,我们提出了多视图一致性蒸馏(MVCD),这是一个在使用特权信息学习(LUPI)范式下制定的框架。具体来说,我们构建了一个只接受培训的教师,他有特权访问多视图片段和身份注释(仅在培训期间可用),并通过一致性蒸馏将这些特权知识转移给标准的单视图学生。教师包含三种仅用于训练的机制:(1)显著性引导特征净化(SGFP),通过标签引导抑制闭塞性噪声;(2)跨视图Patch Alignment (Cross-View Patch Alignment, CVPA),利用Patch对应进行跨视图空间校正;(3)可靠性引导聚合(RGA),生成低方差、可靠的监督目标。至关重要的是,所有辅助成分在训练后被丢弃,使学生能够从闭塞的输入中恢复更完整的表示,并且没有额外的推理时间成本。在五个基准上进行的广泛实验表明,在较强的基线上有一致的改进。在occlded - dukemtmc上,MVCD达到70.4%的Rank-1精度,每张图像运行25毫秒,优于先前最先进的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书