UKD-TEAD:一种用于检测不同纵横比交通设备异常的无监督知识蒸馏框架

IF 8.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou
{"title":"UKD-TEAD:一种用于检测不同纵横比交通设备异常的无监督知识蒸馏框架","authors":"Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou","doi":"10.1109/JIOT.2024.3524788","DOIUrl":null,"url":null,"abstract":"The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 10","pages":"14080-14095"},"PeriodicalIF":8.9000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"UKD-TEAD: An Unsupervised Knowledge Distillation Framework for Detecting Anomalies in Traffic Equipment With Various Aspect Ratios\",\"authors\":\"Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou\",\"doi\":\"10.1109/JIOT.2024.3524788\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 10\",\"pages\":\"14080-14095\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10819484/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10819484/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

设备异常捕获的低效影响了各种交通设备异常检测模型的有效训练。本文提出了一种用于交通设备异常检测的无监督知识蒸馏方法(UKD-TEAD),消除了对大量标注的需要,保证了对各种设备异常的适用性。首先,设计了三种基于不同目标类别长宽比分布的专用检测头,对复杂交通场景下的多尺度目标进行高精度检测;其次,基于分层知识精馏法,提出了一种师生模型,以减轻因兴趣区域(roi)裁剪面积小而导致的关键特征损失。通过在网络的不同深度进行知识蒸馏,学生网络有效地学习了教师网络在多个尺度特征层上的表示能力,从而提高了异常检测性能。最后,为了验证所提出的无监督异常检测框架,基于交通检测数据构建了目标检测数据集和无监督异常检测数据集。实验结果表明,该方法对TE检测的准确率mAP@0.5为0.862,对异常检测的平均曲线下面积(mAUC)达到0.857。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
UKD-TEAD: An Unsupervised Knowledge Distillation Framework for Detecting Anomalies in Traffic Equipment With Various Aspect Ratios
The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Internet of Things Journal
IEEE Internet of Things Journal Computer Science-Information Systems
CiteScore
17.60
自引率
13.20%
发文量
1982
期刊介绍: The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信