Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou
{"title":"UKD-TEAD:一种用于检测不同纵横比交通设备异常的无监督知识蒸馏框架","authors":"Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou","doi":"10.1109/JIOT.2024.3524788","DOIUrl":null,"url":null,"abstract":"The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 10","pages":"14080-14095"},"PeriodicalIF":8.9000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"UKD-TEAD: An Unsupervised Knowledge Distillation Framework for Detecting Anomalies in Traffic Equipment With Various Aspect Ratios\",\"authors\":\"Di Wu;Jiankun Peng;Shuangzhi Yu;Yuming Ge;Chunye Ma;Jiaxuan Zhou\",\"doi\":\"10.1109/JIOT.2024.3524788\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 10\",\"pages\":\"14080-14095\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10819484/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10819484/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
UKD-TEAD: An Unsupervised Knowledge Distillation Framework for Detecting Anomalies in Traffic Equipment With Various Aspect Ratios
The inefficient capture of equipment anomalies has impeded the effective training of models for detecting anomalies in various traffic equipment (TE). This article proposes an unsupervised knowledge distillation for traffic equipment anomaly detection (UKD-TEAD), eliminating the need for numerous annotations and ensuring the applicability to various equipment anomalies. First, three specialized detection heads based on different object category aspect ratio distributions are designed, to detect multiscale objects with high precision in complex traffic scenes. Second, a teacher-student model, grounded in hierarchical knowledge distillation, is developed to mitigate the critical feature loss associated with the small size of cropped regions of interest (ROIs). By performing knowledge distillation at different depths of the network, the student network effectively learns the representation capabilities of the teacher network on multiple scale feature layers, thereby improving the anomaly detection performance. Finally, to validate the proposed unsupervised anomaly detection framework, a target detection dataset and an unsupervised anomaly detection dataset were constructed based on traffic inspection data. Experimental results show that the proposed method achieves an mAP@0.5 of 0.862 for TE detection, while the mean area under the curve (mAUC) for anomaly detection reaches 0.857.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.