创新视频异常检测:基于自监督特征学习的TCN-AnoDetect

IF 2.5 4区 计算机科学 Q3 TELECOMMUNICATIONS
V. Rahul Chiranjeevi, D. Malathi
{"title":"创新视频异常检测:基于自监督特征学习的TCN-AnoDetect","authors":"V. Rahul Chiranjeevi,&nbsp;D. Malathi","doi":"10.1002/ett.70045","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Video anomaly detection is a critical task in surveillance, industrial quality control, and anomaly monitoring systems. Recognizing anomalous events or behaviors within video sequences is challenging due to the diverse and often vague nature of anomalies. A novel temporal convolutional network-based anomaly detection (TCN-AnoDetect) is proposed that leverages TCNs and self-supervised learning. In this, TCNs are employed to model the temporal context within video sequences effectively, capturing short and long-term dependencies. The algorithm integrates TCNs with pretrained models to encode rich spatiotemporal features. The core of TCN-AnoDetect lies in self-supervised feature learning, where a neural network is pretrained on unlabeled video data to capture high-level spatiotemporal features. The anomaly detection module combines reconstruction-based and temporal context–aware approaches, using reconstruction errors and temporal context deviations for anomaly scoring and classification. To enhance model robustness, TCN-AnoDetect incorporates domain adaptation technique to handle domain shifts and evolving anomalies. The proposed algorithm is evaluated on three different benchmark datasets and ShanghaiTech Campus, demonstrating its superior performance. The extensive experiments performed in terms of different evaluation measures show the efficiency of the TCN-AnoDetect algorithm. The TCN-AnoDetect, an innovative approach, thereby provides promising solutions in video anomaly detection and in various applications.</p>\n </div>","PeriodicalId":23282,"journal":{"name":"Transactions on Emerging Telecommunications Technologies","volume":"36 1","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2024-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Innovative Video Anomaly Detection: TCN-AnoDetect With Self-Supervised Feature Learning\",\"authors\":\"V. Rahul Chiranjeevi,&nbsp;D. Malathi\",\"doi\":\"10.1002/ett.70045\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>Video anomaly detection is a critical task in surveillance, industrial quality control, and anomaly monitoring systems. Recognizing anomalous events or behaviors within video sequences is challenging due to the diverse and often vague nature of anomalies. A novel temporal convolutional network-based anomaly detection (TCN-AnoDetect) is proposed that leverages TCNs and self-supervised learning. In this, TCNs are employed to model the temporal context within video sequences effectively, capturing short and long-term dependencies. The algorithm integrates TCNs with pretrained models to encode rich spatiotemporal features. The core of TCN-AnoDetect lies in self-supervised feature learning, where a neural network is pretrained on unlabeled video data to capture high-level spatiotemporal features. The anomaly detection module combines reconstruction-based and temporal context–aware approaches, using reconstruction errors and temporal context deviations for anomaly scoring and classification. To enhance model robustness, TCN-AnoDetect incorporates domain adaptation technique to handle domain shifts and evolving anomalies. The proposed algorithm is evaluated on three different benchmark datasets and ShanghaiTech Campus, demonstrating its superior performance. The extensive experiments performed in terms of different evaluation measures show the efficiency of the TCN-AnoDetect algorithm. The TCN-AnoDetect, an innovative approach, thereby provides promising solutions in video anomaly detection and in various applications.</p>\\n </div>\",\"PeriodicalId\":23282,\"journal\":{\"name\":\"Transactions on Emerging Telecommunications Technologies\",\"volume\":\"36 1\",\"pages\":\"\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2024-12-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transactions on Emerging Telecommunications Technologies\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/ett.70045\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions on Emerging Telecommunications Technologies","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ett.70045","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

视频异常检测是监控、工业质量控制和异常监控系统中的一项关键任务。由于异常的多样性和通常模糊的性质,识别视频序列中的异常事件或行为是具有挑战性的。提出了一种新的基于时间卷积网络的异常检测方法(TCN-AnoDetect),该方法利用了tcn和自监督学习。在这种情况下,tcn被用于有效地模拟视频序列中的时间上下文,捕获短期和长期依赖关系。该算法将tcn与预训练模型相结合,对丰富的时空特征进行编码。TCN-AnoDetect的核心在于自监督特征学习,其中神经网络在未标记的视频数据上进行预训练,以捕获高级时空特征。异常检测模块结合了基于重构和时间上下文感知的方法,利用重构误差和时间上下文偏差对异常进行评分和分类。为了增强模型的鲁棒性,TCN-AnoDetect结合了域自适应技术来处理域偏移和演化异常。在三个不同的基准数据集和上海科技园区上对该算法进行了评估,证明了其优越的性能。在不同的评估指标下进行的大量实验表明了TCN-AnoDetect算法的有效性。TCN-AnoDetect是一种创新的方法,因此在视频异常检测和各种应用中提供了有前途的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Innovative Video Anomaly Detection: TCN-AnoDetect With Self-Supervised Feature Learning

Video anomaly detection is a critical task in surveillance, industrial quality control, and anomaly monitoring systems. Recognizing anomalous events or behaviors within video sequences is challenging due to the diverse and often vague nature of anomalies. A novel temporal convolutional network-based anomaly detection (TCN-AnoDetect) is proposed that leverages TCNs and self-supervised learning. In this, TCNs are employed to model the temporal context within video sequences effectively, capturing short and long-term dependencies. The algorithm integrates TCNs with pretrained models to encode rich spatiotemporal features. The core of TCN-AnoDetect lies in self-supervised feature learning, where a neural network is pretrained on unlabeled video data to capture high-level spatiotemporal features. The anomaly detection module combines reconstruction-based and temporal context–aware approaches, using reconstruction errors and temporal context deviations for anomaly scoring and classification. To enhance model robustness, TCN-AnoDetect incorporates domain adaptation technique to handle domain shifts and evolving anomalies. The proposed algorithm is evaluated on three different benchmark datasets and ShanghaiTech Campus, demonstrating its superior performance. The extensive experiments performed in terms of different evaluation measures show the efficiency of the TCN-AnoDetect algorithm. The TCN-AnoDetect, an innovative approach, thereby provides promising solutions in video anomaly detection and in various applications.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.90
自引率
13.90%
发文量
249
期刊介绍: ransactions on Emerging Telecommunications Technologies (ETT), formerly known as European Transactions on Telecommunications (ETT), has the following aims: - to attract cutting-edge publications from leading researchers and research groups around the world - to become a highly cited source of timely research findings in emerging fields of telecommunications - to limit revision and publication cycles to a few months and thus significantly increase attractiveness to publish - to become the leading journal for publishing the latest developments in telecommunications
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信