Outlier detection in temporal and spatial sequences via correlation analysis based on graph neural networks

IF 3.7 2区 工程技术 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Yan Gao , Qingquan Lin , Shuang Ye , Yu Cheng , Tao Zhang , Bin Liang , Weining Lu
{"title":"Outlier detection in temporal and spatial sequences via correlation analysis based on graph neural networks","authors":"Yan Gao ,&nbsp;Qingquan Lin ,&nbsp;Shuang Ye ,&nbsp;Yu Cheng ,&nbsp;Tao Zhang ,&nbsp;Bin Liang ,&nbsp;Weining Lu","doi":"10.1016/j.displa.2024.102775","DOIUrl":null,"url":null,"abstract":"<div><p>Outlier detection is essential for identifying patterns that deviate from expected normal representations in data. Real-world challenges such as the lack of labeled data, noise, and high dimensionality significantly impact the effectiveness of existing methods. Understanding the temporal or spatial correlation of normal data is crucial for detecting or forecasting anomalous patterns. In this paper, we introduce UOSC-GNN, a novel Unsupervised Outlier detection architecture by Sequential Correlation analysis with Graph Neural Network. The architecture includes a deviation generation module to measure the variance between expected and actual states of sequential data. This module incorporates a Generic Feature Extraction component to extract intrinsic features from outliers and normal instances tailored to specific tasks, and an Expected State Estimator component based on Graph Neural Network to learn sequential patterns. To ensure the forecast of outliers with high confidence and improve alarm accuracy, an Outlier Probability Assessment module is introduced. This module combines a rule-based index derived from expert knowledge and a statistical index calculated based on generated deviations. Our method is evaluated on two real-world tasks: medical imaging analysis utilizing spatial-related data and early fault detection of instruments leveraging temporal-related data. The results show that our method triggers alarms about 70 min earlier than the best models on the run-to-failure bearing dataset and achieves an accuracy of 92.82% and a sensitivity of 88.51% on the wireless capsule endoscopy image dataset, outperforming traditional outlier detection algorithms consistently.</p></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"84 ","pages":"Article 102775"},"PeriodicalIF":3.7000,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141938224001392","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

Abstract

Outlier detection is essential for identifying patterns that deviate from expected normal representations in data. Real-world challenges such as the lack of labeled data, noise, and high dimensionality significantly impact the effectiveness of existing methods. Understanding the temporal or spatial correlation of normal data is crucial for detecting or forecasting anomalous patterns. In this paper, we introduce UOSC-GNN, a novel Unsupervised Outlier detection architecture by Sequential Correlation analysis with Graph Neural Network. The architecture includes a deviation generation module to measure the variance between expected and actual states of sequential data. This module incorporates a Generic Feature Extraction component to extract intrinsic features from outliers and normal instances tailored to specific tasks, and an Expected State Estimator component based on Graph Neural Network to learn sequential patterns. To ensure the forecast of outliers with high confidence and improve alarm accuracy, an Outlier Probability Assessment module is introduced. This module combines a rule-based index derived from expert knowledge and a statistical index calculated based on generated deviations. Our method is evaluated on two real-world tasks: medical imaging analysis utilizing spatial-related data and early fault detection of instruments leveraging temporal-related data. The results show that our method triggers alarms about 70 min earlier than the best models on the run-to-failure bearing dataset and achieves an accuracy of 92.82% and a sensitivity of 88.51% on the wireless capsule endoscopy image dataset, outperforming traditional outlier detection algorithms consistently.

通过基于图神经网络的相关性分析检测时空序列中的离群点
离群点检测对于识别数据中偏离预期正常表示的模式至关重要。现实世界中存在的挑战,如缺乏标注数据、噪声和高维度,严重影响了现有方法的有效性。了解正常数据的时间或空间相关性对于检测或预测异常模式至关重要。在本文中,我们介绍了 UOSC-GNN,这是一种新型的无监督离群点检测架构,通过顺序相关分析和图神经网络进行检测。该架构包括一个偏差生成模块,用于测量序列数据的预期状态与实际状态之间的差异。该模块包含一个通用特征提取组件,用于从异常值和正常实例中提取适合特定任务的内在特征,以及一个基于图神经网络的预期状态估计组件,用于学习序列模式。为确保对异常值进行高置信度预测并提高警报准确性,引入了异常值概率评估模块。该模块结合了基于专家知识的规则指数和基于生成偏差计算的统计指数。我们的方法在两个实际任务中进行了评估:利用空间相关数据的医学成像分析和利用时间相关数据的仪器早期故障检测。结果表明,在运行到故障轴承数据集上,我们的方法比最佳模型提前约 70 分钟触发警报;在无线胶囊内窥镜图像数据集上,我们的方法达到了 92.82% 的准确率和 88.51% 的灵敏度,始终优于传统的离群点检测算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Displays
Displays 工程技术-工程:电子与电气
CiteScore
4.60
自引率
25.60%
发文量
138
审稿时长
92 days
期刊介绍: Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface. Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信