PA-Rank:基于GAN和强化学习的多度量异常检测和原因诊断框架

IF 8.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Zhaowen Wang;Yong Zhou;YangSiyu Zhang;Fengyu Cong;Dongdong Zhou;Zhijian An
{"title":"PA-Rank:基于GAN和强化学习的多度量异常检测和原因诊断框架","authors":"Zhaowen Wang;Yong Zhou;YangSiyu Zhang;Fengyu Cong;Dongdong Zhou;Zhijian An","doi":"10.1109/JIOT.2025.3567091","DOIUrl":null,"url":null,"abstract":"The increasing scale and complexity of modern IT systems necessitate advanced solutions for monitoring and managing performance anomalies. Artificial intelligence for IT operations (AIOps) has emerged as a promising approach to enhance the efficiency and effectiveness of IT operations. However, existing methods struggle with effectively detecting anomalies in multidimensional performance data and accurately identifying their root causes in complex interdependent systems. This article proposes a novel framework, PA-Rank, that combines generative adversarial networks (GANs), reinforcement learning, and graph-based methods to address these challenges comprehensively. For anomaly detection, an unsupervised GAN-based model is developed to identify anomalous time periods and assign weighted scores to metrics, facilitating precise anomaly identification. For root cause localization, a causal graph construction model (CGCM) has been developed, utilizing a reinforcement learning-based causal discovery method that is integrated with graph attention networks (GAT) to construct a causal graph representing the relationships between metrics. A random walk algorithm further ranks metric importance during anomalies, enabling effective root cause localization. Extensive experiments on real-world datasets, including server machine dataset (SMD), ASD, and DAMADICS, demonstrate the superiority of PA-Rank over traditional statistical and state-of-the-art machine learning methods. On the SMD dataset, the proposed framework achieved an F1 score of 0.9542 for anomaly detection and consistently identified root causes among top-ranked candidates on the Pymicro and RMS datasets with the highest PR@Avg scores. These results underscore PA-Rank’s efficacy in diagnosing performance anomalies and supporting efficient system maintenance.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 14","pages":"28889-28898"},"PeriodicalIF":8.9000,"publicationDate":"2025-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PA-Rank: A GAN and Reinforcement Learning Powered Framework for Multimetric Anomaly Detection and Causal Diagnosis\",\"authors\":\"Zhaowen Wang;Yong Zhou;YangSiyu Zhang;Fengyu Cong;Dongdong Zhou;Zhijian An\",\"doi\":\"10.1109/JIOT.2025.3567091\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The increasing scale and complexity of modern IT systems necessitate advanced solutions for monitoring and managing performance anomalies. Artificial intelligence for IT operations (AIOps) has emerged as a promising approach to enhance the efficiency and effectiveness of IT operations. However, existing methods struggle with effectively detecting anomalies in multidimensional performance data and accurately identifying their root causes in complex interdependent systems. This article proposes a novel framework, PA-Rank, that combines generative adversarial networks (GANs), reinforcement learning, and graph-based methods to address these challenges comprehensively. For anomaly detection, an unsupervised GAN-based model is developed to identify anomalous time periods and assign weighted scores to metrics, facilitating precise anomaly identification. For root cause localization, a causal graph construction model (CGCM) has been developed, utilizing a reinforcement learning-based causal discovery method that is integrated with graph attention networks (GAT) to construct a causal graph representing the relationships between metrics. A random walk algorithm further ranks metric importance during anomalies, enabling effective root cause localization. Extensive experiments on real-world datasets, including server machine dataset (SMD), ASD, and DAMADICS, demonstrate the superiority of PA-Rank over traditional statistical and state-of-the-art machine learning methods. On the SMD dataset, the proposed framework achieved an F1 score of 0.9542 for anomaly detection and consistently identified root causes among top-ranked candidates on the Pymicro and RMS datasets with the highest PR@Avg scores. These results underscore PA-Rank’s efficacy in diagnosing performance anomalies and supporting efficient system maintenance.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 14\",\"pages\":\"28889-28898\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-03-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10988663/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10988663/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

现代IT系统日益增长的规模和复杂性需要先进的解决方案来监控和管理性能异常。IT运营人工智能(AIOps)已经成为提高IT运营效率和有效性的一种有前途的方法。然而,现有的方法难以有效地检测多维性能数据中的异常,并在复杂的相互依存系统中准确识别其根本原因。本文提出了一个新的框架,PA-Rank,它结合了生成对抗网络(gan)、强化学习和基于图的方法来全面解决这些挑战。对于异常检测,开发了一种基于无监督gan的模型来识别异常时间段,并为指标分配加权分数,从而促进精确的异常识别。针对根本原因定位,本文建立了因果图构建模型(CGCM),利用基于强化学习的因果发现方法与图注意网络(GAT)相结合,构建了表征指标间关系的因果图。随机游走算法进一步对异常期间的度量重要性进行排序,从而实现有效的根本原因定位。在真实世界的数据集上进行的大量实验,包括服务器机器数据集(SMD)、ASD和DAMADICS,证明了PA-Rank优于传统的统计和最先进的机器学习方法。在SMD数据集上,该框架在异常检测方面的F1得分为0.9542,并在Pymicro和RMS数据集上得分最高的PR@Avg数据集中一致地识别出排名前几位的候选人的根本原因。这些结果强调了PA-Rank在诊断性能异常和支持高效系统维护方面的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
PA-Rank: A GAN and Reinforcement Learning Powered Framework for Multimetric Anomaly Detection and Causal Diagnosis
The increasing scale and complexity of modern IT systems necessitate advanced solutions for monitoring and managing performance anomalies. Artificial intelligence for IT operations (AIOps) has emerged as a promising approach to enhance the efficiency and effectiveness of IT operations. However, existing methods struggle with effectively detecting anomalies in multidimensional performance data and accurately identifying their root causes in complex interdependent systems. This article proposes a novel framework, PA-Rank, that combines generative adversarial networks (GANs), reinforcement learning, and graph-based methods to address these challenges comprehensively. For anomaly detection, an unsupervised GAN-based model is developed to identify anomalous time periods and assign weighted scores to metrics, facilitating precise anomaly identification. For root cause localization, a causal graph construction model (CGCM) has been developed, utilizing a reinforcement learning-based causal discovery method that is integrated with graph attention networks (GAT) to construct a causal graph representing the relationships between metrics. A random walk algorithm further ranks metric importance during anomalies, enabling effective root cause localization. Extensive experiments on real-world datasets, including server machine dataset (SMD), ASD, and DAMADICS, demonstrate the superiority of PA-Rank over traditional statistical and state-of-the-art machine learning methods. On the SMD dataset, the proposed framework achieved an F1 score of 0.9542 for anomaly detection and consistently identified root causes among top-ranked candidates on the Pymicro and RMS datasets with the highest PR@Avg scores. These results underscore PA-Rank’s efficacy in diagnosing performance anomalies and supporting efficient system maintenance.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Internet of Things Journal
IEEE Internet of Things Journal Computer Science-Information Systems
CiteScore
17.60
自引率
13.20%
发文量
1982
期刊介绍: The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信