Juan Chen, Rui Zhang, Peng Chen, Jianhua Ren, Zongling Wu, Yang Wang, Xi Li, Ling Xiong
{"title":"MTG_CD: Multi-scale learnable transformation graph for fault classification and diagnosis in microservices","authors":"Juan Chen, Rui Zhang, Peng Chen, Jianhua Ren, Zongling Wu, Yang Wang, Xi Li, Ling Xiong","doi":"10.1186/s13677-024-00666-0","DOIUrl":null,"url":null,"abstract":"The rapid advancement of microservice architecture in the cloud has led to the necessity of effectively detecting, classifying, and diagnosing run failures in microservice applications. Due to the high dynamics of cloud environments and the complex dependencies between microservices, it is challenging to achieve robust real-time system fault identification. This paper proposes an interpretable fault diagnosis framework tailored for microservice architecture, namely Multi-scale Learnable Transformation Graph for Fault Classification and Diagnosis(MTG_CD). Firstly, we employ multi-scale neural transformation and graph structure adjacency matrix learning to enhance data diversity while extracting temporal-structural features from system monitoring metrics Secondly, a graph convolutional network (GCN) is utilized to fuse the extracted temporal-structural features in a multi-feature modeling approach, which helps to improve the accuracy of anomaly detection. To identify the root cause of system faults, we finally conduct a coarse-grained level diagnosis and exploration after obtaining the results of classifying the fault data. We evaluate the performance of MTG_CD on the microservice benchmark SockShop, demonstrating its superiority over several baseline methods in detecting CPU usage overhead, memory leak, and network delay faults. The average macro F1 score improves by 14.05%.","PeriodicalId":501257,"journal":{"name":"Journal of Cloud Computing","volume":"66 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Cloud Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s13677-024-00666-0","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The rapid advancement of microservice architecture in the cloud has led to the necessity of effectively detecting, classifying, and diagnosing run failures in microservice applications. Due to the high dynamics of cloud environments and the complex dependencies between microservices, it is challenging to achieve robust real-time system fault identification. This paper proposes an interpretable fault diagnosis framework tailored for microservice architecture, namely Multi-scale Learnable Transformation Graph for Fault Classification and Diagnosis(MTG_CD). Firstly, we employ multi-scale neural transformation and graph structure adjacency matrix learning to enhance data diversity while extracting temporal-structural features from system monitoring metrics Secondly, a graph convolutional network (GCN) is utilized to fuse the extracted temporal-structural features in a multi-feature modeling approach, which helps to improve the accuracy of anomaly detection. To identify the root cause of system faults, we finally conduct a coarse-grained level diagnosis and exploration after obtaining the results of classifying the fault data. We evaluate the performance of MTG_CD on the microservice benchmark SockShop, demonstrating its superiority over several baseline methods in detecting CPU usage overhead, memory leak, and network delay faults. The average macro F1 score improves by 14.05%.
云计算中微服务架构的快速发展导致了有效检测、分类和诊断微服务应用程序运行故障的必要性。由于云环境的高动态性和微服务之间的复杂依赖性,实现稳健的实时系统故障识别具有挑战性。本文针对微服务架构提出了一种可解释的故障诊断框架,即用于故障分类和诊断的多尺度可学习转换图(Multi-scale Learnable Transformation Graph for Fault Classification and Diagnosis,MTG_CD)。首先,我们利用多尺度神经变换和图结构邻接矩阵学习来增强数据的多样性,同时从系统监控指标中提取时间结构特征;其次,利用图卷积网络(GCN)将提取的时间结构特征融合到多特征建模方法中,这有助于提高异常检测的准确性。为了找出系统故障的根本原因,我们在获得故障数据分类结果后,最终进行粗粒度诊断和探索。我们在微服务基准 SockShop 上评估了 MTG_CD 的性能,证明它在检测 CPU 使用开销、内存泄漏和网络延迟故障方面优于几种基准方法。平均宏 F1 分数提高了 14.05%。