{"title":"基于多通道卷积神经网络的磁盘故障预测","authors":"Jian Wu, Haiyang Yu, Zhen Yang, Ruiping Yin","doi":"10.1109/IJCNN52387.2021.9534457","DOIUrl":null,"url":null,"abstract":"With the increase of data centers, the number of disks also grows rapidly. Therefore, the prediction of disk failures has become an important task for both academia and industry. Existing prediction schemes predict disk failure in the short prediction horizon or with a short time window. However, these schemes cannot achieve ideal performance for a long prediction horizon with a long time window. In this paper, we proposed a deep learning method that can effectively solve the above problems. We refine the Self-Monitoring, Analysis and Reporting Technology (SMART) attributes by using information entropy to select the most related attributes for prediction. Moreover, we proposed the Multiple Channel Convolutional Neural Network based LSTM (MCCNN-LSTM) model to predict whether disk failures will occur in a given disk in next few days. We further evaluate the MCCNN-LSTM model by comparing it with the state-of-the-art works. Extensive experiments show that our model can improve FDR (Fault Detection Rate) to 99.8% and reduce FAR (False Alarm Rate) to 0.2%.","PeriodicalId":396583,"journal":{"name":"2021 International Joint Conference on Neural Networks (IJCNN)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Disk Failure Prediction with Multiple Channel Convolutional Neural Network\",\"authors\":\"Jian Wu, Haiyang Yu, Zhen Yang, Ruiping Yin\",\"doi\":\"10.1109/IJCNN52387.2021.9534457\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the increase of data centers, the number of disks also grows rapidly. Therefore, the prediction of disk failures has become an important task for both academia and industry. Existing prediction schemes predict disk failure in the short prediction horizon or with a short time window. However, these schemes cannot achieve ideal performance for a long prediction horizon with a long time window. In this paper, we proposed a deep learning method that can effectively solve the above problems. We refine the Self-Monitoring, Analysis and Reporting Technology (SMART) attributes by using information entropy to select the most related attributes for prediction. Moreover, we proposed the Multiple Channel Convolutional Neural Network based LSTM (MCCNN-LSTM) model to predict whether disk failures will occur in a given disk in next few days. We further evaluate the MCCNN-LSTM model by comparing it with the state-of-the-art works. Extensive experiments show that our model can improve FDR (Fault Detection Rate) to 99.8% and reduce FAR (False Alarm Rate) to 0.2%.\",\"PeriodicalId\":396583,\"journal\":{\"name\":\"2021 International Joint Conference on Neural Networks (IJCNN)\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 International Joint Conference on Neural Networks (IJCNN)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IJCNN52387.2021.9534457\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Joint Conference on Neural Networks (IJCNN)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IJCNN52387.2021.9534457","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
随着数据中心的增加,磁盘的数量也在快速增长。因此,硬盘故障预测已成为学术界和工业界的一项重要任务。现有的预测方案对硬盘故障的预测范围较短或时间窗较短。然而,对于长时间窗口的长预测视界,这些方案不能达到理想的性能。在本文中,我们提出了一种可以有效解决上述问题的深度学习方法。我们利用信息熵对SMART (Self-Monitoring, Analysis and Reporting Technology)属性进行细化,选择相关度最高的属性进行预测。此外,我们提出了基于多通道卷积神经网络的LSTM (MCCNN-LSTM)模型来预测给定磁盘在未来几天内是否会发生故障。我们进一步评估了MCCNN-LSTM模型,将其与最先进的作品进行比较。大量的实验表明,我们的模型可以将故障检测率(FDR)提高到99.8%,将误报率(FAR)降低到0.2%。
Disk Failure Prediction with Multiple Channel Convolutional Neural Network
With the increase of data centers, the number of disks also grows rapidly. Therefore, the prediction of disk failures has become an important task for both academia and industry. Existing prediction schemes predict disk failure in the short prediction horizon or with a short time window. However, these schemes cannot achieve ideal performance for a long prediction horizon with a long time window. In this paper, we proposed a deep learning method that can effectively solve the above problems. We refine the Self-Monitoring, Analysis and Reporting Technology (SMART) attributes by using information entropy to select the most related attributes for prediction. Moreover, we proposed the Multiple Channel Convolutional Neural Network based LSTM (MCCNN-LSTM) model to predict whether disk failures will occur in a given disk in next few days. We further evaluate the MCCNN-LSTM model by comparing it with the state-of-the-art works. Extensive experiments show that our model can improve FDR (Fault Detection Rate) to 99.8% and reduce FAR (False Alarm Rate) to 0.2%.