A multidimensional time-series association rules algorithm based on spark

Dongyue Liu, Bin Wu, Chao Gu, Yan Ma, Bai Wang
{"title":"A multidimensional time-series association rules algorithm based on spark","authors":"Dongyue Liu, Bin Wu, Chao Gu, Yan Ma, Bai Wang","doi":"10.1109/FSKD.2017.8393066","DOIUrl":null,"url":null,"abstract":"Fault prediction of industrial systems has been a hot research orientation in recent years, which allows the maintainer to know the operation conditions and the fault to be occurred in advance so as to reduce the risk of fault and the economic loss. In general, association rules learning is one of the most effective methods in fault prediction of industrial systems, however, traditional methods based on association rules are not suitable for sparse time-series data that are common in industrial systems (e.g. transmission line data). Although some methods based on clustering to reduce the dimension of data have been proposed, these methods may lose some of the key rules from the dataset and reduce the effectiveness of the results. In order to solve the problem, we propose a novel algorithm called Multidimensional Time-series Association Rules(MTAR) in this paper, which can fully utilize the information and find out more valuable rules from multidimensional time-series data. Meanwhile, we implement the parallelization of the algorithm based on the parallel computing framework Spark, which can improve the performance of the algorithm greatly. Experiments are conducted on the transmission line dataset in Power Grid System to show the effectiveness and the efficiency of the proposed approach.","PeriodicalId":236093,"journal":{"name":"2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/FSKD.2017.8393066","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Fault prediction of industrial systems has been a hot research orientation in recent years, which allows the maintainer to know the operation conditions and the fault to be occurred in advance so as to reduce the risk of fault and the economic loss. In general, association rules learning is one of the most effective methods in fault prediction of industrial systems, however, traditional methods based on association rules are not suitable for sparse time-series data that are common in industrial systems (e.g. transmission line data). Although some methods based on clustering to reduce the dimension of data have been proposed, these methods may lose some of the key rules from the dataset and reduce the effectiveness of the results. In order to solve the problem, we propose a novel algorithm called Multidimensional Time-series Association Rules(MTAR) in this paper, which can fully utilize the information and find out more valuable rules from multidimensional time-series data. Meanwhile, we implement the parallelization of the algorithm based on the parallel computing framework Spark, which can improve the performance of the algorithm greatly. Experiments are conducted on the transmission line dataset in Power Grid System to show the effectiveness and the efficiency of the proposed approach.
基于spark的多维时间序列关联规则算法
工业系统故障预测是近年来的一个热点研究方向,它可以使维护人员提前知道系统的运行状况和可能发生的故障,从而降低故障的风险和经济损失。一般来说,关联规则学习是工业系统故障预测中最有效的方法之一,但传统的基于关联规则的方法并不适合工业系统中常见的稀疏时间序列数据(如传输线数据)。虽然已经提出了一些基于聚类的数据降维方法,但这些方法可能会丢失数据集中的一些关键规则,从而降低结果的有效性。为了解决这一问题,本文提出了一种新的算法——多维时间序列关联规则(MTAR),该算法可以充分利用这些信息,从多维时间序列数据中发现更多有价值的规则。同时,我们基于并行计算框架Spark实现了算法的并行化,大大提高了算法的性能。在电网系统的输电线路数据集上进行了实验,验证了该方法的有效性和高效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信