通过滑动窗口挖掘数据流中的频繁模式

Feng Wu, Quanyuan Wu, Yan Zhong, Xin Jin
{"title":"通过滑动窗口挖掘数据流中的频繁模式","authors":"Feng Wu, Quanyuan Wu, Yan Zhong, Xin Jin","doi":"10.1109/CISE.2009.5363461","DOIUrl":null,"url":null,"abstract":"Frequent pattern mining in data stream is an important task. Under the time decay model, this paper presents a new algorithm SWFP for mining frequent patterns over sliding windows. The new definitions of the infrequent, critical and frequent patterns which reflect the actual statistical property of each pattern within the sliding windows, grasp the real substance of mining process and help to improve the mining quality essentially. The support decay mechanism is designed not only to differentiate the current and history transaction, but also to make the online pattern maintain operation easily and accurately. The reasonable strategy for the pattern pruning periodically is used to make big cuts in the maintenance cost and the error controlled in a small bound. Theoretical analysis guarantees no false negatives of SWFP. Experimental evaluation over a number of synthetic data sets demonstrates the efficiency and scalability of our method. Keywords-frequent pattern mining; sliding windows; time decay model; data stream","PeriodicalId":135441,"journal":{"name":"2009 International Conference on Computational Intelligence and Software Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2009-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Mining Frequent Patterns in Data Stream over Sliding Windows\",\"authors\":\"Feng Wu, Quanyuan Wu, Yan Zhong, Xin Jin\",\"doi\":\"10.1109/CISE.2009.5363461\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Frequent pattern mining in data stream is an important task. Under the time decay model, this paper presents a new algorithm SWFP for mining frequent patterns over sliding windows. The new definitions of the infrequent, critical and frequent patterns which reflect the actual statistical property of each pattern within the sliding windows, grasp the real substance of mining process and help to improve the mining quality essentially. The support decay mechanism is designed not only to differentiate the current and history transaction, but also to make the online pattern maintain operation easily and accurately. The reasonable strategy for the pattern pruning periodically is used to make big cuts in the maintenance cost and the error controlled in a small bound. Theoretical analysis guarantees no false negatives of SWFP. Experimental evaluation over a number of synthetic data sets demonstrates the efficiency and scalability of our method. Keywords-frequent pattern mining; sliding windows; time decay model; data stream\",\"PeriodicalId\":135441,\"journal\":{\"name\":\"2009 International Conference on Computational Intelligence and Software Engineering\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2009-12-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2009 International Conference on Computational Intelligence and Software Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CISE.2009.5363461\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2009 International Conference on Computational Intelligence and Software Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CISE.2009.5363461","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5

摘要

数据流中的频繁模式挖掘是一项重要任务。在时间衰减模型下,提出了一种挖掘滑动窗口上频繁模式的新算法SWFP。新定义的不频繁模式、关键模式和频繁模式反映了滑动窗口内每种模式的实际统计性质,从本质上把握了挖掘过程的实质,有助于提高挖掘质量。设计了支持衰减机制,既能区分当前事务和历史事务,又能使在线模式维护操作方便、准确。采用合理的模式周期性剪枝策略,使维护成本大幅度降低,误差控制在小范围内。理论分析保证SWFP不存在假阴性。在许多合成数据集上的实验评估证明了我们的方法的有效性和可扩展性。关键词:频繁模式挖掘;滑动窗口;时间衰减模型;数据流
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Mining Frequent Patterns in Data Stream over Sliding Windows
Frequent pattern mining in data stream is an important task. Under the time decay model, this paper presents a new algorithm SWFP for mining frequent patterns over sliding windows. The new definitions of the infrequent, critical and frequent patterns which reflect the actual statistical property of each pattern within the sliding windows, grasp the real substance of mining process and help to improve the mining quality essentially. The support decay mechanism is designed not only to differentiate the current and history transaction, but also to make the online pattern maintain operation easily and accurately. The reasonable strategy for the pattern pruning periodically is used to make big cuts in the maintenance cost and the error controlled in a small bound. Theoretical analysis guarantees no false negatives of SWFP. Experimental evaluation over a number of synthetic data sets demonstrates the efficiency and scalability of our method. Keywords-frequent pattern mining; sliding windows; time decay model; data stream
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信