应用Prefixed-Itemset和压缩矩阵优化Hadoop基于mapreduce的Apriori算法

Ruiqi Sun, Yuqiang Li
{"title":"应用Prefixed-Itemset和压缩矩阵优化Hadoop基于mapreduce的Apriori算法","authors":"Ruiqi Sun, Yuqiang Li","doi":"10.1145/3384544.3384610","DOIUrl":null,"url":null,"abstract":"Apriori algorithm is the classical algorithm for mining association rules. However, it also has some problems, such as comparing the identical itemset repeatedly and scanning the external storage database frequently. Based on the previous research, this paper proposed a method of applying the prefixed-itemset and the compression matrix to optimize the connection step, pruning step, support counting step and transaction storage mode of the Apriori algorithm. The experimental results show that compared with the conventional Apriori algorithm, the optimized Apriori algorithm has more powerful mining efficiency and more excellent performance.","PeriodicalId":200246,"journal":{"name":"Proceedings of the 2020 9th International Conference on Software and Computer Applications","volume":"201 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Applying Prefixed-Itemset and Compression Matrix to Optimize the MapReduce-based Apriori Algorithm on Hadoop\",\"authors\":\"Ruiqi Sun, Yuqiang Li\",\"doi\":\"10.1145/3384544.3384610\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Apriori algorithm is the classical algorithm for mining association rules. However, it also has some problems, such as comparing the identical itemset repeatedly and scanning the external storage database frequently. Based on the previous research, this paper proposed a method of applying the prefixed-itemset and the compression matrix to optimize the connection step, pruning step, support counting step and transaction storage mode of the Apriori algorithm. The experimental results show that compared with the conventional Apriori algorithm, the optimized Apriori algorithm has more powerful mining efficiency and more excellent performance.\",\"PeriodicalId\":200246,\"journal\":{\"name\":\"Proceedings of the 2020 9th International Conference on Software and Computer Applications\",\"volume\":\"201 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-02-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2020 9th International Conference on Software and Computer Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3384544.3384610\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2020 9th International Conference on Software and Computer Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3384544.3384610","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

Apriori算法是挖掘关联规则的经典算法。但是,它也存在重复比较同一项集和频繁扫描外部存储数据库等问题。在前人研究的基础上,本文提出了一种利用前缀项集和压缩矩阵对Apriori算法的连接步骤、剪枝步骤、支持计数步骤和事务存储方式进行优化的方法。实验结果表明,与传统的Apriori算法相比,优化后的Apriori算法具有更强大的挖掘效率和更优异的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Applying Prefixed-Itemset and Compression Matrix to Optimize the MapReduce-based Apriori Algorithm on Hadoop
Apriori algorithm is the classical algorithm for mining association rules. However, it also has some problems, such as comparing the identical itemset repeatedly and scanning the external storage database frequently. Based on the previous research, this paper proposed a method of applying the prefixed-itemset and the compression matrix to optimize the connection step, pruning step, support counting step and transaction storage mode of the Apriori algorithm. The experimental results show that compared with the conventional Apriori algorithm, the optimized Apriori algorithm has more powerful mining efficiency and more excellent performance.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信