Research of Massive Spatiotemporal Data Mining Technology Based onCloud Computing

Shuxia Wang, Z. Xiong
{"title":"Research of Massive Spatiotemporal Data Mining Technology Based onCloud Computing","authors":"Shuxia Wang, Z. Xiong","doi":"10.2174/1874444301507012244","DOIUrl":null,"url":null,"abstract":"This paper mainly discusses developing a new mass data analysis system in the face of the challenges, based on cloud computing technology, cloud service provided by Amazon and HBase. Based on the research of the EC2, S3 and EMR service provided by Amazon and on the detailed analysis of the client reception server and data handling server of the data analysis system, this paper tries to create a preliminary model of the system. Then, each model and whole system is finalized according to actual demand. Finally, system test and performance test prove that the system can solve the problems faced by traditional data analysis system. The research runs through the whole process of data analytical system design and implementation. Firstly, we present the problem domain and requirements. By investigating the traditional data analysis system and by analyzing the problems existing in this system, we raise the developing requirements of the mas- sive data analysis system based on cloud computing, and point out that the key points of the new system implementation are receiving server and data processing design. Secondly, we design and realize each module of the massive data analysis system. Finally, results of system test and performance test prove that the new data analysis system is stable and that the requirements are satisfied.","PeriodicalId":153592,"journal":{"name":"The Open Automation and Control Systems Journal","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Open Automation and Control Systems Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2174/1874444301507012244","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This paper mainly discusses developing a new mass data analysis system in the face of the challenges, based on cloud computing technology, cloud service provided by Amazon and HBase. Based on the research of the EC2, S3 and EMR service provided by Amazon and on the detailed analysis of the client reception server and data handling server of the data analysis system, this paper tries to create a preliminary model of the system. Then, each model and whole system is finalized according to actual demand. Finally, system test and performance test prove that the system can solve the problems faced by traditional data analysis system. The research runs through the whole process of data analytical system design and implementation. Firstly, we present the problem domain and requirements. By investigating the traditional data analysis system and by analyzing the problems existing in this system, we raise the developing requirements of the mas- sive data analysis system based on cloud computing, and point out that the key points of the new system implementation are receiving server and data processing design. Secondly, we design and realize each module of the massive data analysis system. Finally, results of system test and performance test prove that the new data analysis system is stable and that the requirements are satisfied.
基于云计算的海量时空数据挖掘技术研究
面对挑战,本文主要讨论基于云计算技术、Amazon提供的云服务和HBase开发一种新的海量数据分析系统。本文在对亚马逊提供的EC2、S3和EMR服务进行研究的基础上,在对数据分析系统的客户端接收服务器和数据处理服务器进行详细分析的基础上,尝试建立系统的初步模型。然后根据实际需求对各个模型和整个系统进行定型。最后通过系统测试和性能测试,证明该系统能够解决传统数据分析系统所面临的问题。本研究贯穿于数据分析系统设计与实现的全过程。首先,提出了问题域和需求。通过对传统数据分析系统的考察,分析了该系统存在的问题,提出了基于云计算的海量数据分析系统的开发要求,并指出了新系统实现的关键是接收服务器和数据处理设计。其次,对海量数据分析系统的各个模块进行了设计和实现。最后,系统测试和性能测试结果表明,新数据分析系统运行稳定,能够满足要求。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信