S3、HDFS和RDS存储技术在实时大数据应用中的性能比较

Alaa Jamal, Rita Fleiner, E. Kail
{"title":"S3、HDFS和RDS存储技术在实时大数据应用中的性能比较","authors":"Alaa Jamal, Rita Fleiner, E. Kail","doi":"10.1109/SACI51354.2021.9465594","DOIUrl":null,"url":null,"abstract":"Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).","PeriodicalId":321907,"journal":{"name":"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Performance Comparison between S3, HDFS and RDS storage technologies for real-time big-data applications\",\"authors\":\"Alaa Jamal, Rita Fleiner, E. Kail\",\"doi\":\"10.1109/SACI51354.2021.9465594\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).\",\"PeriodicalId\":321907,\"journal\":{\"name\":\"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SACI51354.2021.9465594\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SACI51354.2021.9465594","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

低延迟和快速交付成为大数据实时应用的关键挑战,一直是研究热点。本研究揭示了三种存储技术之间的性能差异,这三种存储技术分别是:存储理性数据库系统(MySQL)、对象存储(S3)(由Amazon Cloud Services提供支持)和Hadoop分布式文件系统(HDFS)。采用三种不同存储技术的四种系统架构在AWS云环境上进行了测试,并进行了许多复杂的查询,以确定在速度(计算时间)、网络过载和成本(价格)方面最适合实时应用(即web应用、空中交通管制系统、网络化多媒体系统、指挥控制系统)的技术。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Performance Comparison between S3, HDFS and RDS storage technologies for real-time big-data applications
Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信