{"title":"S3、HDFS和RDS存储技术在实时大数据应用中的性能比较","authors":"Alaa Jamal, Rita Fleiner, E. Kail","doi":"10.1109/SACI51354.2021.9465594","DOIUrl":null,"url":null,"abstract":"Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).","PeriodicalId":321907,"journal":{"name":"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Performance Comparison between S3, HDFS and RDS storage technologies for real-time big-data applications\",\"authors\":\"Alaa Jamal, Rita Fleiner, E. Kail\",\"doi\":\"10.1109/SACI51354.2021.9465594\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).\",\"PeriodicalId\":321907,\"journal\":{\"name\":\"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SACI51354.2021.9465594\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 15th International Symposium on Applied Computational Intelligence and Informatics (SACI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SACI51354.2021.9465594","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Performance Comparison between S3, HDFS and RDS storage technologies for real-time big-data applications
Low latency and fast delivery became crucial challenges in real-time applications of Big Data and remained a hot research topic. This research sheds light on the performance differences between three types of storage technologies, which are: the storage rational database system (MySQL), object storage (S3), which is powered by Amazon Cloud Services, and the Hadoop distributed file system (HDFS). Four system architectures with three different storage technologies were tested on AWS cloud environment with many complex queries to determine the most appropriate technology for real-time applications (i.e., web application, air traffic control systems, networked multimedia systems, command control systems) in terms of speed (computation time), network overload, and cost (price).