Nadezhda F. Bahareva, Y. Ushakov, M. Ushakova, D. Parfenov, L. Legashev, I. Bolodurina
{"title":"面向大数据处理的分布式计算自动化平台研究","authors":"Nadezhda F. Bahareva, Y. Ushakov, M. Ushakova, D. Parfenov, L. Legashev, I. Bolodurina","doi":"10.1109/EnT50437.2020.9431254","DOIUrl":null,"url":null,"abstract":"This paper is devoted to the study of the effectiveness of methods for deploying cloud infrastructures to create a distributed computing automation platform for big data processing based on cloud infrastructures. Deployment schemes for Hadoop, Spark architecture based on Docker Swarm and Kubernetes clusters are presented. Also, the development of criteria for evaluating the effectiveness of the distributed computing automation platform for big data processing and an experimental study were carried out.","PeriodicalId":129694,"journal":{"name":"2020 International Conference Engineering and Telecommunication (En&T)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Researching a Distributed Computing Automation Platform for Big Data Processing\",\"authors\":\"Nadezhda F. Bahareva, Y. Ushakov, M. Ushakova, D. Parfenov, L. Legashev, I. Bolodurina\",\"doi\":\"10.1109/EnT50437.2020.9431254\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper is devoted to the study of the effectiveness of methods for deploying cloud infrastructures to create a distributed computing automation platform for big data processing based on cloud infrastructures. Deployment schemes for Hadoop, Spark architecture based on Docker Swarm and Kubernetes clusters are presented. Also, the development of criteria for evaluating the effectiveness of the distributed computing automation platform for big data processing and an experimental study were carried out.\",\"PeriodicalId\":129694,\"journal\":{\"name\":\"2020 International Conference Engineering and Telecommunication (En&T)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Conference Engineering and Telecommunication (En&T)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/EnT50437.2020.9431254\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference Engineering and Telecommunication (En&T)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EnT50437.2020.9431254","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Researching a Distributed Computing Automation Platform for Big Data Processing
This paper is devoted to the study of the effectiveness of methods for deploying cloud infrastructures to create a distributed computing automation platform for big data processing based on cloud infrastructures. Deployment schemes for Hadoop, Spark architecture based on Docker Swarm and Kubernetes clusters are presented. Also, the development of criteria for evaluating the effectiveness of the distributed computing automation platform for big data processing and an experimental study were carried out.