A Data Distribution Service for Cloud and Containerized Storage Based on Information Dispersal

2018 IEEE Symposium on Service-Oriented System Engineering (SOSE) Pub Date : 2018-03-26 DOI:10.1109/SOSE.2018.00020

Pablo Morales-Ferreira, Miguel Santiago-Duran, Cristopher Gaytan-Diaz, J. L. González, Víctor Jesús Sosa Sosa, I. Lopez-Arevalo

{"title":"A Data Distribution Service for Cloud and Containerized Storage Based on Information Dispersal","authors":"Pablo Morales-Ferreira, Miguel Santiago-Duran, Cristopher Gaytan-Diaz, J. L. González, Víctor Jesús Sosa Sosa, I. Lopez-Arevalo","doi":"10.1109/SOSE.2018.00020","DOIUrl":null,"url":null,"abstract":"Information dispersal is a fault-tolerant technique where files of size |F| are split into n redundant pieces of size |F|/k that are dispersed to different servers where k pieces suffice for recovering the original file whenever k<n. This technique is a popular solution for service providers to withstand server failures and to improve the storage utilization. However, the coding/decoding service time produced by this technique as well as the management of pieces of heterogeneous size, that belong to different files, represent both a challenge for the deployment of this technique on clouds and clusters. This paper presents the design and development of a data distribution service for fault-tolerant cloud/cluster storage. This service includes an information dispersal client for coding/decoding files in-memory, which improves the service experience of end-users when delivering/retrieving files to/from cloud storage services. It also includes a data placement method to allocate, locate and manage redundant pieces of heterogeneous size in a uniform manner, which produces load balancing in the storage nodes. A prototype of this service was implemented in a private cloud and containerized cluster. An experimental evaluation based on synthetic traces and a case study based on satellite images revealed that the service prototype preserved a balanced load even in scenarios when managing pieces of heterogeneous size and that, when performing coding/decoding in-memory, the service experience of end-users was improved in comparison with tested traditional solutions.","PeriodicalId":414464,"journal":{"name":"2018 IEEE Symposium on Service-Oriented System Engineering (SOSE)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE Symposium on Service-Oriented System Engineering (SOSE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SOSE.2018.00020","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 10

Abstract

Information dispersal is a fault-tolerant technique where files of size |F| are split into n redundant pieces of size |F|/k that are dispersed to different servers where k pieces suffice for recovering the original file whenever k

查看原文本刊更多论文

一种基于信息分散的云存储和容器存储数据分发服务

信息分散是一种容错技术，其中大小为|F|的文件被分割成n个大小为|F|/k的冗余块，分散到不同的服务器上，其中k个块足以在k

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊