{"title":"基于擦除编码的分布式文件系统模型","authors":"Yu-Feng Han, Hui Li, Hanxu Hou","doi":"10.1109/APCLOUDCC.2012.6486519","DOIUrl":null,"url":null,"abstract":"Today's exponential growth in network bandwidth and storage capacity has inspired different classes of distributed storage infrastructures. However replication has become the actual way for storing data across data centers, no matter the system is centralized framework or peer-to-peer infrastructure. Erasure code, which is well researched and more space efficient than replication, has multiple tradeoffs that need to be seriously considered. In this paper, we present an erasure-coding-based model coupled with hadoop library, and we call it the Erasure-Coding-Based Distributed File System. We discuss the detailed design of our model and provide some recommendations on other coding strategy for distributed file systems.","PeriodicalId":331441,"journal":{"name":"2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A model of Erasure-Coding-Based Distributed File System\",\"authors\":\"Yu-Feng Han, Hui Li, Hanxu Hou\",\"doi\":\"10.1109/APCLOUDCC.2012.6486519\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Today's exponential growth in network bandwidth and storage capacity has inspired different classes of distributed storage infrastructures. However replication has become the actual way for storing data across data centers, no matter the system is centralized framework or peer-to-peer infrastructure. Erasure code, which is well researched and more space efficient than replication, has multiple tradeoffs that need to be seriously considered. In this paper, we present an erasure-coding-based model coupled with hadoop library, and we call it the Erasure-Coding-Based Distributed File System. We discuss the detailed design of our model and provide some recommendations on other coding strategy for distributed file systems.\",\"PeriodicalId\":331441,\"journal\":{\"name\":\"2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)\",\"volume\":\"72 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2012-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/APCLOUDCC.2012.6486519\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APCLOUDCC.2012.6486519","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A model of Erasure-Coding-Based Distributed File System
Today's exponential growth in network bandwidth and storage capacity has inspired different classes of distributed storage infrastructures. However replication has become the actual way for storing data across data centers, no matter the system is centralized framework or peer-to-peer infrastructure. Erasure code, which is well researched and more space efficient than replication, has multiple tradeoffs that need to be seriously considered. In this paper, we present an erasure-coding-based model coupled with hadoop library, and we call it the Erasure-Coding-Based Distributed File System. We discuss the detailed design of our model and provide some recommendations on other coding strategy for distributed file systems.