Scality在地理分布式文件系统方面的经验

Proceedings of the Posters and Demos Session of the 15th International Middleware Conference Pub Date : 2014-12-08 DOI:10.1145/2678508.2678524

M. Segura, Vianney Rancurel, Vinh Tao, M. Shapiro

{"title":"Scality在地理分布式文件系统方面的经验","authors":"M. Segura, Vianney Rancurel, Vinh Tao, M. Shapiro","doi":"10.1145/2678508.2678524","DOIUrl":null,"url":null,"abstract":"This paper presents our experience in building a large scale geo-distributed file system for a leading telecommunications service provider in France; the system, which spans two data centers in Paris and Lyon, is capable of storing 4.02PB of data. We use a structured P2P network protocol based on consistent hashing for scalability and load balancing. We combine different setups that ensure availability and consistency. We report the measurements, and issues encountered during one year of the production system; measurements show that our approach scales with real-world workloads.","PeriodicalId":412543,"journal":{"name":"Proceedings of the Posters and Demos Session of the 15th International Middleware Conference","volume":"39 9-10","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Scality's experience with a geo-distributed file system\",\"authors\":\"M. Segura, Vianney Rancurel, Vinh Tao, M. Shapiro\",\"doi\":\"10.1145/2678508.2678524\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents our experience in building a large scale geo-distributed file system for a leading telecommunications service provider in France; the system, which spans two data centers in Paris and Lyon, is capable of storing 4.02PB of data. We use a structured P2P network protocol based on consistent hashing for scalability and load balancing. We combine different setups that ensure availability and consistency. We report the measurements, and issues encountered during one year of the production system; measurements show that our approach scales with real-world workloads.\",\"PeriodicalId\":412543,\"journal\":{\"name\":\"Proceedings of the Posters and Demos Session of the 15th International Middleware Conference\",\"volume\":\"39 9-10\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-12-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Posters and Demos Session of the 15th International Middleware Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/2678508.2678524\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Posters and Demos Session of the 15th International Middleware Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/2678508.2678524","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 3

摘要

本文介绍了我们为法国一家领先的电信服务提供商构建大规模地理分布式文件系统的经验;该系统横跨巴黎和里昂的两个数据中心，能够存储4.02PB的数据。我们使用基于一致散列的结构化P2P网络协议来实现可伸缩性和负载平衡。我们将不同的设置组合起来，以确保可用性和一致性。我们报告测量结果，以及在生产系统的一年中遇到的问题;测量结果表明，我们的方法适用于实际工作负载。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Scality's experience with a geo-distributed file system

This paper presents our experience in building a large scale geo-distributed file system for a leading telecommunications service provider in France; the system, which spans two data centers in Paris and Lyon, is capable of storing 4.02PB of data. We use a structured P2P network protocol based on consistent hashing for scalability and load balancing. We combine different setups that ensure availability and consistency. We report the measurements, and issues encountered during one year of the production system; measurements show that our approach scales with real-world workloads.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Proceedings of the Posters and Demos Session of the 15th International Middleware Conference

自引率

0.00%

发文量