Scality's experience with a geo-distributed file system

Abstract

This paper presents our experience in building a large scale geo-distributed file system for a leading telecommunications service provider in France; the system, which spans two data centers in Paris and Lyon, is capable of storing 4.02PB of data. We use a structured P2P network protocol based on consistent hashing for scalability and load balancing. We combine different setups that ensure availability and consistency. We report the measurements, and issues encountered during one year of the production system; measurements show that our approach scales with real-world workloads.