HCFS2: A File Storage Service with Weak Consistency in the Hybrid Cloud

Abstract

In the hybrid cloud, multiple private and public clouds usually communicate through Wide Area Networks (WAN), suffering from high latency and low bandwidth for inter-cloud data transmission. While existing DFSs are widely used in a single cloud, they may bring significant I/O delay in the hybrid cloud where, based on our investigation, applications are sensitive to latency but barely rely on strictly consistent storage. However, existing DFSs are mainly designed with strong consistency semantics. To address this problem, we implement HCFS2 (Hybrid Cloud File Storage Service). We reuse some components of MooseFS while weakening its consistency semantics. HCFS2 holds three main features: (1) It generates file update digests through intercepting and parsing client I/O operations in userspace, and leverages gossip protocol to distribute file update digests among geographically distributed servers. (2) It maintains weak consistency among storage servers in the hybrid cloud, and it uses a two-level consistency setup to ensure local consistency and global consistency, respectively. (3) It maintains three Log queues to simplify the Log management and uses different task queues to parallelize different processing stages for synchronization, thus improving its concurrent operation performance. Experiment results show that HCFS2 achieves good performance in the hybrid cloud.