On achieving high data availability in heterogeneous cloud storage systems

Abstract

In the era of Big data, cloud storage services have become the option of choice to store and share data thanks to their cost-effectiveness and seemingly limitless capacity. The increasing success of these services is driving cloud providers to further improve their storage management systems in order to offer more stringent guarantees on data availability and access time. However, despite recent efforts towards this goal, existing solutions have largely overlooked the heterogeneity of the workloads and the underlying storage components in terms of failure rates, capacity and I/O speed. To fill this gap, we present in this paper a heterogeneity-aware data management scheme (dubbed Heron) based on a genetic algorithm that takes into consideration disk heterogeneity to satisfy SLA requirements in terms of access time and availability and minimizes costs in terms of data migration, storage and energy consumption. Through realistic simulations, we show that Heron significantly improves data availability and access time and ensures minimal storage costs and data migration overhead compared to heterogeneity-oblivious solutions.