3 Tiers Storage Model for Low Throughput Off-Line Storage

Abstract

The demand of low cost large scale storages increases. Recently, several low throughput storage services such as Pogo plug Cloud have been developed. These services are based on Amazon Glacier. They have low throughput but low cost and large capacity. Therefore, these services are suited to backup or archive big data. They can be used instead of off-line storage tier. The low throughput storage does not have only low throughput but also low reliability of communication path. So, it needs efficient re-transferring mechanism. We proposed a split file model that can represent big data efficiently in low throughput storage. In this split file model, a large file is divided into many small parts and they are stored into a directory. We have developed tool commands to support the transparent way of using split files. Using these commands, replicated data is naturally excluded and effective shallow copying is supported. Furthermore, in this paper, we propose the split file mode based 3 tiers storage.