Cloud storage of massive remote sensing data based on distributed file system

Abstract

Cloud storage is an effective means to solve the storage and management challenges of the growing mass remote sensing data products. In order to settle the problems existing in the application of cloud storage for remote sensing data, a distributed storage module based on image blocks organization was put forward, and the inefficient problem of distributed file system in massive image blocks storage was solved. In the combination of the module and HDFS, the efficient distributed storage and retrieval of image data were implemented, and the ability of spatial data access of the remote sensing data cloud storage was enabled. As built upon distributed file system, the storage system has a good scalability to meet the requirements of data growing. The experiment and analysis showed that the storage system could maintain a high throughput and stability under multiple concurrent connections.