{"title":"基于分布式文件系统的海量遥感数据云存储","authors":"Ziwen Chi, Feng Zhang, Zhenhong Du, Ren-yi Liu","doi":"10.1109/ICSPCC.2013.6663922","DOIUrl":null,"url":null,"abstract":"Cloud storage is an effective means to solve the storage and management challenges of the growing mass remote sensing data products. In order to settle the problems existing in the application of cloud storage for remote sensing data, a distributed storage module based on image blocks organization was put forward, and the inefficient problem of distributed file system in massive image blocks storage was solved. In the combination of the module and HDFS, the efficient distributed storage and retrieval of image data were implemented, and the ability of spatial data access of the remote sensing data cloud storage was enabled. As built upon distributed file system, the storage system has a good scalability to meet the requirements of data growing. The experiment and analysis showed that the storage system could maintain a high throughput and stability under multiple concurrent connections.","PeriodicalId":124509,"journal":{"name":"2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2013-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Cloud storage of massive remote sensing data based on distributed file system\",\"authors\":\"Ziwen Chi, Feng Zhang, Zhenhong Du, Ren-yi Liu\",\"doi\":\"10.1109/ICSPCC.2013.6663922\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cloud storage is an effective means to solve the storage and management challenges of the growing mass remote sensing data products. In order to settle the problems existing in the application of cloud storage for remote sensing data, a distributed storage module based on image blocks organization was put forward, and the inefficient problem of distributed file system in massive image blocks storage was solved. In the combination of the module and HDFS, the efficient distributed storage and retrieval of image data were implemented, and the ability of spatial data access of the remote sensing data cloud storage was enabled. As built upon distributed file system, the storage system has a good scalability to meet the requirements of data growing. The experiment and analysis showed that the storage system could maintain a high throughput and stability under multiple concurrent connections.\",\"PeriodicalId\":124509,\"journal\":{\"name\":\"2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2013-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSPCC.2013.6663922\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSPCC.2013.6663922","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Cloud storage of massive remote sensing data based on distributed file system
Cloud storage is an effective means to solve the storage and management challenges of the growing mass remote sensing data products. In order to settle the problems existing in the application of cloud storage for remote sensing data, a distributed storage module based on image blocks organization was put forward, and the inefficient problem of distributed file system in massive image blocks storage was solved. In the combination of the module and HDFS, the efficient distributed storage and retrieval of image data were implemented, and the ability of spatial data access of the remote sensing data cloud storage was enabled. As built upon distributed file system, the storage system has a good scalability to meet the requirements of data growing. The experiment and analysis showed that the storage system could maintain a high throughput and stability under multiple concurrent connections.