基于HBase的卫星图像数据分布式存储与查询方法

2021 2nd International Conference on Computer Communication and Network Security (CCNS) Pub Date : 2021-07-01 DOI:10.1109/CCNS53852.2021.00021

Hongjuan Liu, Jiancun Li, Wenjing Li, Wei Huang, Zhitao Shao, Yuan Zhang, Shiguang Wang, Zhaoying Yang

{"title":"基于HBase的卫星图像数据分布式存储与查询方法","authors":"Hongjuan Liu, Jiancun Li, Wenjing Li, Wei Huang, Zhitao Shao, Yuan Zhang, Shiguang Wang, Zhaoying Yang","doi":"10.1109/CCNS53852.2021.00021","DOIUrl":null,"url":null,"abstract":"With the rapid development of aerospace industry, satellite image data has shown a blowout growth. At present, the annual data reception capacity of a satellite has reached TB level, and the data size of a satellite image can reach about 2GB. This poses a serious challenge. Based on the Hadoop framework, this paper studies the HBase-based satellite image big data solution, and provides three query methods as HBase, Hive, and Impala according to the application scenario.","PeriodicalId":142980,"journal":{"name":"2021 2nd International Conference on Computer Communication and Network Security (CCNS)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Distributed Storage and Query Method of Satellite Image Data based on HBase\",\"authors\":\"Hongjuan Liu, Jiancun Li, Wenjing Li, Wei Huang, Zhitao Shao, Yuan Zhang, Shiguang Wang, Zhaoying Yang\",\"doi\":\"10.1109/CCNS53852.2021.00021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid development of aerospace industry, satellite image data has shown a blowout growth. At present, the annual data reception capacity of a satellite has reached TB level, and the data size of a satellite image can reach about 2GB. This poses a serious challenge. Based on the Hadoop framework, this paper studies the HBase-based satellite image big data solution, and provides three query methods as HBase, Hive, and Impala according to the application scenario.\",\"PeriodicalId\":142980,\"journal\":{\"name\":\"2021 2nd International Conference on Computer Communication and Network Security (CCNS)\",\"volume\":\"6 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 2nd International Conference on Computer Communication and Network Security (CCNS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CCNS53852.2021.00021\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd International Conference on Computer Communication and Network Security (CCNS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCNS53852.2021.00021","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

摘要

随着航天事业的快速发展，卫星图像数据呈现井喷式增长。目前，一颗卫星的年数据接收能力已经达到TB级，一张卫星图像的数据大小可以达到2GB左右。这是一个严峻的挑战。本文基于Hadoop框架，研究了基于HBase的卫星图像大数据解决方案，根据应用场景提供了HBase、Hive、Impala三种查询方式。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Distributed Storage and Query Method of Satellite Image Data based on HBase

With the rapid development of aerospace industry, satellite image data has shown a blowout growth. At present, the annual data reception capacity of a satellite has reached TB level, and the data size of a satellite image can reach about 2GB. This poses a serious challenge. Based on the Hadoop framework, this paper studies the HBase-based satellite image big data solution, and provides three query methods as HBase, Hive, and Impala according to the application scenario.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

2021 2nd International Conference on Computer Communication and Network Security (CCNS)

自引率

0.00%

发文量