{"title":"Distributed Storage of Meteorological Grid Data based on HBase","authors":"Honghao Yu, Hong Jia","doi":"10.1109/ISCEIC53685.2021.00041","DOIUrl":null,"url":null,"abstract":"In order to improve the storage and management ability of relational database for massive meteorological grid data, an index method based on spatial subdivision grid is proposed, and a distributed storage model of meteorological grid data based on HBase is designed and implemented. In this paper, the spatial grid is established on the NetCDF format meteorological grid data, and the spatial index coding based on spatial octree is designed; The distributed storage scheme based on HBase is adopted and the structure of rowkey and table is optimized . The experimental results show that HBase database is superior to relational database in storage and query for massive meteorological grid data.","PeriodicalId":342968,"journal":{"name":"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd International Symposium on Computer Engineering and Intelligent Communications (ISCEIC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISCEIC53685.2021.00041","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In order to improve the storage and management ability of relational database for massive meteorological grid data, an index method based on spatial subdivision grid is proposed, and a distributed storage model of meteorological grid data based on HBase is designed and implemented. In this paper, the spatial grid is established on the NetCDF format meteorological grid data, and the spatial index coding based on spatial octree is designed; The distributed storage scheme based on HBase is adopted and the structure of rowkey and table is optimized . The experimental results show that HBase database is superior to relational database in storage and query for massive meteorological grid data.