水文大数据共享平台研究与设计 Research and Design of Hydrological Big Data Sharing Platform

Journal of Water Resources Research Pub Date : 2017-12-05 DOI:10.12677/JWRR.2018.71002

陈华, 徐坚, 肖志远, 杨家伟, 陈杰, 郭生练, 许崇育

{"title":"水文大数据共享平台研究与设计 Research and Design of Hydrological Big Data Sharing Platform","authors":"陈华, 徐坚, 肖志远, 杨家伟, 陈杰, 郭生练, 许崇育","doi":"10.12677/JWRR.2018.71002","DOIUrl":null,"url":null,"abstract":"本文根据水文数据的特点探讨了水文大数据标准化方法，探索数据预处理、数据索引、数据高效存储等水文大数据共享平台关键技术；利用Hadoop对多源异构数据的海量存储能力及高速计算能力，研究基于MapReduce的水文大数据分布式数据处理模型，设计和实现水文大数据共享平台，为水利及跨行业跨部门的信息共享、空间集成，以及跨学科的可持续发展研究提供技术支撑。 In this paper, the methodology of hydrological big data standardization is discussed upon analyzing on the characteristics of hydrological data. Solutions on data preprocessing, data indexing and highly effi-cient data reading and writing are also introduced. The mass storage capacity and high speed computing capability of Hadoop are utilized for designing and implementing hydrological big data sharing platform. Accordingly, the platform can be technical support for information sharing and space integration between water conservancy industry and other industries, as well as the interdisciplinary sustainable development.","PeriodicalId":349946,"journal":{"name":"Journal of Water Resources Research","volume":"28 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Water Resources Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.12677/JWRR.2018.71002","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 3

Abstract

本文根据水文数据的特点探讨了水文大数据标准化方法，探索数据预处理、数据索引、数据高效存储等水文大数据共享平台关键技术；利用Hadoop对多源异构数据的海量存储能力及高速计算能力，研究基于MapReduce的水文大数据分布式数据处理模型，设计和实现水文大数据共享平台，为水利及跨行业跨部门的信息共享、空间集成，以及跨学科的可持续发展研究提供技术支撑。 In this paper, the methodology of hydrological big data standardization is discussed upon analyzing on the characteristics of hydrological data. Solutions on data preprocessing, data indexing and highly effi-cient data reading and writing are also introduced. The mass storage capacity and high speed computing capability of Hadoop are utilized for designing and implementing hydrological big data sharing platform. Accordingly, the platform can be technical support for information sharing and space integration between water conservancy industry and other industries, as well as the interdisciplinary sustainable development.

查看原文本刊更多论文

水文大数据共享平台研究与设计 Research and Design of Hydrological Big Data Sharing Platform

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Water Resources Research

自引率

0.00%

发文量