直方图立方体:面向地球观测大数据的轻量级交互时空聚合

IF 3.7 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL
Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin
{"title":"直方图立方体:面向地球观测大数据的轻量级交互时空聚合","authors":"Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin","doi":"10.1080/17538947.2023.2278684","DOIUrl":null,"url":null,"abstract":"In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.","PeriodicalId":54962,"journal":{"name":"International Journal of Digital Earth","volume":"46 5","pages":"0"},"PeriodicalIF":3.7000,"publicationDate":"2023-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data\",\"authors\":\"Jiyuan Li, Lingkui Meng, Miao Zhang, Zhou Jiang, Weihang Jin\",\"doi\":\"10.1080/17538947.2023.2278684\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.\",\"PeriodicalId\":54962,\"journal\":{\"name\":\"International Journal of Digital Earth\",\"volume\":\"46 5\",\"pages\":\"0\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2023-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Digital Earth\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/17538947.2023.2278684\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Digital Earth","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/17538947.2023.2278684","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

在对地观测大数据时代,交互式时空聚合分析是探索地理格局的重要工具。然而,现有的方法既低效又复杂。它们的交互性能在很大程度上依赖于大规模的计算资源,特别是数据立方体基础设施。本研究从绿色计算的角度出发,提出了一种基于预聚合概念的轻量级数据立方体模型,其中EO数据的频率直方图作为具体测度。通过Google S2网格系统将立方体空间划分为晶格金字塔,并将EO数据的直方图统计信息注入到内存长方体中。因此,对EO数据集的探索性聚合分析可以快速转化为多维视图查询过程。我们在本地PC上实现了原型系统,并进行了全球植被指数聚合的案例研究。实验表明,该模型比ArcGIS Pro和XCube更小、更快、能耗更低,有利于实现涉及立方体基础设施的绿色计算策略。由于独立模式,更大的数据集将导致更长的多维数据集构建时间和索引延迟。该方法的效率是以精度为代价的,本文对其固有的不确定性进行了检验。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Histogram cube: towards lightweight interactive spatiotemporal aggregation of big earth observation data
In the era of Earth Observation (EO) big data, interactive spatiotemporal aggregation analysis is a critical tool for exploring geographic patterns. However, existing methods are inefficient and complex. Their interactive performance greatly depends on large-scale computing resources, especially data cube infrastructure. In this study, from a green computing perspective, we propose a lightweight data cube model based on the preaggregation concept, in which the frequency histogram of EO data is employed as a specific measure. The cube space was divided into lattice pyramids by the Google S2 grid system, and histogram statistics of the EO data were injected into in-memory cuboids. Therefore, exploratory aggregation analysis of EO datasets could be rapidly converted into multidimensional-view query processes. We implemented the prototype system on a local PC and conducted a case study of global vegetation index aggregation. The experiments showed that the proposed model is smaller, faster and consumes less energy than ArcGIS Pro and XCube, and facilitates green computing strategies involving a cube infrastructure. Due to the standalone mode, larger dataset will result in longer cube building time with indexing latency. The efficiency of the approach comes at the expense of accuracy, and the inherent uncertainties were examined in this paper.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.50
自引率
3.90%
发文量
88
审稿时长
3 months
期刊介绍: The International Journal of Digital Earth is a response to this initiative. This peer-reviewed academic journal (SCI-E) focuses on the theories, technologies, applications, and societal implications of Digital Earth and those visionary concepts that will enable a modeled virtual world. The journal encourages papers that: Progress visions for Digital Earth frameworks, policies, and standards; Explore geographically referenced 3D, 4D, or 5D models to represent the real planet, and geo-data-intensive science and discovery; Develop methods that turn all forms of geo-referenced data, from scientific to social, into useful information that can be analyzed, visualized, and shared; Present innovative, operational applications and pilots of Digital Earth technologies at a local, national, regional, and global level; Expand the role of Digital Earth in the fields of Earth science, including climate change, adaptation and health related issues,natural disasters, new energy sources, agricultural and food security, and urban planning; Foster the use of web-based public-domain platforms, social networks, and location-based services for the sharing of digital data, models, and information about the virtual Earth; and Explore the role of social media and citizen-provided data in generating geo-referenced information in the spatial sciences and technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信