浅谈应急管理中的地理空间大数据管理

Kuien Liu, Yandong Yao, Danhuai Guo
{"title":"浅谈应急管理中的地理空间大数据管理","authors":"Kuien Liu, Yandong Yao, Danhuai Guo","doi":"10.1145/2835596.2835614","DOIUrl":null,"url":null,"abstract":"With the rapid growth of mobile devices and applications, geo-tagged data is becoming increasingly important in emergency management and has become a major workload for big data storage systems. Traditional methods that storing geospatial data in centralized databases suffer from inevitable limitations such like scaling out with the growing size of geospatial data. In order to achieve scalability, a number of solutions on big geospatial data management are proposed in recent years. We can simply classify them into two kinds: extending on distributed databases, or migrating to big-data storage systems. For previous, they mostly adopt the massive parallel processing (MPP) based architecture, in which data are stored and retrieved in a set of independent nodes. Each node can be treated as a traditional databases instance with geospatial extension. For the latter, existing solutions tend to build an additional index layer above general-purpose distributed data stores, e.g., HBASE, CASSANDRA, MangoDB, etc., to support geospatial data while integrating the big-data lineage. However, there are no absolutely perfect data management systems on the earth. Some approaches are desired for execution efficiency while some others are better on fulfilling the programming level need for big data scenarios. In this paper, we analysis the requirements and challenges on geospatial big data storage in emergency management, succeed with discussion with individual perspective from practical cases. The purpose of this paper is not only focused on how to program a geospatial data storage platform but also on how to approve the rationality of geospatial big data system that we plan to build.","PeriodicalId":323570,"journal":{"name":"Proceedings of the 1st ACM SIGSPATIAL International Workshop on the Use of GIS in Emergency Management","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"On managing geospatial big-data in emergency management: some perspectives\",\"authors\":\"Kuien Liu, Yandong Yao, Danhuai Guo\",\"doi\":\"10.1145/2835596.2835614\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid growth of mobile devices and applications, geo-tagged data is becoming increasingly important in emergency management and has become a major workload for big data storage systems. Traditional methods that storing geospatial data in centralized databases suffer from inevitable limitations such like scaling out with the growing size of geospatial data. In order to achieve scalability, a number of solutions on big geospatial data management are proposed in recent years. We can simply classify them into two kinds: extending on distributed databases, or migrating to big-data storage systems. For previous, they mostly adopt the massive parallel processing (MPP) based architecture, in which data are stored and retrieved in a set of independent nodes. Each node can be treated as a traditional databases instance with geospatial extension. For the latter, existing solutions tend to build an additional index layer above general-purpose distributed data stores, e.g., HBASE, CASSANDRA, MangoDB, etc., to support geospatial data while integrating the big-data lineage. However, there are no absolutely perfect data management systems on the earth. Some approaches are desired for execution efficiency while some others are better on fulfilling the programming level need for big data scenarios. In this paper, we analysis the requirements and challenges on geospatial big data storage in emergency management, succeed with discussion with individual perspective from practical cases. The purpose of this paper is not only focused on how to program a geospatial data storage platform but also on how to approve the rationality of geospatial big data system that we plan to build.\",\"PeriodicalId\":323570,\"journal\":{\"name\":\"Proceedings of the 1st ACM SIGSPATIAL International Workshop on the Use of GIS in Emergency Management\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 1st ACM SIGSPATIAL International Workshop on the Use of GIS in Emergency Management\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/2835596.2835614\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 1st ACM SIGSPATIAL International Workshop on the Use of GIS in Emergency Management","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/2835596.2835614","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

随着移动设备和应用的快速发展,地理标记数据在应急管理中的作用越来越重要,已成为大数据存储系统的主要工作负载。将地理空间数据存储在集中式数据库中的传统方法存在不可避免的局限性,例如随着地理空间数据规模的增长而扩展。为了实现可扩展性,近年来提出了许多地理空间大数据管理的解决方案。我们可以简单地将它们分为两类:在分布式数据库上扩展,或者迁移到大数据存储系统。以往,它们大多采用基于海量并行处理(MPP)的架构,将数据存储和检索在一组独立的节点中。每个节点都可以视为具有地理空间扩展的传统数据库实例。对于后者,现有的解决方案倾向于在通用分布式数据存储(如HBASE、CASSANDRA、mongodb等)之上建立一个额外的索引层,以在集成大数据谱系的同时支持地理空间数据。然而,世界上没有绝对完美的数据管理系统。有些方法是为了提高执行效率,而另一些方法则更好地满足大数据场景的编程级需求。本文分析了地理空间大数据存储在应急管理中的需求和面临的挑战,并从实际案例出发,从个人角度进行了探讨。本文的目的不仅在于如何对地理空间数据存储平台进行编程,还在于如何对我们计划构建的地理空间大数据系统的合理性进行验证。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
On managing geospatial big-data in emergency management: some perspectives
With the rapid growth of mobile devices and applications, geo-tagged data is becoming increasingly important in emergency management and has become a major workload for big data storage systems. Traditional methods that storing geospatial data in centralized databases suffer from inevitable limitations such like scaling out with the growing size of geospatial data. In order to achieve scalability, a number of solutions on big geospatial data management are proposed in recent years. We can simply classify them into two kinds: extending on distributed databases, or migrating to big-data storage systems. For previous, they mostly adopt the massive parallel processing (MPP) based architecture, in which data are stored and retrieved in a set of independent nodes. Each node can be treated as a traditional databases instance with geospatial extension. For the latter, existing solutions tend to build an additional index layer above general-purpose distributed data stores, e.g., HBASE, CASSANDRA, MangoDB, etc., to support geospatial data while integrating the big-data lineage. However, there are no absolutely perfect data management systems on the earth. Some approaches are desired for execution efficiency while some others are better on fulfilling the programming level need for big data scenarios. In this paper, we analysis the requirements and challenges on geospatial big data storage in emergency management, succeed with discussion with individual perspective from practical cases. The purpose of this paper is not only focused on how to program a geospatial data storage platform but also on how to approve the rationality of geospatial big data system that we plan to build.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信