基于NoSQL的传感器数据存储与检索

M. Marinov, Georgi Georgiev, Elitsa Popova
{"title":"基于NoSQL的传感器数据存储与检索","authors":"M. Marinov, Georgi Georgiev, Elitsa Popova","doi":"10.23919/MIPRO.2018.8400257","DOIUrl":null,"url":null,"abstract":"The sensor data is heterogeneous, redundant, real-time, massive, streaming and is generated in high frequency. The increasing use of sensors leads to a rising demand on sensor data storage platforms. Appropriate data management is therefore, a key factor in making sure that the sensor data storage system becomes a reality. In this article we will focus on finding a data storage solution that is capable of storing huge amount of sensor data. The storage models in SQL and NoSQL databases are analyzed and compared, thus seeking an appropriate type of database for sensor data storage. Hypertable is identified to be the database that best suits the system requirements. It is therefore investigated how to implement the sensor data insertion and retrieval services. Query processing over distributed databases is more challenging than doing so in a centralized environment. Because NoSQL databases do not work with SQL, they require manual query programming which can be fast for simple tasks but time-consuming for others. This paper considers the extension of Hypertable query language with aggregate operations and describes the implementation of the query language interpreter.","PeriodicalId":431110,"journal":{"name":"2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"NoSQL approach for sensor data storage and retrieval\",\"authors\":\"M. Marinov, Georgi Georgiev, Elitsa Popova\",\"doi\":\"10.23919/MIPRO.2018.8400257\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The sensor data is heterogeneous, redundant, real-time, massive, streaming and is generated in high frequency. The increasing use of sensors leads to a rising demand on sensor data storage platforms. Appropriate data management is therefore, a key factor in making sure that the sensor data storage system becomes a reality. In this article we will focus on finding a data storage solution that is capable of storing huge amount of sensor data. The storage models in SQL and NoSQL databases are analyzed and compared, thus seeking an appropriate type of database for sensor data storage. Hypertable is identified to be the database that best suits the system requirements. It is therefore investigated how to implement the sensor data insertion and retrieval services. Query processing over distributed databases is more challenging than doing so in a centralized environment. Because NoSQL databases do not work with SQL, they require manual query programming which can be fast for simple tasks but time-consuming for others. This paper considers the extension of Hypertable query language with aggregate operations and describes the implementation of the query language interpreter.\",\"PeriodicalId\":431110,\"journal\":{\"name\":\"2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-05-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/MIPRO.2018.8400257\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/MIPRO.2018.8400257","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

传感器数据是异构的、冗余的、实时的、海量的、流的,并且以高频率产生。传感器的使用越来越多,导致对传感器数据存储平台的需求不断增加。因此,适当的数据管理是确保传感器数据存储系统成为现实的关键因素。在本文中,我们将重点寻找能够存储大量传感器数据的数据存储解决方案。分析比较了SQL和NoSQL数据库中的存储模式,从而寻找适合传感器数据存储的数据库类型。Hypertable被认为是最适合系统需求的数据库。因此,研究了如何实现传感器数据的插入和检索服务。在分布式数据库上进行查询处理比在集中式环境中进行查询处理更具挑战性。因为NoSQL数据库不使用SQL,所以它们需要手动查询编程,这对于简单的任务来说可能很快,但对于其他任务来说却很耗时。本文考虑了Hypertable查询语言的聚合操作扩展,并描述了查询语言解释器的实现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
NoSQL approach for sensor data storage and retrieval
The sensor data is heterogeneous, redundant, real-time, massive, streaming and is generated in high frequency. The increasing use of sensors leads to a rising demand on sensor data storage platforms. Appropriate data management is therefore, a key factor in making sure that the sensor data storage system becomes a reality. In this article we will focus on finding a data storage solution that is capable of storing huge amount of sensor data. The storage models in SQL and NoSQL databases are analyzed and compared, thus seeking an appropriate type of database for sensor data storage. Hypertable is identified to be the database that best suits the system requirements. It is therefore investigated how to implement the sensor data insertion and retrieval services. Query processing over distributed databases is more challenging than doing so in a centralized environment. Because NoSQL databases do not work with SQL, they require manual query programming which can be fast for simple tasks but time-consuming for others. This paper considers the extension of Hypertable query language with aggregate operations and describes the implementation of the query language interpreter.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信