A Scalable Database Model of RFI Data for the MeerKAT Radio Telescope

Gerald Nathan Balekaki, M. Kuttel, A. Schroeder, Sarah Blyth, S. Berman
{"title":"A Scalable Database Model of RFI Data for the MeerKAT Radio Telescope","authors":"Gerald Nathan Balekaki, M. Kuttel, A. Schroeder, Sarah Blyth, S. Berman","doi":"10.1145/3351108.3351127","DOIUrl":null,"url":null,"abstract":"In radio astronomy, radio frequency interference (RFI) refers to any signal captured by a radio telescope that did not originate from the observed target in the sky. As RFI corrupts observational data and may even damage radio telescope equipment, astronomers seek to store data on RFI, with the aim of mitigating or preventing future interference events. This is a concern for the MeerKAT telescope, precursor to the Square Kilometer Array and one of the largest and most sensitive radio telescope in the world to date. Currently, RFI data at MeerKAT is collected in many different file formats that do not fit into traditional database models created to store data in a fixed schema. Therefore, we have designed a scalable database model for RFI storage, that supports many databases and many data models. The database is deployed in a Dockerized environment. Preliminary testing of our design shows linearly scaling of data ingestion as data sizes increases, as well as fast query processing.","PeriodicalId":269578,"journal":{"name":"Research Conference of the South African Institute of Computer Scientists and Information Technologists","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Conference of the South African Institute of Computer Scientists and Information Technologists","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3351108.3351127","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

In radio astronomy, radio frequency interference (RFI) refers to any signal captured by a radio telescope that did not originate from the observed target in the sky. As RFI corrupts observational data and may even damage radio telescope equipment, astronomers seek to store data on RFI, with the aim of mitigating or preventing future interference events. This is a concern for the MeerKAT telescope, precursor to the Square Kilometer Array and one of the largest and most sensitive radio telescope in the world to date. Currently, RFI data at MeerKAT is collected in many different file formats that do not fit into traditional database models created to store data in a fixed schema. Therefore, we have designed a scalable database model for RFI storage, that supports many databases and many data models. The database is deployed in a Dockerized environment. Preliminary testing of our design shows linearly scaling of data ingestion as data sizes increases, as well as fast query processing.
MeerKAT射电望远镜RFI数据的可扩展数据库模型
在射电天文学中,无线电频率干扰(RFI)是指射电望远镜捕捉到的并非来自天空中观测目标的任何信号。由于RFI会破坏观测数据,甚至可能损坏射电望远镜设备,天文学家寻求将数据存储在RFI上,目的是减轻或防止未来的干扰事件。这是MeerKAT望远镜所关注的问题,它是平方公里阵列的前身,也是迄今为止世界上最大、最灵敏的射电望远镜之一。目前,MeerKAT的RFI数据是以许多不同的文件格式收集的,这些格式不适合为将数据存储在固定模式中而创建的传统数据库模型。因此,我们为RFI存储设计了一个可扩展的数据库模型,它支持许多数据库和许多数据模型。数据库部署在Dockerized环境中。我们设计的初步测试显示,随着数据大小的增加,数据摄取呈线性扩展,以及快速的查询处理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信