Gerald Nathan Balekaki, M. Kuttel, A. Schroeder, Sarah Blyth, S. Berman
{"title":"A Scalable Database Model of RFI Data for the MeerKAT Radio Telescope","authors":"Gerald Nathan Balekaki, M. Kuttel, A. Schroeder, Sarah Blyth, S. Berman","doi":"10.1145/3351108.3351127","DOIUrl":null,"url":null,"abstract":"In radio astronomy, radio frequency interference (RFI) refers to any signal captured by a radio telescope that did not originate from the observed target in the sky. As RFI corrupts observational data and may even damage radio telescope equipment, astronomers seek to store data on RFI, with the aim of mitigating or preventing future interference events. This is a concern for the MeerKAT telescope, precursor to the Square Kilometer Array and one of the largest and most sensitive radio telescope in the world to date. Currently, RFI data at MeerKAT is collected in many different file formats that do not fit into traditional database models created to store data in a fixed schema. Therefore, we have designed a scalable database model for RFI storage, that supports many databases and many data models. The database is deployed in a Dockerized environment. Preliminary testing of our design shows linearly scaling of data ingestion as data sizes increases, as well as fast query processing.","PeriodicalId":269578,"journal":{"name":"Research Conference of the South African Institute of Computer Scientists and Information Technologists","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Conference of the South African Institute of Computer Scientists and Information Technologists","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3351108.3351127","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
In radio astronomy, radio frequency interference (RFI) refers to any signal captured by a radio telescope that did not originate from the observed target in the sky. As RFI corrupts observational data and may even damage radio telescope equipment, astronomers seek to store data on RFI, with the aim of mitigating or preventing future interference events. This is a concern for the MeerKAT telescope, precursor to the Square Kilometer Array and one of the largest and most sensitive radio telescope in the world to date. Currently, RFI data at MeerKAT is collected in many different file formats that do not fit into traditional database models created to store data in a fixed schema. Therefore, we have designed a scalable database model for RFI storage, that supports many databases and many data models. The database is deployed in a Dockerized environment. Preliminary testing of our design shows linearly scaling of data ingestion as data sizes increases, as well as fast query processing.