SDHDF: A new file format for spectral-domain radio astronomy data

IF 1.9 4区物理与天体物理 Q2 ASTRONOMY & ASTROPHYSICS

Astronomy and Computing Pub Date : 2024-02-24 DOI:10.1016/j.ascom.2024.100804

L.J. Toomey , G. Hobbs , D.C. Price , J.R. Dawson , T. Wenger , D. Lagoy , L. Staveley-Smith , J.A. Green , E. Carretti , A. Hafner , M. Huynh , J. Kaczmarek , S. Mader , V. McIntyre , J. Reynolds , T. Robishaw , J. Sarkissian , A. Thompson , C. Tremblay , A. Zic

{"title":"SDHDF: A new file format for spectral-domain radio astronomy data","authors":"L.J. Toomey , G. Hobbs , D.C. Price , J.R. Dawson , T. Wenger , D. Lagoy , L. Staveley-Smith , J.A. Green , E. Carretti , A. Hafner , M. Huynh , J. Kaczmarek , S. Mader , V. McIntyre , J. Reynolds , T. Robishaw , J. Sarkissian , A. Thompson , C. Tremblay , A. Zic","doi":"10.1016/j.ascom.2024.100804","DOIUrl":null,"url":null,"abstract":"<div><p>Radio astronomy file formats are now required to store wide frequency bandwidths and multiple simultaneous receiver beams and must be able to account for versatile observing modes and numerous calibration strategies. The need to capture and archive high-time and high frequency-resolution data, along with the comprehensive metadata that fully describe the data, implies that a new data format and new processing software are required. This requirement is suited to a well-defined, hierarchically-structured and flexible file format. In this paper we present the Spectral-Domain Hierarchical Data Format (‘SDHDF’) — a new file format for radio astronomy data, in particular for single dish or beam-formed data streams. Since 2018, SDHDF has been the primary format for data products from the spectral-line and continuum observing modes at Murriyang, the CSIRO Parkes 64-metre radio telescope, and we demonstrate that this data format can also be used to store observations of pulsars and fast radio bursts.</p></div>","PeriodicalId":48757,"journal":{"name":"Astronomy and Computing","volume":"47 ","pages":"Article 100804"},"PeriodicalIF":1.9000,"publicationDate":"2024-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2213133724000192/pdfft?md5=a8940702da8fbe932e90a581cd25609a&pid=1-s2.0-S2213133724000192-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astronomy and Computing","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2213133724000192","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}

引用次数: 0

Abstract

Radio astronomy file formats are now required to store wide frequency bandwidths and multiple simultaneous receiver beams and must be able to account for versatile observing modes and numerous calibration strategies. The need to capture and archive high-time and high frequency-resolution data, along with the comprehensive metadata that fully describe the data, implies that a new data format and new processing software are required. This requirement is suited to a well-defined, hierarchically-structured and flexible file format. In this paper we present the Spectral-Domain Hierarchical Data Format (‘SDHDF’) — a new file format for radio astronomy data, in particular for single dish or beam-formed data streams. Since 2018, SDHDF has been the primary format for data products from the spectral-line and continuum observing modes at Murriyang, the CSIRO Parkes 64-metre radio telescope, and we demonstrate that this data format can also be used to store observations of pulsars and fast radio bursts.

查看原文本刊更多论文

SDHDF：光谱域射电天文数据的新文件格式

射电天文学文件格式现在需要存储宽频带和多个同时接收波束，并且必须能够考虑到多种观测模式和多种校准策略。需要捕获和存档高时间分辨率和高频率分辨率的数据以及全面描述数据的综合元数据，这意味着需要一种新的数据格式和新的处理软件。这种要求适合于定义明确、分层结构和灵活的文件格式。在本文中，我们介绍了光谱域分层数据格式（'SDHDF'）--一种用于射电天文学数据，特别是单碟或波束形成数据流的新文件格式。自2018年以来，SDHDF一直是CSIRO帕克斯64米射电望远镜（Murriyang）光谱线和连续谱观测模式数据产品的主要格式，我们证明这种数据格式也可用于存储脉冲星和快速射电暴的观测数据。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Astronomy and Computing ASTRONOMY & ASTROPHYSICSCOMPUTER SCIENCE,-COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

CiteScore

4.10

自引率

8.00%

发文量

期刊介绍： Astronomy and Computing is a peer-reviewed journal that focuses on the broad area between astronomy, computer science and information technology. The journal aims to publish the work of scientists and (software) engineers in all aspects of astronomical computing, including the collection, analysis, reduction, visualisation, preservation and dissemination of data, and the development of astronomical software and simulations. The journal covers applications for academic computer science techniques to astronomy, as well as novel applications of information technologies within astronomy.