hailong zhang, Jie WANG, Xinchen YE, Wanqiong WANG, Jia LI, Zhang Yazhou, Xu Du, Han Wu, Ting ZHANG
{"title":"新疆天文台数据中心交叉匹配服务","authors":"hailong zhang, Jie WANG, Xinchen YE, Wanqiong WANG, Jia LI, Zhang Yazhou, Xu Du, Han Wu, Ting ZHANG","doi":"10.1088/1674-4527/ad08e8","DOIUrl":null,"url":null,"abstract":"Abstract Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, We propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system (Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory (XAO-DC). Specifically, we use Q3C (Quad Tree Cube) to divide the spherical blocks of celestial object and map the 2-D space composed of Right Ascension (RA) and Declination (Dec) to 1-D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using GAIA 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of cross-matching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.","PeriodicalId":54494,"journal":{"name":"Research in Astronomy and Astrophysics","volume":"18 S6","pages":"0"},"PeriodicalIF":1.8000,"publicationDate":"2023-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Cross-matching Service for Data Center of Xinjiang Astronomical Observatory\",\"authors\":\"hailong zhang, Jie WANG, Xinchen YE, Wanqiong WANG, Jia LI, Zhang Yazhou, Xu Du, Han Wu, Ting ZHANG\",\"doi\":\"10.1088/1674-4527/ad08e8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, We propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system (Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory (XAO-DC). Specifically, we use Q3C (Quad Tree Cube) to divide the spherical blocks of celestial object and map the 2-D space composed of Right Ascension (RA) and Declination (Dec) to 1-D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using GAIA 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of cross-matching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.\",\"PeriodicalId\":54494,\"journal\":{\"name\":\"Research in Astronomy and Astrophysics\",\"volume\":\"18 S6\",\"pages\":\"0\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2023-11-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research in Astronomy and Astrophysics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1088/1674-4527/ad08e8\",\"RegionNum\":4,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ASTRONOMY & ASTROPHYSICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research in Astronomy and Astrophysics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1088/1674-4527/ad08e8","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0
摘要
交叉匹配是实现多波段天文表融合的关键技术。由于各种天文望远镜等设备的不同,以及测量误差和天体自身运动的存在,同一天体在不同的星表中会有不同的位置,给多波段或全波段天文数据的整合带来困难。本文提出了一种基于伪球面索引技术的在线交叉匹配方法,并结合高性能计算系统(Taurus)开发了一种服务,以提高交叉匹配效率,该服务面向新疆天文台数据中心(xaodc)设计。具体来说,我们使用Q3C (Quad Tree Cube)对天体的球面块进行划分,并将由赤经(Right Ascension, RA)和赤纬(Dec)组成的二维空间映射到一维空间,实现真实天体与球面块的对应。最后,我们使用GAIA 3和PPMXL目录验证了服务的性能。同时,我们将匹配结果分别发送给VO工具- topcat和Aladin,以获得可视化结果。实验结果表明,该服务有效解决了频繁I/O导致的交叉匹配速度瓶颈问题,显著提高了海量天文数据的检索和匹配速度。
A Cross-matching Service for Data Center of Xinjiang Astronomical Observatory
Abstract Cross-matching is a key technique to achieve fusion of multi-band astronomical catalogs. Due to different equipment such as various astronomical telescopes, the existence of measurement errors and proper motions of the celestial bodies, the same celestial object will have different positions in different catalogs, making it difficult to integrate multi-band or full-band astronomical data. In this study, We propose an online cross-matching method based on pseudo-spherical indexing techniques and develop a service combining with high performance computing system (Taurus) to improve cross-matching efficiency, which is designed for the Data Center of Xinjiang Astronomical Observatory (XAO-DC). Specifically, we use Q3C (Quad Tree Cube) to divide the spherical blocks of celestial object and map the 2-D space composed of Right Ascension (RA) and Declination (Dec) to 1-D space and achieve correspondence between real celestial objects and spherical patches. Finally, we verify the performance of the service using GAIA 3 and PPMXL catalogs. Meanwhile, we send the matching results to VO tools-Topcat and Aladin respectively to get visual results. The experimental results show that the service effectively solves the speed bottleneck problem of cross-matching caused by frequent I/O, and significantly improves the retrieval and matching speed of massive astronomical data.
期刊介绍:
Research in Astronomy and Astrophysics (RAA) is an international journal publishing original research papers and reviews across all branches of astronomy and astrophysics, with a particular interest in the following topics:
-large-scale structure of universe formation and evolution of galaxies-
high-energy and cataclysmic processes in astrophysics-
formation and evolution of stars-
astrogeodynamics-
solar magnetic activity and heliogeospace environments-
dynamics of celestial bodies in the solar system and artificial bodies-
space observation and exploration-
new astronomical techniques and methods