Polystore Database Systems for Managing Large Scientific Dataset Archives

Abstract

Palomar Transient Factory (PTF) has a tremendous amount of astronomical data. The data type varies from images of the astronomical objects, unstructured texts, relations and, key-values. To manage such varieties of data in a single database may have performance issues. So, in this study, we present an approach based on Polystores to manage multiple databases with a federation of information and a uniform query language. We also present a web-based query system built around the Polystore database architecture and try to provide a solution for the growing size of data in the astronomical domain.