Arrays in Databases: from Underdog to First-Class Citizen

Abstract

Array Databases close a gap in the database ecosystem by adding modelling, storage, and processing support for multi-dimensional arrays. Built into “datacubes” such structures are known since long in OLAP and statistics, but they also appear as spatio-temporal sensor, image, simulation, and statistics data in all science and engineering domains. In our research we address Array Databases in all aspects, from concepts over architecture to applications. Our full-stack implementation rasdaman ("raster data manager"), which effectively has pioneered Array Databases, is in operational use on multi-Petabyte, federated Earth data assets. Based on this experience, the rasdaman team has initiated and shaped datacube standards such as ISO SQL/MDA (Multi-Dimensional Arrays) and the OGC Earth datacube standards suite. In our talk we present concepts and implementation of rasdaman and show its application to Earth datacubes, illustrated by live demonstration of operational services.