LEaCRS: An Extendible Array Based Compression Scheme for High Dimensional Data Using Linearization

Abstract

Large multidimensional arrays are extensively used as the basic data structure in scientific, statistical and engineering applications. Increasing size of Data warehouses and high degree of sparsity makes demand for developing some compression schemes in order to obtain better performance. In this paper, we propose a new compression scheme namely Linearized Extendible array based Compressed Row Storage (LEaCRS) scheme for large multidimensional sparse array. The main idea of this scheme is to linearize each sub array found from the existing extendible array and then compresses the sub arrays independently using the CRS method.