Enhanced LZMA and BZIP2 for improved energy data compression

Abstract

Smart grid is the next generation of electricity production, transmission and distribution system. This is possible through an overlayed communication layer with the power delivery layer. Due to this communication layer smart grids produce enormous amounts of data. This data may be analyzed for improving the quality of service of smart grids. However, handling such enormous amount of data is a challenge. LZMA and BZIP2 are two industrial strength compression techniques. In this paper we present an enhanced version of these two schemes specifically targeted to smart grid data through a pre-processing step. Our results show that while the original LZMA is able to compress the data size to around 80% our enhanced scheme using the preprocessing is able to reduce the size of the smart grid data to 98% on average.