DEWA R&D Data Lake: Big Data Platform for Advanced Energy Data Analytics

Abstract

The digital transformation of the utility sector has resulted in a flood of data incoming from diverse and dispersed data sources, which requires huge integration, storage, processing, and management efforts. In this work, we present a Big Data advanced analytics platform for utility data, that allows for easier data retrieval, processing, and visualization, with enhanced data security. The successful implementation of Data Lake at DEWA (Dubai Electricity and Water Authority) R&D Center increases valuable insight extraction from raw and processed data, that can be employed in informed decision-making and cross-utilization of data between different sectors in the utility company.