Application Research of Spark in Corporate Online Data Monitoring and Analysis

Abstract

Power grid companies produce and collect massive amounts of data in production and operation, operation management, marketing management, etc. Using data analysis to reflect the status of power grid company operation, mining the deep value of data, and boosting decision analysis for corporate management, are the key for digital transformation. Spark, which has both advanced architecture and high computational efficiency, is used to build an online data monitoring and analysis platform for enterprises. Such platform is aiming to improve the cross-discipline and cross-module data processing and data mining capabilities for power grid companies. Thus, all-service and all-scenario data acquisition is achieved; and its analysis models can be applied and reused. Lastly, it uses results from high-speed, high-quality data analysis to promote business development enabled by the application of corporate data.