Design of real-time distributed data collection and analysis system

Abstract

Aiming at the requirements of data query, monitoring, analysis and display during system operation, a real-time distributed data collection and analysis system is designed. This paper first analyzes the processing process of data acquisition and analysis, on this basis, combined with the actual application requirements, minimizes the changes to the existing equipment environment, adds intelligent acquisition cards at the device interface for signal-level or business-level data collection, and adopts cloud/server technology and MQTT lightweight communication technology to visualize the system operation process, and supports on-demand subscription to ensure that problems in the process of system operation can be found in a timely and effective manner.