Big Data Sampling Algorithm Based on Peak Detection

Abstract

Domestic mass data processing system in aerospace field uses big data simple sampling algorithm for data specification in the data preprocessing stage. This paper analyzes the data curve distortion caused by this algorithm, and proposes an optimization method for that. Finally, a big data sampling algorithm based on peak detection is adopted to achieve the purpose of quickly viewing the fidelity and complete picture of massive historical data, while ensuring the correctness of the data interpretation after data preprocessing at the same time. Through the using of real test data for verification, in the data preprocessing stage of the domestic mass data processing system, the large data sampling algorithm based on peak detection is adopted to achieve the high fidelity of the data curve after sampling.