Research of road disease big data process based on Hadoop system

Abstract

In Big data era, the data volume produced by ground penetrating radar (GPR) application swelling and has the characteristics of heterogeneity. This paper introduces the current status of the big data. In view of the characteristics of ground penetrating radar (GPR) application used in road disease detection, we design and realize a kind of ground penetrating radar (GPR) data management system GRBase based on Hadoop platform used in road disease detection, propose and implement a GPR data preprocessing method based on the Storm, solve the problem that the GPR data and Hadoop input format does not match. GRBase uses MySQL and HBase as storage database and enhances the radar data computational efficiency in road disease detection applications. The experiments and practice demonstrate that GRBase management platform is an effective, practical and strong scalability distributed GPR data management system.