Big data processing framework of road traffic collision using distributed CEP

Abstract

The traffic information is a big data comes from varying sources, such as, social sites, mobile phone GPS signals and so on. The Hadoop and HBase can store and analyze real-time collision data in a distributed processing framework. This framework can be designed as flexible and scalable framework using distributed CEP that process massive real-time traffic data and ESB that integrates other services. In this paper, we propose a new architecture for distributed processing that enables big data processing on the road traffic data and its related information analysis. We tested the proposed framework on road traffic data on 400km from Seoul to Busan freeway section in Korea. By integrating freeway traffic big data and collision data over a seven-year period (1TB Size), we obtained the collision probability data.