R2Time: A Framework to Analyse Open TSDB Time-Series Data in HBase

Abstract

In recent years, the amount of time series data generated in different domains have grown consistently. Analyzing large time-series datasets coming from sensor networks, power grids, stock exchanges, social networks and cloud monitoring logs at a massive scale is one of the biggest challenges that data scientists are facing. Big data storage and processing frameworks provides an environment to handle the volume, velocity and frequency attributes associated with time-series data. We propose an efficient and distributed computing framework - R2Time for processing such data in the Hadoop environment. It integrates R with a distributed time-series database (Open TSDB) using a MapReduce programming framework (RHIPE). R2Time allows analysts to work on huge datasets from within a popular, well supported, and powerful analysis environment.