A Framework for the Analysis of BGP Data over Long Timescales

Abstract

BGP data are very important for understanding the dynamics of the inter domain routing. With the development of Internet, the routing data that BGP routers deals with are increasing dramatically. Nowadays, the most important factor to restrict the research process for general scientific researchers is how to deal with the large volume metadata of TB sizes. Not to mention that metadata sizes can be times larger after decompression. In this paper, we address this problem by presenting a framework, which can deal with large volume of data and extract potential information. What's more, it as well reveals some characteristics of the inter domain routing over long timescale.