CMPT: A methodology of comparing performance measurement tools

Abstract

Crowdsourcing-based network benchmarking is an emerging trend for the performance evaluation of mobile networks. This novel problem-solving method allows to collect the measurements from various mobile users in order to estimate overall network performance. In this measurement procedure the experiment is only defined via the used methodology to measure key performance indicator, e.g., the bandwidth. Therefore, it is important to analyze the impact of different scenarios on today's methodologies. In this paper, we present the versatile functionality of our developed application which allows a systematical benchmarking of the network performance by performance measurement tools in the context of a crowdsourced measurement platform. We elaborate on the design algorithm, measurement procedure, and its implementation. We show that the tool and the test methodology constitutes an important contribution to create a baseline for state-of-the-art crowdsourced mobile benchmarking.