PSBench: a benchmark for content- and topic-based publish/subscribe systems

Abstract

The publish/subscribe paradigm has found wide acceptance in a broad variety of use cases that differ dramatically in the characteristics of their workloads. Many different systems have been developed both by academia as well as industry, but there is no definitive benchmark, which enables a fair comparison between the different systems. In this demo, we present PSBench, a benchmark specification and suite for publish/subscribe systems that covers a broad variety of publish/subscribe workloads and scenarios. The benchmark suite is extensible and generic, but the specification targets social games. Social games are the ideal use case since they have a very broad range of requirements and produce a variety of publications and subscriptions. We draw from our experience in massive multiplayer online games to construct a highly realistic workload. In this demo, we present the toolchain, the workload and the graphical interfaces that enable an extensive performance evaluation of publish/subscribe systems.