Design and development of high performance, scalable content based publish subscribe system: doctoral symposium

Abstract

In many application scenarios, content based pub/sub systems are required to provide stringent service guarantees such as reliable delivery, high performance in terms of throughput and low latency for event notification to interested subscribers. Matching algorithm play a critical role in content based pub/sub systems. The aim of our work is design and development of parallel, scalable and high performance content based publish subscribe system. We parallelize event processing using thread based and multi GPU approaches. We achieved low latency and high throughput when pub/sub is deployed on Apache Storm, a real time event processing system. Throughput gain and reduction in matching time is nearly 48% and 40% respectively in multi GPGPU approach of event processing compared to earlier work mentioned in [1].