Towards creating a generalized complex event processing operator using FlinkCEP: architecture & benchmark

Abstract

FlinkCEP, the Complex Event Processing (CEP) API of the Flink Big Data platform, scales-out pattern detection to a number of machines in a computer cluster or cloud. The high expressive power of FlinkCEP's language comes at the cost of cumbersome parameterization of the patterns to be monitored, thus limiting usability. In this work, we build a novel, logical CEP operator that receives as input specifications of CEP queries in the form of extended regular expressions and automatically re-writes them to FlinkCEP programs. We also initiate a benchmarking effort on FlinkCEP.