Column-oriented data model for data-intensive systems

Abstract

Traditional relational row-oriented databases have some performance issues in the case of data-intensive systems that process large amounts of data. On the other hand, a column-oriented approach to data presentation has shown promising results when applied in analytical processing. This paper shows a design for a webhook (event notifications) software system to facilitate the usage of the columnar approach in data-intensive software systems. It will be an example of using the column store where the analytical requirement is not the primary one. The approach can be applied to any system in the data-intensive context, which has many data points and requirements to store, fetch, and aggregate based on a few specific from many fields.