Apache Spark and Apache Ignite Performance Analysis

Abstract

Big Data represents an actual research topic. More and more it becomes part of people life's through different applications that are used daily, such as stock exchange, news, social media, health-care. All these applications make use of Big Data technologies for storing and processing information. There have been developed numerous technologies for implementing Big Data requirements and it is interesting to follow their strengths and weaknesses, when to use one over another and how well they perform in different situations. In this paper, we compare two frameworks Apache Spark and Ignite that are used for data processing. We perform the comparison taking into consideration the following aspects: features, implementation, architecture, and performance metrics. In order to test the performance, we used two popular applications such as word count and k-means clustering. Results show that Spark achieved better performance than Ignite.