A Computer Cluster for Big Data and Data Analytics Management: Design, Implementation, and Assessment

Abstract

This paper deals with the implementation of a computer cluster based on Apache Hadoop technology to provide Big Data and Data Analytics services. The cluster is an innovative proposal of the TIC consulting office (CTIC) of the Universidad Santo Tomás - Bucaramanga, which aims at satisfying the needs regarding Big Data and Data Analytics of the Bucaramanga Metropolitan Area. The cluster implementation includes the description of the architecture and configuration of the equipment involved as well as the series of experiments carried out to assess the cluster's performance in terms of computing time, energy consumption, cost, and carbon footprint.