Analysis of big data security practices

Abstract

In modern world, huge amount of data is common across all businesses which aim to unlock new economy from these sources. Hadoop was developed to analyze large scale data repository in a parallel computing architecture. The main task in this process is to handle this “Big Data” by applying proper strategies. So, present industry is focusing on the methods in which this “Big Data” can be used for their business growth. There's no suspicion that the setup of Data Lake on hadoop can provide a new way of analytics and intuition analysis. Beyond experimentations and POCs, today Hadoop is considered more into production. As we are moving towards the stage where Hadoop is considered for real-time production scenarios and major chunk of the production data is normally sensitive, or subject to many control measures, it becomes high priority to consider the security aspects in hadoop before deciding on Hadoop installation for any enterprise. This paper evaluates various issues in Hadoop ecosystem and its popular distributions by top big data players in the market. It further intends to investigate and compare the current security features being provided in those big data distributions along with other open source big data security solutions to help in building secure big data environment.