Addressing Challenges of Hadoop for BIG Data Analysis

Abstract

Data has become necessary part of every individual, industry, economy, business function and organization. Miscellaneous industries, machines and institutions are expanding their analytical data at digital world at a very high rate. As this data set increases, selecting the relevant information becomes a laborious task. Therefore, this on-command and on-demand nature of digital universe gives creation of a data category called the Big-Data because of its sheer velocity, volume and variety. It is basically employed to differentiate the various datasets and their sizes are above the ability of the database software tools to manage, evaluate and store. It proposes exclusive computational and analytical challenges which includes measurement errors, scalability and storage bottleneck and noise accumulation.Because of a specific characteristic of the Big-Data they are put in a distributed file system Hadoop (HDFS). However, Hadoop is impartially complex. As Hadoop is new to users, this research paper discusses the important challenges and issues faced during the data mining and deployment of the file system. Aim of this paper is to make user comfortable with Hadoop.