Apache Spark based analysis on word count application in Big Data

Abstract

The rise in the volume of data, as well as the type of data and the rate at which data is produced, has led to the development of novel processing methods capable of working with such massive amounts of data, termed as Big Data. The most difficult aspects of managing Big Data include its collection and storage, as well as search, sharing, analysis, and visualizations. In this paper explain the characteristics, processing, application of bigdata and its challenges. Also explained how big data support Internet of Things and Cloud computing. By combining big data, IOT, Cloud provides the new architecture.