Building Real-time knowledge in Social Media on Focus Point: An Apache Spark Streaming Implementation

Abstract

Be it an individual, or a community or an organization, Social media has given rise to trends and interests which can be triggered for various reasons. Analyzing social media with this freely available interesting public information could yield interested results. Focus Point means the current trend and interest on twitter which can help us in analyzing multiple factors e.g. sensitivity of the ongoing trend, its spread, people getting affected, its effect on business and soon. Traditionally available approaches help us in analyzing batch data and finding interests and trends on it. Now with the advancements in the field of technology helps us in analyzing large amount of online data within seconds. Here we will be exploring twitter streams API in combination with latest technologies like Apache Spark Streaming. In this paper, we will propose our methodology of analyzing and exploring tweets in real-time with the extent of converting information we are getting from twitter to knowledge.