FCM based CF: An efficient approach for consolidating big data applications

Abstract

With regard to rapid development of Internet technology and the increasing volume of data and information, the need for systems that can guide users toward their desired items and services may be felt more than ever. As a result, service-relevant data become too big to be effectively processed by traditional approaches. A naive solution is to decrease the number of services that need to be processed in real time. Clustering are such techniques that can reduce the data size by a large factor by grouping similar services together. In this research work, we propose a novel approach called Fuzzy C-Means Clustering-based Collaborative Filtering approach (FCM based CF) to overcome the above mentioned issues. Our proposed mechanism consists of two stages: FCM clustering and collaborative filtering. Clustering is a preprocessing step to separate the big data into manageable parts. Collaborative Filtering is imposed on one of the clusters. The main goal of this research is with respect to users, consolidating and mining their implicit interests from usage reviews or records may be a complement to the explicit interests (ratings). By this means, recommendations can be generated even if there are only few ratings. Finally, our proposed algorithm consolidates the web services and suggests the better web services based on the user navigation.