RECOMMENDATION SYSTEM USING BLOOM FILTER IN MAPREDUCE

Many clients like to use the Web to discover product details in the form of online reviews. The reviews are provided by other clients and specialists. Recommender systems provide an important response to the information overload problem as it presents users more practical and personalized information facilities. Collaborative filtering methods are vital component in recommender systems as they generate high-quality recommendations by influencing the likings of society of similar users. The collaborative filtering method has assumption that people having same tastes choose the same items. The conventional collaborative filtering system has drawbacks as sparse data problem & lack of scalability. A new recommender system is required to deal with the sparse data problem & produce high quality recommendations in large scale mobile environment. MapReduce is a programming model which is widely used for large-scale data analysis. The described algorithm of recommendation mechanism for mobile commerce is user based collaborative filtering using MapReduce which reduces scalability problem in conventional CF system. One of the essential operations for the data analysis is join operation. But MapReduce is not very competent to execute the join operation as it always uses all records in the datasets where only small fraction of datasets are applicable for the join operation. This problem can be reduced by applying bloomjoin algorithm. The bloom filters are constructed and used to filter out redundant intermediate records. The proposed algorithm using bloom filter will reduce the number of intermediate results and will improve the join performance.