Practice challenge recommendations in online judge using implicit rating extraction and utility sequence patterns

Abstract

Purpose

The existing traditional recommendations based on content-based filtering (CBF), collaborative filtering (CF) and hybrid approaches are inadequate for recommending practice challenges in programming online judge (POJ). These systems only consider the preferences of the target users or similar users to recommend items. In the learning environment, recommender systems should consider the learning path, knowledge level and ability of the learner. Another major problem in POJ is the learners don't give ratings to practice challenges like e-commerce and video streaming portals. This purpose of the proposed approach is to overcome the abovementioned shortcomings.

Design/methodology/approach

To achieve the context-aware practice challenge recommendation, the data preparation techniques including implicit rating extraction, data preprocessing to remove outliers, sequence-based learner clustering and utility sequence pattern mining approaches are used in the proposed approach. The approach ensures that the recommender system considers the knowledge level, learning path and learning goals of the learner to recommend practice challenges.

Findings

Experiments on practice challenge recommendations conducted using real-world POJ dataset show that the proposed system outperforms other traditional approaches. The experiment also demonstrates that the proposed system is recommending challenges based on the learner's current context. The implicit rating extracted using the proposed approach works accurately in the recommender system.

Originality/value

The proposed system contains the following novel approaches to address the lack of rating and context-aware recommendations. The mathematical model was used to extract ratings from learner submissions. The statistical approach was used in data preprocessing. The sequence similarity-based learner clustering was used in transition matrix. Utilizing the rating as a utility in the USPAN algorithm provides useful insights into learner–challenge relationships.