A Method for Assessing User-generated Tests for Online Courses Exploiting Crowdsourcing Concept

Abstract

In this research, we focus on the challenge of user-generated tests, where crowdsourcing of users have the chance of making new and innovative questions that increases the allowance for a teacher to create a new test. This approach replaces the dependence of stored questions/ answers pair that encourage memory skills not learning skills. The limitation of how to accept these questions contents is raised up. In this paper we propose a question acceptance method based on two measures that weight the question's score, which are difficulty and goodness factors. Since the formalization of assessment and goodness which we made in this paper are recursive, we also propose a heuristic algorithm for iteratively calculating both values. Moreover, we show simulation result to confirm that the algorithm converges, and that it reflects the difficulty and the goodness factors.