Why Design Matters: Crowdsourcing of Complex Tasks

Abstract

In this paper, we show how the power of the crowd can be used to do complex tasks using human pose estimation as a use case. Crowdsourcing tasks are usually not very complex and easy to solve by workers that are not experienced in a certain topic. For more complex tasks, it is general recommended to use experienced workers or experts. However, we show that tasks can also be more complex for non-expert workers and that they produce data that is close to what experts would report. Therefore, a detailed description of the crowdsourcing campaign, the methods applied and the results will be given, and we discuss how the obtained data can be used.