Supporting Coordination in Crowdsourced Software Testing Services

Abstract

Crowdsourcing is a new phenomenon with great opportunities and benefits; it refers to outsourcing a task to the internet crowds. Crowdsourced Software Testing (CST) is a specific, valuable crowdsourcing service. Its scale, flexibility, cost effectiveness and fast turnaround times are just a few reasons why web-based crowdsourced testing services have recently received a great deal of attention. Major software companies have used CST to test their applications. However, CST has its own challenges and limitations (e.g., tester selection dilemmas, test report processing, overall test quality). The lack of coordination support in CST activities is causing delays and missed opportunities; hence, the best test results may not be guaranteed. This paper presents ongoing research that aims to support coordination in CST activities by identifying coordination challenges in the current practices. The quantitative comparison of 15 CST platforms reveals a lack of computer-based support for testers, project managers and clients.