Empirical evaluation of software testing techniques in an open source fashion

Abstract

Testing technique selection and evaluation remains a key issue in software testing. Industry practitioners need concrete evidence to select proper testing techniques in STLC. Despite the large number of empirical studies which attempt to study the testing techniques’ applicability conditions and allied factors, we are still without realistic and generalized results as studies lack a formal foundation and are not complete in all respects. Additionally, besides varying significantly in terms of parameters they have taken into consideration, many existing studies show contradictory results. Even though the researchers stress on replication of these studies under a common set of guidelines, however, attempts to aggregate results from such replications still has not been fruitful so far. As such, to bridge the gap between researchers and industry professionals, we propose to carry out evaluation of testing techniques on a large scale under a unified framework in an open-source fashion so that the realistic and generalized results are obtained in a shorter span of time.