Crucial Tool Features for Successful Combinatorial Input Parameter Testing in an Industrial Application

Abstract

In this paper, we report on the use of available combinatorial testing tools on a large industrial object-oriented .N E T application to find out whether combinatorial testing methods are readily usable to perform combinatorial input parameter testing in an industrial setup. In particular, we applied CAmetrics and CCM to compute the combinatorial coverage of existing tests, and CAgen and ACTS to generate test suites from scratch. We identified shortcomings in some of the tools that may prevent them from being used in practice.