An Industrial Study on Applications of Combinatorial Testing in Modern Web Development

Abstract

The purpose of this study is to describe the new paradigms in front-end web application testing and how combinatorial testing (CT) fits in this modern development environment to create cost effective, highly fault-detecting automated tests. The system under test (SUT) is a cloud based application for monitoring and controlling building operations from Siemens Building Technologies, currently under development. Three examples for the applications of combinatorial testing in the front-end are analyzed, incorporating the CT model into automation using Protractor test framework's end-to-end (e2e) UI tests in behavioral driven development (BDD) style. The manner in which the CT model translates automation code is studied. A scenario where a sequence of actions are incorporated into a CT model is illustrated; with a focus on veri?cation of these sequences, compositions of the actions and streamlining the expected assertions per the test oracle.