Multimedia system verification through a usage model and a black test box

Abstract

This paper presents an automated verification methodology aimed at detecting failures in multimedia systems based on a black box testing approach. Moreover, the verification is performed using a black test box as part of a test harness. The quality of a system is examined against functional failures using a model-based testing approach for generating test scenarios. System under test (specifically, the software of the system) is modeled to represent the most probable system usage. In this way, failures that occur most frequently during system exploitation are detected through the testing. Test case execution is fully automated and test oracle is based on image quality analysis. The proposed framework is primarily intended for detecting software-related failures, but will also detect the failures that result from system hardware defects.