How Good is My Software? A Simple Approach for Software Rating based on System Testing Results: A Case Study via Test-in-the Cloud Platform

Abstract

Knowing how good your software is prior to release could indicate whether the software can really work in the actual environment. Executing the system test allows for this to take place. By applying simple analytics approach to the system test cases results of PASS or FAIL for each test strategy imposed, points can be assigned per test case for every test iteration. Then, scores can be calculated. This shall be done to every test tool used per test strategy. The average of accumulated scores from all test strategies is mapped to the predefined rating table to establish software product rating. The proposed approach can be used for complete system testing or ongoing system testing, which serves as early indicator for the software's expected behavior in the actual environment.