Regression Testing Goals - View of Practitioners and Researchers

Context: Regression testing is a well-researched area. However,the majority regression testing techniques proposed by theresearchers are not getting the attention of the practitioners. Communicationgaps between industry and academia and disparity in theregression testing goals are the main reasons. Close collaboration canhelp in bridging the communication gaps and resolving the disparities.Objective: The study aims at exploring the views of academicsand practitioners about the goals of regression testing. The purpose isto investigate the commonalities and differences in their viewpointsand defining some common goals for the success of regression testing.Method: We conducted a focus group study, with 7 testingexperts from industry and academia. 4 testing practitioners from 2companies and 3 researchers from 2 universities participated in thestudy. We followed GQM approach, to elicit the regression testinggoals, information needs, and measures.Results: 43 regression testing goals were identified by theparticipants, which were reduced to 10 on the basis of similarityamong the identified goals. Later during the priority assignmentprocess, 5 goals were discarded, because the priority assigned tothese goals was very low. Participants identified 47 informationneeds/questions required to evaluate the success of regression testingwith reference to goal G5 (confidence). Which were then reduced to10 on the basis of similarity. Finally, we identified measures to gaugethose information needs/questions, which were corresponding to thegoal (G5).Conclusions: We observed that participation level ofpractitioners and researchers during the elicitation of goals andquestions was same. We found a certain level of agreement betweenthe participants regarding the regression testing definitions and goals.But there was some level of disagreement regarding the prioritiesof the goals. We also identified the need to implement a regressiontesting evaluation framework in the participating companies.