2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET)最新文献

Metamorphic Testing: Beyond Testing Numerical Computations 变形试验:超越试验数值计算

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.7

Z. Zhou

引用次数: 1

Harnessing Multiple Source Test Cases in Metamorphic Testing: A Case Study in Bioinformatics 在变形测试中利用多源测试用例:生物信息学的案例研究

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.4

Joshua Y. S. Tang, A. Yang, T. Chen, J. Ho

{"title":"Harnessing Multiple Source Test Cases in Metamorphic Testing: A Case Study in Bioinformatics","authors":"Joshua Y. S. Tang, A. Yang, T. Chen, J. Ho","doi":"10.1109/MET.2017.4","DOIUrl":"https://doi.org/10.1109/MET.2017.4","url":null,"abstract":"Metamorphic testing (MT) has been applied to software verification, validation and quality assessment. In mostprevious studies, research has focused on deriving metamorphic relations (MRs) such that the input of one or more follow-up testcases is generated from one source test case. We note that some programs under test (PUT) naturally take multiple inputs andprocess them simultaneously to generate multiple outputs. This type of programs are common in the field of big data analysisand bioinformatics. This means, in the source execution of the program, we can obtain multiple outputs from multiple sourcetest cases. Here we consider a type of MR in which multiple follow-up test cases are generated from multiple source testcases simultaneously. We hypothesise that harnessing the outputs from multiple source test cases enables us to obtain additionalinformation about the PUT, and therefore allows us to construct more effective MRs. In this paper, we designed a new MR to testa popular RNA sequence alignment program. Since the MR was designed based on a desirable property of the PUT (which usesa complex heuristic algorithm) rather than a necessary property, violation of this MR indicates the program outputs deviate fromuser expectation, hence this MR can be used for assessing the quality of the outputs. Furthermore, we note that outputs ofthe follow-up test cases allow us to putatively assign alignment information to some sequences that were not aligned in the sourcetest cases, hence potentially identifying and correcting these 'false negative' outputs. We believe this case study provides importantinsight into designing MRs based on multiple source test cases, and how testing results can be used to improve the performanceof some heuristic-based programs.","PeriodicalId":332688,"journal":{"name":"2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET)","volume":"152 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127312719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

A Revisit of the Integration of Metamorphic Testing and Test Suite Based Automated Program Repair 基于自动程序修复的变形测试与测试套件集成研究

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.5

Mingyue Jiang, T. Chen, Fei-Ching Kuo, Zuohua Ding, Eun-Hye Choi, O. Mizuno

{"title":"A Revisit of the Integration of Metamorphic Testing and Test Suite Based Automated Program Repair","authors":"Mingyue Jiang, T. Chen, Fei-Ching Kuo, Zuohua Ding, Eun-Hye Choi, O. Mizuno","doi":"10.1109/MET.2017.5","DOIUrl":"https://doi.org/10.1109/MET.2017.5","url":null,"abstract":"The technique of metamorphic testing (MT) has been integrated with test suite based automated program repair (APR) to alleviate the test oracle problem of APR. The proposed integration yields APR-MT techniques, which can be applied regardless of the existence of a test oracle. In a previous study, the feasibility and effectiveness of the APR-MT technique have been demonstrated via GenProg-MT, an integration of MT and the APR technique GenProg. This paper aims to complement our previous study to investigate the feasibility and effectiveness of APR-MT across different categories of APR techniques. We present the integration of MT with CETI, an APR technique belonging to a different category to GenProg, and conductexperimental analysis on the integrated technique CETI-MT, showing that CETI-MT is comparable to CETI in terms of the repair effectiveness. These results not only demonstrate the feasibility of integrating MT with different categories of APR techniques, but also consolidate the effectiveness of APR-MT techniques, hence increasing the practical benefits of APR-MT techniques.","PeriodicalId":332688,"journal":{"name":"2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET)","volume":"2017 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133351418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Metamorphic Model-Based Testing of Autonomous Systems 基于变形模型的自治系统测试

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.6

M. Lindvall, Adam Porter, Gudjon Magnusson, Christoph Schulze

引用次数: 49

Validating a Deep Learning Framework by Metamorphic Testing 用变形测试验证一个深度学习框架

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.2

Junhua Ding, Xiaojun Kang, Xin-Hua Hu

引用次数: 56

A Template-Based Approach to Describing Metamorphic Relations 基于模板的变质关系描述方法

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017..3

Sergio Segura, Amador Durán Toro, J. Troya, Antonio Ruiz-Cortés

{"title":"A Template-Based Approach to Describing Metamorphic Relations","authors":"Sergio Segura, Amador Durán Toro, J. Troya, Antonio Ruiz-Cortés","doi":"10.1109/MET.2017..3","DOIUrl":"https://doi.org/10.1109/MET.2017..3","url":null,"abstract":"Metamorphic testing enables the generation of test cases in the absence of an oracle by exploiting relations among different executions of the program under test, called metamorphic relations. In a recent survey, we observed a great variability in the way metamorphic relations are described, typically in an informal manner using natural language. We noticed that the lack of a standard mechanism to describe metamorphic relations often makes them hard to read and understand, which hinders the widespread adoption of the technique. In this paper, we propose a template-based approach for the description of metamorphic relations. The proposed template aims to ease communication among practitioners as well as to contribute to research dissemination. Also, it provides a helpful guide for those approaching metamorphic testing for the first time. For the validation of the approach, we used the proposed template to describe 17 previously published metamorphic relations from different domains and groups of authors, without finding expressiveness problems. We hope that this work eases the diffusion and adoption of metamorphic testing, contributing to the progress of this thriving testing technique.","PeriodicalId":332688,"journal":{"name":"2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-05-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125946835","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

Metamorphic Testing for Adobe Data Analytics Software 变形测试的Adobe数据分析软件

2017 IEEE/ACM 2nd International Workshop on Metamorphic Testing (MET) Pub Date : 2017-05-20 DOI: 10.1109/MET.2017.1

Darryl C. Jarman, Z. Zhou, Tsong Yueh Chen

引用次数: 25