Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation最新文献

Comparing transition trees test suites effectiveness for different mutation operators 比较转换树测试套件对不同突变操作符的有效性

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-11-08 DOI: 10.1145/3412452.3423571

H. Khalil, Y. Labiche

{"title":"Comparing transition trees test suites effectiveness for different mutation operators","authors":"H. Khalil, Y. Labiche","doi":"10.1145/3412452.3423571","DOIUrl":"https://doi.org/10.1145/3412452.3423571","url":null,"abstract":"Research demonstrated that faults seeded mutation using operators can be representative of faults in real systems. In this paper, we study the relationship between the different operators used to insert mutants in the fault domain of the system under test and the effectiveness of different state machine test suites at killing those mutants. We are particularly interested in the effectiveness of two interrelated state machine testing strategies at finding different types of faults. Those are the round-trip paths strategy and the transition tree strategy. Using empirical evaluation, we compare the effectiveness of more than two thousand unique test suites at killing mutants seeded using eight different mutation operators. We perform experiments on four experimental objects and provide qualitative analysis of the results. We conclude that neither of the two studied strategies is more effective than the other at killing a certain type of mutants. However, the structure of the finite state machine and the nature of the system under test affect the type of faults detected by the different testing strategies.","PeriodicalId":163705,"journal":{"name":"Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126715855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

The effectiveness of automated software testing techniques (keynote) 自动化软件测试技术的有效性(主题演讲)

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-11-08 DOI: 10.1145/3412452.3428120

A. Aleti

引用次数: 0

SafeDNN: understanding and verifying neural networks (keynote) SafeDNN:理解和验证神经网络(主题演讲)

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-11-08 DOI: 10.1145/3412452.3428119

C. Pasareanu

引用次数: 0

Towards automated testing of RPA implementations 走向RPA实现的自动化测试

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-11-08 DOI: 10.1145/3412452.3423573

Marina Cernat, A. Staicu, Alin Stefanescu

引用次数: 4

Fuzz4B: a front-end to AFL not only for fuzzing experts Fuzz4B:前端的AFL不仅为模糊专家

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-11-08 DOI: 10.1145/3412452.3423572

Ryu Miyaki, Norihiro Yoshida, Natsuki Tsuzuki, Ryota Yamamoto, H. Takada

引用次数: 0

Navigation and exploration in 3D-game automated play testing 3d游戏自动测试中的导航和探索

Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation Pub Date : 2020-09-15 DOI: 10.1145/3412452.3423570

I. Prasetya, Maurin Voshol, Tom Tanis, Adam Smits, B. Smit, Jacco van Mourik, Menno Klunder, Frank Hoogmoed, Stijn Hinlopen, August van Casteren, Jesse van de Berg, Naraenda G.W.Y. Prasetya, Samira Shirzadehhajimahmood, Saba Gholizadeh Ansari

{"title":"Navigation and exploration in 3D-game automated play testing","authors":"I. Prasetya, Maurin Voshol, Tom Tanis, Adam Smits, B. Smit, Jacco van Mourik, Menno Klunder, Frank Hoogmoed, Stijn Hinlopen, August van Casteren, Jesse van de Berg, Naraenda G.W.Y. Prasetya, Samira Shirzadehhajimahmood, Saba Gholizadeh Ansari","doi":"10.1145/3412452.3423570","DOIUrl":"https://doi.org/10.1145/3412452.3423570","url":null,"abstract":"To enable automated software testing, the ability to automatically navigate to a state of interest and to explore all, or at least sufficient number of, instances of such a state is fundamental. When testing a computer game the problem has an extra dimension, namely the virtual world where the game is played on. This world often plays a dominant role in constraining which logical states are reachable, and how to reach them. So, any automated testing algorithm for computer games will inevitably need a layer that deals with navigation on a virtual world. Unlike e.g. navigating through the GUI of a typical web-based application, navigating over a virtual world is much more challenging. This paper discusses how concepts from geometry and graph-based path finding can be applied in the context of game testing to solve the problem of automated navigation and exploration. As a proof of concept, the paper also briefly discusses the implementation of the proposed approach.","PeriodicalId":163705,"journal":{"name":"Proceedings of the 11th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115779313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 10