Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation最新文献

Model-based testing of stochastic systems with IOCO theory 基于IOCO理论的随机系统模型测试

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994298

M. Gerhold, M. Stoelinga

引用次数: 2

The complementary aspect of automatically and manually generated test case sets 自动和手动生成的测试用例集的互补方面

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994295

A. Vincenzi, T. Bachiega, Daniel G. de Oliveira, S. Souza, J. Maldonado

{"title":"The complementary aspect of automatically and manually generated test case sets","authors":"A. Vincenzi, T. Bachiega, Daniel G. de Oliveira, S. Souza, J. Maldonado","doi":"10.1145/2994291.2994295","DOIUrl":"https://doi.org/10.1145/2994291.2994295","url":null,"abstract":"The test is a mandatory activity for software quality assurance. The knowledge about the software under testing is necessary to generate high-quality test cases, but to execute more than 80% of its source code is not an easy task, and demands an in-depth knowledge of the business rules it implements. In this article, we investigate the adequacy, effectiveness, and cost of manually generated test sets versus automatically generated test sets for Java programs. We observed that, in general, manual test sets determine higher statement coverage and mutation score than automatically generated test sets. But one interesting aspect recognized is that the automatically generated test sets are complementary to the manual test set. When we combined manual with automated test sets, the resultant test sets overcame in more that 10%, on average, statement coverage and mutation score when compared to the rates of manual test set, keeping a reasonable cost. Therefore, we advocate that we should concentrate the use of manually generated test sets on testing essential and critical parts of the software.","PeriodicalId":255079,"journal":{"name":"Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133048665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

Automated workflow regression testing for multi-tenant SaaS: integrated support in self-service configuration dashboard 多租户SaaS的自动化工作流回归测试:自助配置仪表板中的集成支持

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994302

Majid Makki, D. Landuyt, W. Joosen

{"title":"Automated workflow regression testing for multi-tenant SaaS: integrated support in self-service configuration dashboard","authors":"Majid Makki, D. Landuyt, W. Joosen","doi":"10.1145/2994291.2994302","DOIUrl":"https://doi.org/10.1145/2994291.2994302","url":null,"abstract":"Single-instance multi-tenant SaaS applications allow tenant administrators to (extensively) customize the application according to the requirements of their organizations. In the specific case of workflow-driven applications, the SaaS provider may offer a set of pre-defined workflow activities and leave their composition to the tenant administrators. In such cases, the tenant administrator can instantiate new variants of the application without deploying new software. This effectively makes these tenant administrators part of the DevOps team, and in turn creates the need for the SaaS provider to provide them with Quality Assurance tool support. One such tool is a regression testing framework that allows them to make sure that a new version of a workflow can behave similarly as to a successful execution of a previous version. This paper highlights the potential and discusses the inherent challenges of running regression tests on workflows in the production environment of a multi-tenant SaaS application and outlines a solution in terms of architecture and automation techniques for mocking and regression detection under control of tenant administrators.","PeriodicalId":255079,"journal":{"name":"Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127647075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Mitigating (and exploiting) test reduction slippage 减轻(并利用)测试减少滑动

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994301

J. Holmes, Alex Groce, Mohammad Amin Alipour

{"title":"Mitigating (and exploiting) test reduction slippage","authors":"J. Holmes, Alex Groce, Mohammad Amin Alipour","doi":"10.1145/2994291.2994301","DOIUrl":"https://doi.org/10.1145/2994291.2994301","url":null,"abstract":"Reducing the size of tests, typically by delta debugging or a related algorithm, is a critical component of effective automated testing and debugging. Automatically generated or user-submitted tests are often far longer than required, full of unnecessary components that make debugging difficult. Test reduction algorithms automatically remove components of such tests, while preserving the property that the test fails. Unfortunately, reduction can sometimes transform a failing test that detects a subtle, critical, and previously unknown fault into a test that detects a trivial-to-find, unimportant, and already known fault. When reducing a test detecting fault(s) F produces a test that does not detect the same F, this is known as slippage. In the case where an interesting fault slips to an uninteresting fault, slippage is a problem, and must be avoided. However, slippage can also be beneficial, when a long test can be reduced to detect a fault that has not otherwise been detected (including by the original test). While traditional delta debugging only produces one reduced test, the concept of slippage suggests an alternative approach, where the output of reduction is a set of reduced tests, in order to avoid problematic slippage and induce beneficial slippage. In this paper, we present preliminary efforts to understand slippage, and compare two approaches to slippage mitigation.","PeriodicalId":255079,"journal":{"name":"Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126534724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

Towards an MDE-based approach to test entity reconciliation applications 迈向基于mde的方法来测试实体协调应用程序

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994303

J. G. Enríquez, Raquel Blanco, Francisco José Domínguez Mayo, J. Tuya, María José Escalona Cuaresma

引用次数: 11

PredSym: estimating software testing budget for a bug-free release PredSym:为一个没有bug的版本估算软件测试预算

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994294

Arnamoy Bhattacharyya, Timur Malgazhdarov

引用次数: 3

EventFlowSlicer: goal based test generation for graphical user interfaces EventFlowSlicer:为图形用户界面生成基于目标的测试

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994293

Jonathan A. Saddler, Myra B. Cohen

引用次数: 4

Development and maintenance efforts testing graphical user interfaces: a comparison 开发和维护工作测试图形用户界面:比较

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994299

Antonia Kresse, Peter M. Kruse

引用次数: 9

Modernizing hierarchical delta debugging 现代化的分层增量调试

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994296

Renáta Hodován, Ákos Kiss

{"title":"Modernizing hierarchical delta debugging","authors":"Renáta Hodován, Ákos Kiss","doi":"10.1145/2994291.2994296","DOIUrl":"https://doi.org/10.1145/2994291.2994296","url":null,"abstract":"Programmers tasked with the fixing of a bug prefer working on a minimal test case where every single bit is needed to reproduce the failure. However, cutting off the excess parts of a potentially large test case can be a tedious and time-consuming task if performed manually, which has led to the research and development of automated test case reduction techniques. The decade-old Hierarchical Delta Debugging (HDD) algorithm targets structured test inputs, parses them with the help of grammars and applies the minimizing Delta Debugging algorithm to the built trees. We have investigated this algorithm and its implementation, and propose improvements in this paper to address the found shortcomings. We argue that using extended context-free grammars with HDD is beneficial in several ways and the experimental evaluation of our modernized HDD implementation, called Picireny, supports the outlined ideas: the reduced outputs are significantly smaller (by circa 25-40%) on the investigated test cases than those produced by the reference HDD implementation using standard context-free grammars. These results, together with the technical improvements that ease the use of the modernized tool, can hopefully help spreading the adaptation of HDD in practice.","PeriodicalId":255079,"journal":{"name":"Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115518528","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 30

Complete IOCO test cases: a case study 完整的IOCO测试用例:案例研究

Proceedings of the 7th International Workshop on Automating Test Case Design, Selection, and Evaluation Pub Date : 2016-11-18 DOI: 10.1145/2994291.2994297

S. C. Paiva, A. Simão, M. Varshosaz, M. Mousavi

引用次数: 4