Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing最新文献

An Empirical Analysis of Two Mutation Testing Tools for Java 两个Java突变测试工具的实证分析

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559751

Ricardo Monteiro, Vinicius H. S. Durelli, M. Eler, A. T. Endo

{"title":"An Empirical Analysis of Two Mutation Testing Tools for Java","authors":"Ricardo Monteiro, Vinicius H. S. Durelli, M. Eler, A. T. Endo","doi":"10.1145/3559744.3559751","DOIUrl":"https://doi.org/10.1145/3559744.3559751","url":null,"abstract":"The effectiveness of mutation testing relies on the mutants that are used. However, mutant generation is time-consuming and unwieldy to carry out manually mainly because of the vast number of mutants that need to be generated. Thus, many mutation tools have been developed and employed by researchers. Despite the longstanding availability of mutation tools, many tools still fall short of the mark. Specifically, many tools seldom realize the complete set of mutation operators proposed in the literature and the final set implemented by most tools is heavily influenced by the target programming language, audience, and when mutants are generated (i.e., phase of compilation). Consequently, current mutation tools might produce different results in terms of the mutants killed by a given test suite. We set out to look into the quality of the mutants produced by two different mutation tools for Java: Major and Pit. We found that Pit generates a significantly larger number of mutants than Major. Our results suggest that the mutants generated by Pit perform slightly better than the mutants generated by Major. When excluding potentially equivalent mutants from our analysis, we found that the mutants generated by Major outperformed the ones yielded by Pit.","PeriodicalId":187140,"journal":{"name":"Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122742437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A Survey of Requirements Engineering and Software Testing Practices in Agile Teams 敏捷团队中的需求工程和软件测试实践综述

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559746

Jarbele C. S. Coutinho, W. Andrade, Patricia D. L. Machado

{"title":"A Survey of Requirements Engineering and Software Testing Practices in Agile Teams","authors":"Jarbele C. S. Coutinho, W. Andrade, Patricia D. L. Machado","doi":"10.1145/3559744.3559746","DOIUrl":"https://doi.org/10.1145/3559744.3559746","url":null,"abstract":"In agile methods, the priority of fast delivery of operational software has directly reached the execution of the activities foreseen in the Requirements Engineering (RE) and Software Testing (ST) stages. Thus, understanding how these activities have been performed in agile teams and how they can contribute in a coordinated way to the quality of the software developed, appears as a need for both academia and industry. For this, we conducted an unsupervised exploratory research (Survey) with seventy-two professionals who work in the software industry and who have experience with RE and ST activities. In a complementary way, we compared the findings of the Survey with the results already found in the literature and with agile practices. Such findings highlight that: (i) the activities of Agile RE and Agile ST still need to be matured in terms of their implementation in a coordinated way in the projects; (ii) there are some similarities and differences between what has been investigated in academia and the real practices and challenges of the industry; (iii) some agile practices, specific to RE and ST have been used, as well as other agile practices more related to processes, approaches, and software development. Such practices act in a complementary manner.","PeriodicalId":187140,"journal":{"name":"Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133534373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating the Effectiveness of Regression Test Suites for Extract Method Validation 评估回归测试套件对提取方法验证的有效性

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559745

Levi Gomes, Cassio Cordeiro, Everton L. G. Alves

引用次数: 0

Mutation Operators for Java Streams Java流的变异操作符

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559752

Manoel Aranda, Elvys Soares, Márcio Ribeiro, F. Ferrari, Rohit Gheyi, Arthur Lima

{"title":"Mutation Operators for Java Streams","authors":"Manoel Aranda, Elvys Soares, Márcio Ribeiro, F. Ferrari, Rohit Gheyi, Arthur Lima","doi":"10.1145/3559744.3559752","DOIUrl":"https://doi.org/10.1145/3559744.3559752","url":null,"abstract":"Mutation testing analyzes test suites to verify their capability to detect artificially injected faults. Mutation testing tools rely on mutation operators to simulate those faults by modifying language constructs. The popularization of Streaming APIs, which enable parallel processing of native data structures with relatively succinct constructs, presents challenges related to functional programming, and faults from the APIs’ misuse are already objects of study. However, no comprehensive mutation operators have been defined for this purpose. We propose seven mutation operators to simulate stream-related faults. To evaluate our operators, we mined 22 open-source projects from different domains (i.e., applications for smart cities and messaging frameworks) to identify faults our operators could simulate. We analyzed 357 commits, raising 91 fixes for stream-related faults in GitHub Java projects. Our operators can simulate 96.7% of the analyzed faults, and we verified five of our proposals in practice. Our mutation operators can enhance the capabilities of current mutation testing tools and help developers to improve their test suites by avoiding stream-related faults.","PeriodicalId":187140,"journal":{"name":"Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129299446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating a Conceptual Framework for Supporting Technical Debt Management in Testing Activities - A Feasibility Study 评估在测试活动中支持技术债务管理的概念框架-可行性研究

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559753

Verusca Rocha, Sávio Freire, Manoel G. Mendonça, R. Spínola

{"title":"Evaluating a Conceptual Framework for Supporting Technical Debt Management in Testing Activities - A Feasibility Study","authors":"Verusca Rocha, Sávio Freire, Manoel G. Mendonça, R. Spínola","doi":"10.1145/3559744.3559753","DOIUrl":"https://doi.org/10.1145/3559744.3559753","url":null,"abstract":"Context: Test-related technical debt (TRTD) refers to debt items that affect software testing activities, compromising their quality. Having information on indicators of their presence, causes, effects, and preventive practices can support the management of TRTD items. Although several works have investigated TD indicators, causes, effects, and prevention, there is a need to investigate how to use this information for supporting the management of debt items in the context of testing activities. Aims: This work (i) presents an updated version of a conceptual framework that organizes a set of indicators, causes, effects, and preventive practices of TRTD and (ii) evaluates it with respect to its ease of use, usefulness, and possible future use. Method: We analyzed 46 answers given to a global family of industrial surveys to assemble a conceptual framework for TRTD management and evaluate it by applying the technology acceptance model (TAM) in a feasibility study with 95 participants. Results: The conceptual framework can be useful for supporting the management of TRTD items, as pointed out by 89% of the participants. Most of the participants also indicated that they would gain productivity, performance, agility, and effectiveness by using the conceptual framework. Conclusion: Results indicate that the data embedded into the conceptual framework and the conceptual framework itself are promising to support the management of TRTD items.","PeriodicalId":187140,"journal":{"name":"Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117035199","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A Strategy to Support the Infeasible Test Requirements Identification 支持不可行测试需求识别的策略

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559748

João Choma Neto, Ricardo Chagas, Allan Mori, R. F. Vilela, T. Colanzi, S. R. S. Souza

{"title":"A Strategy to Support the Infeasible Test Requirements Identification","authors":"João Choma Neto, Ricardo Chagas, Allan Mori, R. F. Vilela, T. Colanzi, S. R. S. Souza","doi":"10.1145/3559744.3559748","DOIUrl":"https://doi.org/10.1145/3559744.3559748","url":null,"abstract":"[Context:] Software testing is an important activity to ensure software quality. However, this is expensive because it is hard to generate and select practical test cases to execute a software system. Many infeasible test requirements collaborate to increase the effort on test data generation, for instance, infeasible paths. The identification of infeasible test requirements is not a trivial task and is currently performed manually. Published works tackle this problem and propose a manual process or brute force to mitigate infeasible test requirements. [Objective:] Our goal is twofold, to propose a strategy based on the infeasible path properties and automate the identification process to reveal infeasible and dark-infeasible test requirements without using input data. [Methodology:] We build a strategy to reveal infeasible and dark-infeasible test requirements. Afterward, we automate the strategy by developing a tool to support and scale the infeasible path-revealing process. The strategy was implemented in a tool, called Fi-paths, which supports the strategy. The tool statically analyzes the properties’ source code to reveal infeasible and dark-infeasible test requirements. To evaluate the strategy, we conducted an experimental study using Fi-paths and analyzed a set of sequential programs implemented in the Java language. [Results and conclusion:] The strategy indicates which regions of the source code had the properties, as well as which testing requirements are infeasible and potentially infeasible. The strategy helps the tester by indicating which code regions need more attention. On the other hand, the strategy has the potential to help an algorithm generate input data because it can be used as a stopping criterion. Since the strategy indicates which test requirements may exhibit infeasible behavior, it allows the algorithm to be optimized by accepting recommendations from the tester to cover problematic testing requirements.","PeriodicalId":187140,"journal":{"name":"Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121921203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Fully-Tested code generation from TLA+ specifications 从TLA+规范生成经过全面测试的代码

Proceedings of the 7th Brazilian Symposium on Systematic and Automated Software Testing Pub Date : 2022-10-03 DOI: 10.1145/3559744.3559747

Gabriela Moreira, Cristiano D. Vasconcellos, Janine Kniess

引用次数: 0