2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)最新文献

Applying a Pairwise Coverage Criterion to Scenario-Based Testing 对基于场景的测试应用成对覆盖标准

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.23

L. D. Bousquet, Mickaël Delahaye, Catherine Oriat

引用次数: 4

A Tool for Automated Inspection of Software Design Documents and Its Empirical Evaluation in an Aviation Industry Setting 航空工业背景下软件设计文档自动检测工具及其实证评价

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.12

M. E. Coskun, M. Ceylan, Kadir Yigitozu, V. Garousi

{"title":"A Tool for Automated Inspection of Software Design Documents and Its Empirical Evaluation in an Aviation Industry Setting","authors":"M. E. Coskun, M. Ceylan, Kadir Yigitozu, V. Garousi","doi":"10.1109/ICSTW.2016.12","DOIUrl":"https://doi.org/10.1109/ICSTW.2016.12","url":null,"abstract":"While software inspection is an effective activity to detect defects early in the software development lifecycle, it is an effort-intensive and error-prone activity. Motivated by a real need in the context of the Turkish Aerospace Industries Inc. (TAI), a tool named AutoInspect was developed to (semi-) automate the inspection of software design documents and, as a result, to increase the efficiency and effectiveness of the inspection process. We present in this paper the features of the tool, its development details and its initial evaluation for inspecting the design documents of three real systems in the company. The results of the initial case-study reveal that the tool is indeed able to increase the inspections efficiency and effectiveness. In terms of efficiency, inspection engineers who used AutoInspect performed 41-50% more efficiently, for the three design documents under study, compared to the case when the tool was not used (i.e., manual inspections). In terms of effectiveness, compared to manual inspections, the automated approach found between 23-33% more defects in the three design documents under study. As the tool currently only provides partial automation, our efforts are currently underway to increase its automation level even further.","PeriodicalId":335145,"journal":{"name":"2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114617110","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Combinatorial Testing: From Algorithms to Applications 组合测试:从算法到应用

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.40

A. Gargantini, Rachel Tzoref

引用次数: 1

Dynamic Integration Test Selection Based on Test Case Dependencies 基于测试用例依赖性的动态集成测试选择

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.14

S. Tahvili, Mehrdad Saadatmand, S. Larsson, W. Afzal, M. Bohlin, Daniel Sundmark

{"title":"Dynamic Integration Test Selection Based on Test Case Dependencies","authors":"S. Tahvili, Mehrdad Saadatmand, S. Larsson, W. Afzal, M. Bohlin, Daniel Sundmark","doi":"10.1109/ICSTW.2016.14","DOIUrl":"https://doi.org/10.1109/ICSTW.2016.14","url":null,"abstract":"Prioritization, selection and minimization of test cases are well-known problems in software testing. Test case prioritization deals with the problem of ordering an existing set of test cases, typically with respect to the estimated likelihood of detecting faults. Test case selection addresses the problem of selecting a subset of an existing set of test cases, typically by discarding test cases that do not add any value in improving the quality of the software under test. Most existing approaches for test case prioritization and selection suffer from one or several drawbacks. For example, they to a large extent utilize static analysis of code for that purpose, making them unfit for higher levels of testing such as integration testing. Moreover, they do not exploit the possibility of dynamically changing the prioritization or selection of test cases based on the execution results of prior test cases. Such dynamic analysis allows for discarding test cases that do not need to be executed and are thus redundant. This paper proposes a generic method for prioritization and selection of test cases in integration testing that addresses the above issues. We also present the results of an industrial case study where initial evidence suggests the potential usefulness of our approach in testing a safety-critical train control management subsystem.","PeriodicalId":335145,"journal":{"name":"2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127393134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 23

Code Defenders: A Mutation Testing Game 代码捍卫者:一款变异测试游戏

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.43

J. Rojas, G. Fraser

{"title":"Code Defenders: A Mutation Testing Game","authors":"J. Rojas, G. Fraser","doi":"10.1109/ICSTW.2016.43","DOIUrl":"https://doi.org/10.1109/ICSTW.2016.43","url":null,"abstract":"Mutation testing is endorsed by software testing researchers for its unique capability of providing pragmatic estimates of a test suite's fault detection capability, and for guiding testers in improving their test suites. In practice, however, wide-spread adoption of mutation testing is hampered because any non-trivial program results in huge numbers of mutants, many of which are either trivial or equivalent, and thus useless. Trivial mutants reduce the motivation of developers in trusting and using the technique, while equivalent mutants are frustratingly difficult to handle. These problems are exacerbated by insufficient education on testing, which often means that mutation testing is not well understood in practice. These are examples of the types of problems that gamification aims to overcome by making such tedious activities competitive and entertaining. In this paper, we introduce the first steps towards building Code Defenders, a mutation testing game where players take the role of an attacker, who aims to create the most subtle non-equivalent mutants, or a defender, who aims to create strong tests to kill these mutants. The benefits of such an approach are manifold: The game can serve an educational role by engaging learners in mutation testing activities in a fun way. Experienced players will produce strong test suites, capable of detecting even the most subtle bugs that other players can conceive. Equivalent mutants are handled by making them a special part of the gameplay, where points are at stake in duels between attackers and defenders.","PeriodicalId":335145,"journal":{"name":"2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132143971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 51

Successive Refinement of Models for Model-Based Testing to Increase System Test Effectiveness 基于模型的测试模型的连续细化以提高系统测试效率

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.10

Ceren Sahin Gebizli, Hasan Sözer, A. Ercan

引用次数: 8

Pseudo-Exhaustive Testing of Attribute Based Access Control Rules 基于属性的访问控制规则的伪穷举测试

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.35

D. Kuhn, Vincent C. Hu, David F. Ferraiolo, R. Kacker, Yu Lei

引用次数: 15

Automatic Generation of UTP Models from Requirements in Natural Language 基于自然语言的需求自动生成UTP模型

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.27

Satoshi Masuda, T. Matsuodani, K. Tsuda

引用次数: 4

Nequivack: Assessing Mutation Score Confidence Nequivack:评估突变评分置信度

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.29

Dominik Holling, Sebastian Banescu, Marco Probst, A. Petrovska, A. Pretschner

{"title":"Nequivack: Assessing Mutation Score Confidence","authors":"Dominik Holling, Sebastian Banescu, Marco Probst, A. Petrovska, A. Pretschner","doi":"10.1109/ICSTW.2016.29","DOIUrl":"https://doi.org/10.1109/ICSTW.2016.29","url":null,"abstract":"The mutation score is defined as the number of killed mutants divided by the number of non-equivalent mutants. However, whether a mutant is equivalent to the original program is undecidable in general. Thus, even when improving a test suite, a mutant score assessing this test suite may become worse during the development of a system, because of equivalent mutants introduced during mutant creation. This is a fundamental problem. Using static analysis and symbolic execution, we show how to establish non-equivalence or \"don't know\" among mutants. If the number of don't knows is small, this is a good indicator that a computed mutation score actually reflects its above definition. We can therefore have an increased confidence that mutation score trends correspond to actual improvements of a test suite's quality, and are not overly polluted by equivalent mutants. Using a set of 14 representative unit size programs, we show that for some, but not all, of these programs, the above confidence can indeed be established. We also evaluate the reproducibility, efficiency and effectiveness of our Nequivack tool. Our findings are that reproducibility is completely given. A single mutant analysis can be performed within 3 seconds on average, which is efficient for practical and industrial applications.","PeriodicalId":335145,"journal":{"name":"2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114420092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 11

Pairwise Coverage-Based Testing with Selected Elements in a Query for Database Applications 对数据库应用程序查询中的选定元素进行基于覆盖率的成对测试

2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2016-04-11 DOI: 10.1109/ICSTW.2016.19

Koji Tsumura, H. Washizaki, Y. Fukazawa, Keishi Oshima, Ryota Mibe

{"title":"Pairwise Coverage-Based Testing with Selected Elements in a Query for Database Applications","authors":"Koji Tsumura, H. Washizaki, Y. Fukazawa, Keishi Oshima, Ryota Mibe","doi":"10.1109/ICSTW.2016.19","DOIUrl":"https://doi.org/10.1109/ICSTW.2016.19","url":null,"abstract":"Because program behaviors of database applications depend on the data used, code coverages do not effectively test database applications. Additionally, test coverages for database applications that focus on predicates in Structured Query Language (SQL) queries are not useful if the necessary predicates are omitted. In this paper, we present two new database applications using Plain Pairwise Coverage (PPC) and Selected Pairwise Coverage (SPC) for SQL queries called Plain Pairwise Coverage Testing (PPCT) and Selected Pairwise Coverage Testing (SPCT), respectively. These coverages are based on pairwise testing coverage, which employs selected elements in the SQL SELECT query as parameters. We also implement a coverage calculation tool and conduct case studies on two open source software systems. PPCT and SPCT can detect many faults, which are not detected by existing test methods based on predicates in the query. Furthermore, the case study suggests that SPCT can detect faults more efficiently than PPCT and the costs of SPCT can be further reduced by ignoring records filtered out by the conditions of the query.","PeriodicalId":335145,"journal":{"name":"2016 IEEE Ninth International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"129 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124246457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 9