2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)最新文献_第6页

Automated Test Generation and Mutation Testing for Alloy 合金的自动测试生成和突变测试

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.31

Allison Sullivan, Kaiyuan Wang, Razieh Nokhbeh Zaeem, S. Khurshid

{"title":"Automated Test Generation and Mutation Testing for Alloy","authors":"Allison Sullivan, Kaiyuan Wang, Razieh Nokhbeh Zaeem, S. Khurshid","doi":"10.1109/ICST.2017.31","DOIUrl":"https://doi.org/10.1109/ICST.2017.31","url":null,"abstract":"We present two novel approaches for automated testing of models written in Alloy – a well-known declarative, first-order language that is supported by a fully automatic SAT-based analysis engine. The first approach introduces automated test generation for Alloy and is embodied by three techniques that create test suites in the traditional spirit of black-box, white-box, and mutation-based testing. The second approach introduces mutation testing for Alloy and defines how to create mutants of Alloy models, compute mutation testing results, and check for equivalent mutants using SAT. The two approaches build on the theoretical foundation defined previously by our AUnit framework, which introduced the idea of unit testing for Alloy in the spirit of unit testing for imperative languages. While test generation and mutation testing are heavily studied problems with many solutions in the context of imperative languages, the key novelty of our work is to introduce and address these problems for the declarative programming paradigm, specifically for the Alloy language. Experimental results using several Alloy subjects, including those with real faults, demonstrate the efficacy of our framework.","PeriodicalId":112258,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121109424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 40

Model-Based Testing IoT Communication via Active Automata Learning 基于模型的主动自动机学习测试物联网通信

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.32

Martin Tappler, B. Aichernig, R. Bloem

引用次数: 80

How Do Assertions Impact Coverage-Based Test-Suite Reduction? 断言如何影响基于覆盖率的测试套件缩减?

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.45

Junjie Chen, Y. Bai, Dan Hao, Lingming Zhang, Lu Zhang, Bing Xie

引用次数: 31

A Controlled Experiment on Coverage Maximization of Automated Model-Based Software Test Cases in the Automotive Industry 汽车行业基于模型的自动化软件测试用例覆盖最大化的控制实验

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.65

R. Darwish, Lynnie Nakyanzi Gwosuta, R. Torkar

引用次数: 5

Transferring State-of-the-Art Immutability Analyses: Experimentation Toolbox and Accuracy Benchmark 转移最先进的不变性分析:实验工具箱和准确性基准

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.55

Benjamin Holland, Ganesh Ram Santhanam, S. Kothari

{"title":"Transferring State-of-the-Art Immutability Analyses: Experimentation Toolbox and Accuracy Benchmark","authors":"Benjamin Holland, Ganesh Ram Santhanam, S. Kothari","doi":"10.1109/ICST.2017.55","DOIUrl":"https://doi.org/10.1109/ICST.2017.55","url":null,"abstract":"Immutability analysis is important to software testing, verification and validation (V&V) because it can be used to identify independently testable functions without side-effects. Existing tools for immutability analysis are largely academic prototypes that have not been rigorously tested for accuracy or have not been maintained and are unable to analyze programs written in later versions of Java. In this paper, we re-implement two prominent approaches to inferring the immutability of an object: one that leverages a points-to analysis and another that uses a type-system. In addition to supporting Java 8 source programs, our re-implementations support the analysis of compiled Java bytecode. In order to evaluate the relative accuracy, we create a benchmark that rigorously tests the accuracy boundaries of the respective approaches. We report results of experiments on analyzing the benchmark with the two approaches and compare their scalability to real world applications. Our results from the benchmark reveal that points-to based approach is more accurate than the type inference based approach in certain cases. However, experiments with real world applications show that the points-to based approach does not scale well to very large applications and a type inference based approach may offer a scalable alternative.","PeriodicalId":112258,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131075624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

A Toolkit for Testing Stochastic Simulations against Statistical Oracles 一个针对统计预言测试随机模拟的工具包

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.50

Matthew Patrick, R. Donnelly, C. Gilligan

引用次数: 2

An Industrial Study of Natural Language Processing Based Test Case Prioritization 基于自然语言处理的测试用例优先级的工业研究

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.66

Yilin Yang, Xinhai Huang, Xuefei Hao, Zicong Liu, Zhenyu Chen

引用次数: 12

Timed k-Tail: Automatic Inference of Timed Automata 时间k尾:时间自动机的自动推理

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.43

F. Pastore, D. Micucci, L. Mariani

{"title":"Timed k-Tail: Automatic Inference of Timed Automata","authors":"F. Pastore, D. Micucci, L. Mariani","doi":"10.1109/ICST.2017.43","DOIUrl":"https://doi.org/10.1109/ICST.2017.43","url":null,"abstract":"Accurate and up-to-date models describing the behavior of software systems are seldom available in practice. To address this issue, software engineers may use specification mining techniques, which can automatically derive models that capture the behavior of the system under analysis. So far, most specification mining techniques focused on the functional behavior of the systems, with specific emphasis on models that represent the ordering of operations, such as temporal rules and finite state models. Although useful, these models are inherently partial. For instance, they miss the timing behavior, which is extremely relevant for many classes of systems and components, such as shared libraries and user-driven applications. Mining specifications that include both the functional and the timing aspects can improve the applicability of many testing and analysis solutions. This paper addresses this challenge by presenting the Timed k-Tail (TkT) specification mining technique that can mine timed automata from program traces. Since timed automata can effectively represent the interplay between the functional and the timing behavior of a system, TkT could be exploited in those contexts where time-related information is relevant. Our empirical evaluation shows that TkT can efficiently and effectively mine accurate models. The mined models have been used to identify executions with anomalous timing. The evaluation shows that most of the anomalous executions have been correctly identified while producing few false positives.","PeriodicalId":112258,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)","volume":"134 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116208972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 27

CBGA-ES: A Cluster-Based Genetic Algorithm with Elitist Selection for Supporting Multi-Objective Test Optimization CBGA-ES:支持多目标测试优化的精英选择聚类遗传算法

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.40

D. Pradhan, Shuai Wang, Shaukat Ali, T. Yue, Marius Liaaen

{"title":"CBGA-ES: A Cluster-Based Genetic Algorithm with Elitist Selection for Supporting Multi-Objective Test Optimization","authors":"D. Pradhan, Shuai Wang, Shaukat Ali, T. Yue, Marius Liaaen","doi":"10.1109/ICST.2017.40","DOIUrl":"https://doi.org/10.1109/ICST.2017.40","url":null,"abstract":"Multi-objective search algorithms (e.g., non-dominated sorting genetic algorithm II (NSGA-II)) have been frequently applied to address various testing problems requiring multi-objective optimization such as test case selection. However, existing multi-objective search algorithms have certain randomness when selecting parent solutions for producing offspring solutions. In the worse case, suboptimal parent solutions may result in offspring solutions with bad quality, and thus affect the overall quality of the next generation. To address such a challenge, we propose a cluster-based genetic algorithm with elitist selection (CBGA-ES) with the aim to reduce such randomness for supporting multi-objective test optimization. We empirically compared CBGA-ES with random search, greedy (as baselines) and four commonly used multi-objective search algorithms (e.g., NSGA-II) using two industrial and one real world test optimization problem, i.e., test suite minimization, test case prioritization, and test case selection. The results showed that CBGA-ES significantly outperformed the baseline algorithms (e.g., greedy), and the four selected search algorithms for all the three test optimization problems. CBGA-ES managed to outperform more than 75% of the objectives for all the four algorithms in each test optimization problem. Moreover, CBGA-ES was able to improve the quality of the solutions for an average of 32.5% for each objective as compared to the four algorithms for the three test optimization problems.","PeriodicalId":112258,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation (ICST)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124588481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 20

Abstraction Re?nement for Non-Zeno Fairness Veri?cation of Linear Hybrid Automata 抽象再保险吗?非芝诺公平验证法案?线性混合自动机的阳离子

2017 IEEE International Conference on Software Testing, Verification and Validation (ICST) Pub Date : 2017-03-01 DOI: 10.1109/ICST.2017.78

Ryo Yanase

引用次数: 0