2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)最新文献_第2页

Targeted Mutation: Efficient Mutation Analysis for Testing Non-Functional Properties 靶向突变:检测非功能特性的有效突变分析

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.18

B. Lisper, B. Lindström, P. Potena, Mehrdad Saadatmand, M. Bohlin

引用次数: 6

Coverage-Based Reduction of Test Execution Time: Lessons from a Very Large Industrial Project 基于覆盖率的测试执行时间减少:来自一个非常大的工业项目的经验教训

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.6

Thomas Bach, A. Andrzejak, Ralf Pannemans

{"title":"Coverage-Based Reduction of Test Execution Time: Lessons from a Very Large Industrial Project","authors":"Thomas Bach, A. Andrzejak, Ralf Pannemans","doi":"10.1109/ICSTW.2017.6","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.6","url":null,"abstract":"There exist several coverage-based approaches to reduce time and resource costs of test execution. While these methods are well-investigated and evaluated for smaller to medium-size projects, we faced several challenges in applying them in the context of a very large industrial software project, namely SAP HANA. These issues include: varying effectiveness of algorithms for test case selection/prioritization, large amounts of shared (non-specific) coverage between different tests, high redundancy of coverage data, and randomness of test results (i.e. flaky tests), as well as of the coverage data (e.g. due to concurrency issues). We address these issues by several approaches. First, our study shows that compared to standard algorithms, so-called overlap-aware solvers can achieve up to 50% higher code coverage in a fixed time budget, significantly increasing the effectiveness of test case prioritization and selection. We also detected in our project high redundancy of line coverage data (up to 97%), providing opportunities for data size reduction. Finally, we show that removal of coverage shared by tests can significantly increase test specificity. Our analysis and approaches can help to narrow the gap between research and practice in context of coverage-based testing approaches, especially in case of very large software projects.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129174712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 10

Planning-Based Security Testing of the SSL/TLS Protocol 基于规划的SSL/TLS协议安全性测试

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.63

Josip Bozic, Kristoffer Kleine, D. Simos, F. Wotawa

{"title":"Planning-Based Security Testing of the SSL/TLS Protocol","authors":"Josip Bozic, Kristoffer Kleine, D. Simos, F. Wotawa","doi":"10.1109/ICSTW.2017.63","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.63","url":null,"abstract":"With a growing amount of transferred data in an interconnected world, the insurance of a secure communication between two peers becomes a critical task in the software industry. A leak of critical data can cause tremendous costs in a financial, social but also political manner. For this sake, cryptographic protocols are implemented and regulate the data transfer, thus ensuring the safety of transferred data between two peers. The widespread security protocol SSL/TLS provides the mechanisms for this request, however, not without drawbacks since several security leaks have been identified up to now. Since vulnerabilities act as a starting point for a potential malicious action, the identification of such leaks is of highest priority. In this paper a novel testing approach is presented, which adapts planning for security testing of cryptographic protocols. The whole approach is implemented in one testing framework. Its purpose is to automatically test for known vulnerabilities in protocol implementations but to trigger other unintended behavior as well so eventually new security flaws can be identified. Additionally, the planning specification can be extended further so new testing possibilities can be generated. New test cases can be generated dynamically according to changing conditions.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116127188","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Simulation-Based Safety Testing Brake-by-Wire 基于仿真的线控制动安全测试

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.17

Nils Müllner, S. Khan, Md. Habibur Rahman, W. Afzal, Mehrdad Saadatmand

{"title":"Simulation-Based Safety Testing Brake-by-Wire","authors":"Nils Müllner, S. Khan, Md. Habibur Rahman, W. Afzal, Mehrdad Saadatmand","doi":"10.1109/ICSTW.2017.17","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.17","url":null,"abstract":"Mechanical systems in cars are replaced by electronic equivalents. To be authorized for the road, validation that the replacements are at least as good as the old systems is required. For electronic braking systems (brake-by-wire), this goodness translates to safety in terms of maintaining timing constraints. Yet, in the future, the safety of braking maneuvres will depend, not only, on electronic brakes, but also on cooperative driving maneuvres orchestrated among many cars. Connecting both brake-by-wire on the microscopic level with cooperative braking on the macroscopic level allows for determining safety on a broader scale, as both systems feed from the same resource: Time. This paper discusses work-in-progress, introducing and combining two threads: electronic brakes and cooperative braking. Discussing safety on two levels simultaneously motivates connecting a Simulink model of an electronic brake-by-wire system with the traffic simulator SUMO for conducting the required combined validation. How safe is a car in relation to a given maximal braking distance? What is the optimal distribution of reaction time between electronic brakes and cooperative braking? The validation focuses on non-functional safety limited by temporal constraints (translated to braking distance). It can be exploited in an early validation approach to help reduce costs of more expensive real world experimentation. It can also determine the boundaries at which sufficient safety can be guaranteed.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130793093","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

A Test Case Recommendation Method Based on Morphological Analysis, Clustering and the Mahalanobis-Taguchi Method 基于形态分析、聚类和Mahalanobis-Taguchi方法的测试用例推荐方法

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.9

Hirohisa Aman, Takashi Nakano, Hideto Ogasawara, Minoru Kawahara

引用次数: 5

Applications of Practical Combinatorial Testing Methods at Siemens Industry Inc., Building Technologies Division 实用组合测试方法在西门子工业公司建筑技术部的应用

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.40

Murat Ozcan

{"title":"Applications of Practical Combinatorial Testing Methods at Siemens Industry Inc., Building Technologies Division","authors":"Murat Ozcan","doi":"10.1109/ICSTW.2017.40","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.40","url":null,"abstract":"The goal of software testing is to find defects before the product is released to the customer. Siemens has a Zero Defect Culture which strives to continuously improve our software testing methods. The current methods use automated testing and manual testing. This paper examines the use of mixed-strength covering arrays, resulting in requiring fewer tests for higher strength coverage. Using the Combinatorial Test Coverage Measurement command line version (CCM) developed by the National Institute of Standards and Technology (NIST), we found practical ways to measure the coverage percentage and the strength of covering arrays, as well as any given test suite. This enabled us to show where we are and the direction we should take with minimal cost improvements. We investigated combinatorial methods, the use of covering arrays for test inputs and test configurations, and methods to combine the two in various ways during the product life cycle. The goal was to craft the leanest and most impactful formal testing and devise optimal configurations for the system under test. In particular, we consider the problem of testing a large number of setup configurations where each configuration requires many tests. Tradeoffs for producing practical test sets are analyzed, with overall and minimum combinatorial coverage measured, demonstrating significant combinatorial coverage improvements while keeping test set size tractable.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125509523","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Runtime Verification for Detecting Suspension Bugs in Multicore and Parallel Software 多核并行软件悬架缺陷检测的运行时验证

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.20

Sara Abbaspour Asadollah, Daniel Sundmark, H. Hansson

{"title":"Runtime Verification for Detecting Suspension Bugs in Multicore and Parallel Software","authors":"Sara Abbaspour Asadollah, Daniel Sundmark, H. Hansson","doi":"10.1109/ICSTW.2017.20","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.20","url":null,"abstract":"Multicore hardware development increases the popularity of parallel and multicore software, while testing and debugging the software become more difficult, frustrating and costly. Among all types of software bugs, concurrency bugs are both important and troublesome. This type of bugs is increasingly becoming an issue, particularly due to the growing prevalence of multicore hardware. Suspension-based-locking bug is one type of concurrency bugs. This position paper proposes a model based on runtime verification and reflection technique in the context of multicore and parallel software to monitor and detect suspension-based-locking bugs. The model is not only able to detect faults, but also diagnose and even repair them. The model is composed of four layers: Logging, Monitoring, Suspension Bug Diagnosis and Mitigation. The logging layer will observe the events and save them into a file system. The monitoring layer will detect the presents of bugs in the software. The suspension bug diagnosis will identify Suspension bugs by comparing the captured data with the suspension bug properties. Finally, the mitigation layer will reconfigure the software to mitigate the suspension bugs. A functional architecture of a runtime verification tool is also proposed in this paper. This architecture is based on the proposed model and is comprised of different modules.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126474708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Building Combinatorial Test Input Model from Use Case Artefacts 从用例工件构建组合测试输入模型

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.42

Preeti Satish, B. Milind, M. S. Narayan, K. Rangarajan

引用次数: 11

What You See Is What You Test - Augmenting Software Testing with Computer Vision 你所看到的就是你所测试的——用计算机视觉增强软件测试

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.76

R. Ramler, T. Ziebermayr

引用次数: 4

Towards Security-Aware Mutation Testing 迈向安全意识突变检测

2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Pub Date : 2017-03-13 DOI: 10.1109/ICSTW.2017.24

Thomas Loise, Xavier Devroey, Gilles Perrouin, Mike Papadakis, P. Heymans

引用次数: 21