2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)最新文献

{"title":"Message from the A-MOST 2017 Chairs","authors":"Paolo Arcaini, Xavier Devroey, Shuai Wang","doi":"10.1109/ICSTW.2017.59","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.59","url":null,"abstract":"Welcome to the 13th edition of the Advances in Model-based testing (A-MOST 2017) held on March 17th, 2017 in beautiful Tokyo, Japan. Context of A-MOST: The complexity of software systems is increasing rapidly and thus warrants the development of novel automated testing techniques that can manage the increased complexity of software. Model-Based Testing (MBT) is one such approach towards automated testing that allows managing the complexity of the Software under Test with the use of models. A recent survey shows that MBT has been increasing, being used both in academic and in industrial settings and thus still remains an interesting area of research. In the past 12 years, A-MOST has served as a good venue for interaction among model-based testing researchers from both academia and industry. In 2017, A-MOST received in total eight submissions, and six of them were accepted after a thorough review and discussion process. Each submission was reviewed by three members of the program committee. The topics of accepted papers cover security testing, test case generation, conformance checking, software product line testing and usability testing. The accepted papers are divided into two main sections, i.e., functional MBT and non-functional MBT that will be presented during the workshop. Moreover, we are also delighted to have two well-renowned MBT researchers as keynote speakers. The first keynote speaker is Ina Schieferdecker who is the director of Fraunhofer FOKUS, Germany. The topic of her keynote speech is \"The New Version of the UML Testing Profile\". The second keynote speaker is Shaukat Ali who is currently a senior research scientist from Simula Research Laboratory, Norway. His theme of the keynote speech is \"Uncertainty-Wise Testing\". We thank them very much for accepting our invitations for their inspiring keynote speeches. We also appreciate the effort made by our program committee members for providing their timely reviews with high quality. Last but not least, we would like to thank the A-MOST steering committee for their support and advice. Last, we thank all the authors who submitted their high quality work to A-MOST 2017.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114301697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Weighting for Combinatorial Testing by Bayesian Inference","authors":"Eun-Hye Choi, Tsuyoshi Fujiwara, O. Mizuno","doi":"10.1109/ICSTW.2017.73","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.73","url":null,"abstract":"Combinatorial testing (CT) is a widely-used technique to detect system interaction failures. To improve the test effectiveness of CT, prioritized combinatorial testing inputs priority weights of parameter-values, and generates combinatorial test suites based on the weights. This paper proposes a method to automatically determine the weights of parameter-values by Bayesian inference using previous testing results. Using two open source projects, we evaluate the fault detection effectiveness of the proposed weighting based prioritized combinatorial testing.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"90 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122735002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Impact of Education and Experience Level on the Effectiveness of Exploratory Testing: An Industrial Case Study","authors":"Ceren Sahin Gebizli, Hasan Sözer","doi":"10.1109/ICSTW.2017.8","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.8","url":null,"abstract":"Exploratory Testing (ET) is a widely applied approach in practice. This approach relies on the knowledge and experience of test engineers and technicians who perform ET. Hence, we aimed at evaluating the impact of education and experience level on the effectiveness of ET. We conducted an industrial case study for this purpose. 19 practitioners, who have different educational backgrounds and experience levels, were involved in applying ET for testing a Digital TV system. We measured the number of detected failures and categorized these failures based on their severity. We evaluated effectiveness from two aspects: criticality of the detected failures and efficiency in terms of number of failures detected per unit of time. The results show that the efficiency of ET is significantly affected by both the educational background and experience. When it comes to the number of critical failures detected, we cannot observe any impact of education on results. However, experience level has a significant impact for this aspect as well.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117101171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Automatic Test Generation for Energy Consumption of Embedded Systems Modeled in EAST-ADL","authors":"R. Marinescu, Eduard Paul Enoiu, C. Seceleanu, Daniel Sundmark","doi":"10.1109/ICSTW.2017.19","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.19","url":null,"abstract":"Testing using architectural design models is intended to determine if the realized system meets its specification, and works as a whole in terms of computational components and their interactions. The growing complexity of embedded systems requires new techniques that are able to support testing of extra-functional requirements, like energy usage of components and systems, which is very necessary in order to obtain valid implementations. In this paper, we show how architectural models described in the EAST-ADL architectural language can also be used for testing the energy consumption of embedded systems, after transforming them into networks of formal models called priced timed automata. Assuming an EAST-ADL model annotated with energy consumption information, we show how to automatically generate energy-aware test cases based on statistical model checking (SMC) of the resulting network of priced timed automata. We automate the generation of executable test cases with UPPAAL SMC, using a test strategy based on several random simulation runs of the system. By seeding the original formal model with a set of energy-consumption related faults, we are able to carry out fault detection analysis. We apply this technique on a Brake-by-Wire system from the automotive domain, and evaluate it in terms of efficiency and model fault detection.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127644214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An Architecture for the Development of Mutation Operators","authors":"Macario Polo, Gonzalo Rojas, Isyed Rodriguez, Suilen Hernandez","doi":"10.1109/ICSTW.2017.31","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.31","url":null,"abstract":"This paper introduces an abstract specification of mutation operators that (1) we have used to create traditional operators and, (2) we are currently using to define and implement mutation operators for context-aware, mobile applications that comeproceed from a list of common errors reported by three companies. This specification describes the structure and behavior of mutation operators at a high abstraction level, thus supporting the specification of new mutation operators according to the evolving state of the art of context-awareness. Facing The paper also gives some notes about BacterioWeb, a web-based mutant tool with an execution engine for Android applications.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"376 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116473333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Automated Test Case Generation from OTS/CafeOBJ Specifications by Specification Translation","authors":"Ryusei Mori, Masaki Nakamura","doi":"10.1109/ICSTW.2017.78","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.78","url":null,"abstract":"A skeleton unit test code generation method has been proposed for OTS/CafeOBJ specifications. To obtain executable test codes, we need to instantiate those skeleton test codes. In this study, we propose a method to instantiate them with CafeOBJ rewrite specifications and the exhaustive search command. We compare rewrite specifications obtained by the existing specification translation methods from OTS/CafeOBJ specifications to rewrite specifications.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130722510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Property-Based Testing with External Test-Case Generators","authors":"B. Aichernig, S. Marcovic, Richard Schumi","doi":"10.1109/ICSTW.2017.62","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.62","url":null,"abstract":"Previous work has demonstrated that property-based testing (PBT) is a flexible random testing technique that facilitates the generation of complex form data. For example, it has been shown that PBT can be applied to web-service applications that require various inputs for web-forms. We want to exploit this data generation feature of PBT and combine it with an external test-case generator that can generate test cases via model-based mutation testing. PBT already supports the generation of test cases from stateful models, but it is limited, because it normally only considers the current state during exploration of the model. We want to give the tester more control on how to produce meaningful operation sequences for test cases. By integrating an external test-case generator into a PBT tool, we produce a smaller set of test cases that meet certain coverage criteria. This also reduces the test execution time. We demonstrate our approach with a simple example of an external generator for regular expressions and perform an industrial case study, where we integrate an existing model-based mutation testing generator.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"8 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132891984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Analysing Test Basis and Deriving Test Cases Based on Data Design Documents","authors":"Tsuyoshi Yumoto, T. Matsuodani, K. Tsuda","doi":"10.1109/ICSTW.2017.52","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.52","url":null,"abstract":"In order to deal with an increase in the number of test cases in recent software testing, a test analysis method for black box testing using test categories based on Application Under Test (AUT) and fault knowledge have been proposed in previous studies. AUT is classified into elements of the reference model, and logical test cases are derived. For each element of the model, there are approaches to derive test cases. In this paper, a practiacl knowledge to derive test cases for one element of the model is proposed. This element is a classification for combination of multiple input / output test cases which is derived from data design documents. It is confirmed that the expected test cases can be derived using this approach from a concrete instance of an IT system.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125328878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Improvement of Description for Reusable Test Type by Using Test Frame","authors":"Keiji Uetsuki, Mitsuru Yamamoto","doi":"10.1109/ICSTW.2017.53","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.53","url":null,"abstract":"A knowledge about test activity is valuable information. To store and share the knowledge across software development projects is a key to achieve effective and efficient test activity. We have built a knowledge database about test types to reuse in new projects. However, the intentions of the test types are often misinterpreted when they are reused because of inappropriate descriptions of the test types. To improve the description, we used the test frame to verify that appropriate information is included for their intentions. We applied our improvement procedure to 23 test types that have been reused in system test. As a result of the improvement, the description became accurate to indicate its intention and suitable for test case design.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126668960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Cloud API Testing","authors":"Junyi Wang, Xiaoying Bai, Haoran Ma, Linyi Li, Zhicheng Ji","doi":"10.1109/ICSTW.2017.71","DOIUrl":"https://doi.org/10.1109/ICSTW.2017.71","url":null,"abstract":"Following the Service-Oriented Architecture, Cloud services are exposed as Web APIs (Application Program Interface), which serve as the contracts between the service providers and service consumers. With increasing massive and broad applications of Cloud-based development, a large number of diversified APIs are emerging. Due to their wide impacts, any flaw in the cloud APIs may lead to serious consequences. API testing is thus necessary to ensure the availability, reliability, and stability of cloud services. The research proposed an approach to automating API testing following the model-driven architecture, so that services can be continuously fetched, analyzed and validated. A prototype system ATcloud was constructed to illustrate the process of API understanding, test scenario modeling using directed graph annotated with transfer probabilities between operations, cloud-based test resources management, distributed workload simulation, and performance monitoring.","PeriodicalId":312017,"journal":{"name":"2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117060804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}