2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)最新文献_第6页

Fostering the Diversity of Exploratory Testing in Web Applications 促进Web应用程序中探索性测试的多样性

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-03-23 DOI: 10.1002/stvr.1827

Julien Leveau, Xavier Blanc, Laurent Réveillère, Jean-Rémy Falleri, Romain Rouvoy

{"title":"Fostering the Diversity of Exploratory Testing in Web Applications","authors":"Julien Leveau, Xavier Blanc, Laurent Réveillère, Jean-Rémy Falleri, Romain Rouvoy","doi":"10.1002/stvr.1827","DOIUrl":"https://doi.org/10.1002/stvr.1827","url":null,"abstract":"Exploratory testing (ET) is a software testing approach that complements automated testing by leveraging business expertise. It has gained momentum over the last decades as it appeals testers to exploit their business knowledge to stress the system under test (SUT). Exploratory tests, unlike automated tests, are defined and executed on-the-fly by testers. Testers who perform exploratory tests may be biased by their past experience and therefore may miss anomalies or unusual interactions proposed by the SUT. This is even more complex in the context of web applications, which typically expose a huge number of interaction paths to their users. As testers of these applications cannot remember all the sequences of interactions they performed, they may fail to deeply explore the application scope. This paper therefore introduces a new approach to assist testers in widely exploring any web application. In particular, our approach monitors the online interactions performed by the testers to suggest in real-time the probabilities of performing next interactions. Looking at these probabilities, we claim that the testers who favour interactions that have a low probability (because they were rarely performed), will increase the diversity of their explorations. Our approach defines a prediction model, based on ${n}$-grams, that encodes the history of past interactions and that supports the estimation of the probabilities. Integrated within a web browser extension, it automatically and transparently injects feedback within the application itself. We conduct a controlled experiment and a qualitative study to assess our approach. Results show that it prevents testers to be trapped in already tested loops, and succeeds to assist them in performing deeper explorations of the SUT.","PeriodicalId":235967,"journal":{"name":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114383411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

A Framework for In-Vivo Testing of Mobile Applications 移动应用程序体内测试框架

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-02-05 DOI: 10.1109/ICST46399.2020.00037

M. Ceccato, Davide Corradini, Luca Gazzola, Fitsum Meshesha Kifetew, L. Mariani, Matteo Orrù, P. Tonella

{"title":"A Framework for In-Vivo Testing of Mobile Applications","authors":"M. Ceccato, Davide Corradini, Luca Gazzola, Fitsum Meshesha Kifetew, L. Mariani, Matteo Orrù, P. Tonella","doi":"10.1109/ICST46399.2020.00037","DOIUrl":"https://doi.org/10.1109/ICST46399.2020.00037","url":null,"abstract":"The ecosystem in which mobile applications run is highly heterogeneous and configurable. All layers upon which mobile apps are built offer wide possibilities of variations, from the device and the hardware, to the operating system and middleware, up to the user preferences and settings. Testing all possible configurations exhaustively, before releasing the app, is unaffordable. As a consequence, the app may exhibit different, including faulty, behaviours when executed in the field, under specific configurations.In this paper, we describe a framework that can be instantiated to support in-vivo testing of a mobile app. The framework monitors the configuration in the field and triggers in-vivo testing when an untested configuration is recognized. Experimental results show that the overhead introduced by monitoring is unnoticeable to negligible (i.e., 0-6%) depending on the device being used (high- vs. low-end). In-vivo test execution required on average 3s: if performed upon screen lock activation, it introduces just a slight delay before locking the device.","PeriodicalId":235967,"journal":{"name":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114693811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

CBR: Controlled Burst Recording CBR:控制突发记录

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-02-05 DOI: 10.1109/ICST46399.2020.00033

Oscar Cornejo, D. Briola, D. Micucci, L. Mariani

{"title":"CBR: Controlled Burst Recording","authors":"Oscar Cornejo, D. Briola, D. Micucci, L. Mariani","doi":"10.1109/ICST46399.2020.00033","DOIUrl":"https://doi.org/10.1109/ICST46399.2020.00033","url":null,"abstract":"Collecting traces from software running in the field is both useful and challenging. Traces may indeed help revealing unexpected usage scenarios, detecting and reproducing failures, and building behavioral models that reflect how the software is actually used. On the other hand, recording traces is an intrusive activity that may annoy users, negatively affecting the usability of the applications, if not properly designed.In this paper we address field monitoring by introducing Controlled Burst Recording, a monitoring solution that can collect comprehensive runtime data without compromising the quality of the user experience. The technique encodes the knowledge extracted from the monitored application as a finite state model that both represents the sequences of operations that can be executed by the users and the corresponding internal computations that might be activated by each operation.Our initial assessment with information extracted from ArgoUML shows that Controlled Burst Recording can reconstruct behavioral information more effectively than competing sampling techniques, with a low impact on the system response time.","PeriodicalId":235967,"journal":{"name":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125563128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing 面向测试评估的开源缺陷注入基准测试平台

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-01-25 DOI: 10.1109/ICST46399.2020.00059

Miroslav Bures, P. Herout, Bestoun S. Ahmed

引用次数: 6

CDST: A Toolkit for Testing Cockpit Display Systems CDST:测试座舱显示系统的工具包

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-01-22 DOI: 10.1109/icst46399.2020.00058

Hassan Sartaj, Muhammad Zohaib Z. Iqbal, Muhammad Uzair Khan

引用次数: 3

A Study on Challenges of Testing Robotic Systems 机器人系统测试挑战研究

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2020-01-22 DOI: 10.1109/icst46399.2020.00020

Afsoon Afzal, Claire Le Goues, Michael Hilton, C. Timperley

引用次数: 45

QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs 基于openapi描述的RESTful api的基于属性的测试生成

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2019-12-20 DOI: 10.1109/icst46399.2020.00023

Stefan Karlsson, Adnan Causevic, Daniel Sundmark

{"title":"QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs","authors":"Stefan Karlsson, Adnan Causevic, Daniel Sundmark","doi":"10.1109/icst46399.2020.00023","DOIUrl":"https://doi.org/10.1109/icst46399.2020.00023","url":null,"abstract":"RESTful APIs are an increasingly common way to expose software systems functionality and it is therefore of high interest to find methods to automatically test and verify such APIs. To lower the barrier for industry adoption, such methods need to be straightforward to use with a low effort. This paper introduces a method to explore the behaviour of a RESTful API. This is done by using automatic property-based tests produced from OpenAPI documents that describe the REST API under test. We describe how this method creates artifacts that can be leveraged both as property-based test generators and as a source of validation for results (i.e., as test oracles). Experimental results, on both industrial and open source services, indicate how this approach is a low effort way of finding real faults. Furthermore, it supports building additional knowledge about the system under test by automatically exposing misalignment of specification and implementation. Since the tests are generated from the OpenAPI document this method automatically evolves test cases as the REST API evolves.","PeriodicalId":235967,"journal":{"name":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124260861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 49

Human-In-The-Loop Automatic Program Repair 人在循环自动程序修复

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2019-12-16 DOI: 10.1109/icst46399.2020.00036

Marcel Böhme, Charaka Geethal, Van-Thuan Pham

{"title":"Human-In-The-Loop Automatic Program Repair","authors":"Marcel Böhme, Charaka Geethal, Van-Thuan Pham","doi":"10.1109/icst46399.2020.00036","DOIUrl":"https://doi.org/10.1109/icst46399.2020.00036","url":null,"abstract":"We introduce LEARN2FIX, the first human-in-the-loop, semi-automatic repair technique when no bug oracle–except for the user who is reporting the bug–is available. Our approach negotiates with the user the condition under which the bug is observed. Only when a budget of queries to the user is exhausted, it attempts to repair the bug. A query can be thought of as the following question: “When executing this alternative test input, the program produces the following output; is the bug observed”? Through systematic queries, LEARN2FIX trains an automatic bug oracle that becomes increasingly more accurate in predicting the user’s response. Our key challenge is to maximize the oracle’s accuracy in predicting which tests are bug-revealing given a small budget of queries. From the alternative tests that were labeled by the user, test-driven automatic repair produces the patch. Our experiments demonstrate that LEARN2FIX learns a sufficiently accurate automatic oracle with a reasonably low labeling effort (lt. 20 queries). Given LEARN2FIX’s test suite, the GenProg test-driven repair tool produces a higher-quality patch (i.e., passing a larger proportion of validation tests) than using manual test suites provided with the repair benchmark.","PeriodicalId":235967,"journal":{"name":"2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123014500","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 21

Metamorphic Security Testing for Web Systems Web系统的变形安全测试

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2019-12-11 DOI: 10.1109/icst46399.2020.00028

P. X. Mai, F. Pastore, Arda Goknil, L. Briand

引用次数: 19

Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems 基于熵的机器学习系统测试生成和数据质量评估

2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) Pub Date : 2019-12-11 DOI: 10.1109/icst46399.2020.00060

Sakshi Udeshi, Xingbin Jiang, Sudipta Chattopadhyay

引用次数: 5