Software Testing Verification & Reliability最新文献_第2页

In vivo test and rollback of Java applications as they are 实时测试和回滚Java应用程序

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-06-25 DOI: 10.1002/stvr.1857

A. Bertolino, Guglielmo De Angelis, Breno Miranda, P. Tonella

{"title":"In vivo test and rollback of Java applications as they are","authors":"A. Bertolino, Guglielmo De Angelis, Breno Miranda, P. Tonella","doi":"10.1002/stvr.1857","DOIUrl":"https://doi.org/10.1002/stvr.1857","url":null,"abstract":"Modern software systems accommodate complex configurations and execution conditions that depend on the environment where the software is run. While in house testing can exercise only a fraction of such execution contexts, in vivo testing can take advantage of the execution state observed in the field to conduct further testing activities. In this paper, we present the Groucho approach to in vivo testing. Groucho can suspend the execution, run some in vivo tests, rollback the side effects introduced by such tests, and eventually resume normal execution. The approach can be transparently applied to the original application, even if only available as compiled code, and it is fully automated. Our empirical studies of the performance overhead introduced by Groucho under various configurations showed that this may be kept to a negligible level by activating in vivo testing with low probability. Our empirical studies about the effectiveness of the approach confirm previous findings on the existence of faults that are unlikely exposed in house and become easy to expose in the field. Moreover, we include the first study to quantify the coverage increase gained when in vivo testing is added to complement in house testing.","PeriodicalId":49506,"journal":{"name":"Software Testing Verification & Reliability","volume":"40 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2023-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77991103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Adversarial example‐based test case generation for black‐box speech recognition systems 针对黑盒语音识别系统的基于对抗性示例的测试用例生成

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-05-25 DOI: 10.1002/stvr.1848

Hanbo Cai, Pengcheng Zhang, Hai Dong, Lars Grunske, Shunhui Ji, Tianhao Yuan

引用次数: 0

HiRAM: A hierarchical risk assessment model and its implementation for an industrial Internet of Things in the cloud HiRAM:分级风险评估模型及其在云中的工业物联网实施

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-05-18 DOI: 10.1002/stvr.1847

Wen-Lin Sun, Ying-Han Tang, Yu-Lun Huang

{"title":"HiRAM: A hierarchical risk assessment model and its implementation for an industrial Internet of Things in the cloud","authors":"Wen-Lin Sun, Ying-Han Tang, Yu-Lun Huang","doi":"10.1002/stvr.1847","DOIUrl":"https://doi.org/10.1002/stvr.1847","url":null,"abstract":"The trend towards intelligent control processes has introduced the Internet of Things (IoT) and cloud computing technologies to factories. IoT devices can sense data and send it to a cloud for further analysis in a factory. Consequently, the quantity of such valuable data flowing in an industrial cyber‐physical system has gradually increased. Tailoring a risk assessment system for Industrial IoT (IIoT) is essential, particularly for a cloud platform that handles the IIoT data flow. In this study, we leverage analytic hierarchy processes (AHPs) and propose Hierarchical Risk Assessment Model (HiRAM) for an IIoT cloud platform. The proposed model allows the platform to self‐evaluate its security status. Furthermore, a modular and responsive Risk Assessment System based on HiRAM, called HiRAM‐RAS, is realized and evaluated in a real‐world IIoT cloud platform. We deploy HiRAM‐RAS to a sample application and introduce the practical deployment procedures. We then estimate the practicality of the HiRAM‐RAS by injecting different degrees of errors and launching Distributed denial‐of‐service (DDoS) attacks. The results demonstrate the changes in integrity and availability scores evaluated by HiRAM.","PeriodicalId":49506,"journal":{"name":"Software Testing Verification & Reliability","volume":"170 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2023-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80671750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Combinatorial testing and machine learning for automated test generation 用于自动测试生成的组合测试和机器学习

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-05-10 DOI: 10.1002/stvr.1846

Yves Le Traon, Tao Xie

引用次数: 0

Test infrastructure and environment 测试基础设施和环境

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-04-11 DOI: 10.1002/stvr.1844

Yves Le Traon, Tao Xie

引用次数: 0

On subsumption relationships in data flow testing 论数据流测试中的包容关系

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-03-21 DOI: 10.1002/stvr.1843

M. Chaim, Kesina Baral, J. Offutt, Mario Concilio Neto, Roberto P. A. Araujo

{"title":"On subsumption relationships in data flow testing","authors":"M. Chaim, Kesina Baral, J. Offutt, Mario Concilio Neto, Roberto P. A. Araujo","doi":"10.1002/stvr.1843","DOIUrl":"https://doi.org/10.1002/stvr.1843","url":null,"abstract":"Data flow testing creates test requirements as definition‐use (DU) associations, where a definition is a program location that assigns a value to a variable and a use is a location where that value is accessed. Data flow testing is expensive, largely because of the number of test requirements. Luckily, many DU‐associations are redundant in the sense that if one test requirement (e.g. node, edge and DU‐association) is covered, other DU‐associations are guaranteed to also be covered. This relationship is called subsumption. Thus, testers can save resources by only covering DU‐associations that are not subsumed by other testing requirements. Although this has the potential to significantly decrease the cost of data flow testing, there are roadblocks to its application. Finding data flow subsumptions correctly and efficiently has been an elusive goal; the savings provided by data flow subsumptions and the cost to find them need to be assessed; and the fault detection ability of a reduced set of DU‐associations and the advantages of data flow testing over node and edge coverage need to be verified. This paper presents novel solutions to these problems. We present algorithms that correctly find data flow subsumptions and are asymptotically less costly than previous algorithms. We present empirical data that show that data flow subsumption is effective at reducing the number of DU‐associations to be tested and can be found at scale. Furthermore, we found that using reduced DU‐associations decreased the fault detection ability by less than 2%, and data flow testing adds testing value beyond node and edge coverage.","PeriodicalId":49506,"journal":{"name":"Software Testing Verification & Reliability","volume":"75 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2023-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86397693","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An investigation of distributed computing for combinatorial testing 面向组合测试的分布式计算研究

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-02-27 DOI: 10.1002/stvr.1842

Edmond La Chance, Sylvain Hallé

引用次数: 0

Model‐based testing 基于模型检测的测试

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-02-13 DOI: 10.1002/stvr.1841

Yves Le Traon, Tao Xie

{"title":"Model‐based testing","authors":"Yves Le Traon, Tao Xie","doi":"10.1002/stvr.1841","DOIUrl":"https://doi.org/10.1002/stvr.1841","url":null,"abstract":"This issue contains two papers. Both papers focus on model-based testing. The first paper, “RATE: A Model-Based Testing Approach That Combines Model Refinement and Test Execution” by Andrea Bombarda, Silvia Bonfanti, Angelo Gargantini, Yu Lei, and Feng Duan, presents the RATE approach and its application to three case studies. The RATE approach helps testers verify the compliance of the actual implementation with respect to the specification of the system under test (SUT). In particular, the approach starts from an initial model of the SUT and refines the model based on the testing results of the previous refinement. The approach derives tests from Avalla scenarios written manually during validation or automatically generated from the model using the ATGT tool. The approach then executes the tests on the code implementation to obtain coverage information in order to identify missing system features or behaviours (not captured in the model) and add them to the next refinement. The authors have applied the approach to three different case studies and have shown the approach’s effectiveness. (Recommended by Manuel Nunez). The second paper, “Coloured Petri Nets for Abstract Test Generation in Software Engineering” by Alvaro Sobrinho, Ially Almeida, Leandro Dias da Silva, Lenardo Chaves e Silva, Adriano Araújo, Tassio Fernandes Costa, and Angelo Perkusich, presents an investigation of the current approaches of abstract test generation for Coloured Petri Nets (CPN) in order to guide testers to select a suitable approach when conducting model-based testing using CPN. In particular, the authors conduct a systematic literature review to investigate the current approaches of abstract test generation for CPN and then focus on specific implementations and advantages/disadvantages. The authors then conduct an empirical study with formal models of medical systems to study the current approaches of abstract test generation for CPN. The study results show that CPN provides reliable tests quickly, dependent on the applied approach of abstract test generation. (Recommended by Manuel Nunez).","PeriodicalId":49506,"journal":{"name":"Software Testing Verification & Reliability","volume":"16 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2023-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72718895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Test environments for large‐scale software systems—An industrial study of intrinsic and extrinsic success factors 大规模软件系统的测试环境——内在和外在成功因素的工业研究

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2023-01-03 DOI: 10.1002/stvr.1839

Torvald Mårtensson, Göran Ancher, Daniel Ståhl

{"title":"Test environments for large‐scale software systems—An industrial study of intrinsic and extrinsic success factors","authors":"Torvald Mårtensson, Göran Ancher, Daniel Ståhl","doi":"10.1002/stvr.1839","DOIUrl":"https://doi.org/10.1002/stvr.1839","url":null,"abstract":"The characteristics of the test environment are of vital importance to its ability to support the organizations testing objectives. This paper seeks to address the need for a structured and reliable approach, which can be used by companies and other organizations to optimize their test environments in each individual case. The reported study included a series of interviews with 30 individuals, a series of focus groups with in total 31 individuals and a cross‐company workshop with 30 participants from five large‐scale companies, operating in different industry segments. The study resulted in a list of success factors, including not only characteristics and capabilities existing within a test environment (intrinsic success factors) but also properties not inherent to the test environment, but still vital for a successfully implemented test environment (extrinsic success factors). This distinction is important, as the root causes differ and as addressing them requires distinct approaches—not only of technology but also of organization, communication and collaboration. We find that successful implementations of test environments for large‐scale software systems depend primarily on how they support the company's business strategy, test organization and product testability (extrinsic success factors). Based on this, test environments can then be optimized to improve test environment capabilities, usability and stability (intrinsic success factors). The list of intrinsic and extrinsic success factors was well received by all five companies included in the study, supporting that the intrinsic and extrinsic success factors for test environments can be applied to a large segment of the software industry.","PeriodicalId":49506,"journal":{"name":"Software Testing Verification & Reliability","volume":"12 1","pages":""},"PeriodicalIF":1.5,"publicationDate":"2023-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82402442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Coloured Petri nets for abstract test generation in software engineering 软件工程中抽象测试生成的彩色Petri网

IF 1.5 4区计算机科学

Software Testing Verification & Reliability Pub Date : 2022-12-20 DOI: 10.1002/stvr.1837

Álvaro Sobrinho, Ially Almeida, Leandro Dias da Silva, L. C. E. Silva, Adriano Araújo, Tássio Fernandes Costa, A. Perkusich

引用次数: 0