2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)最新文献

Kex at the SBFT 2023 Java Tool Competition 在SBFT 2023 Java工具竞赛中的关键字

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00017

A. Abdullin, M. Akhin

引用次数: 0

LIBAFL LIBFUZZER: LIBFUZZER on Top of LIBAFL

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00021

Addison Crump, Andrea Fioraldi, D. Maier, Dongjia Zhang

引用次数: 0

SBFT Tool Competition 2023 - Java Test Case Generation Track SBFT工具竞赛2023 - Java测试用例生成跟踪

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00025

Gunel Jahangirova, Valerio Terragni

引用次数: 3

UTBot at the SBFT 2023 Java Tool Competition UTBot在SBFT 2023 Java工具竞赛中的表现

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/sbft59156.2023.00019

Dmitry Ivanov, Alexey Menshutin, Maxim D. Pelevin, D. Stepanov, Denis Fokin, Yury Kamenev, Egor Kulikov, Artemiy Kononov, Sergey Pospelov, Ivan Volkov, Alena Lisevych, Timur Yuldashev, Nikita Stroganov, Andrey Tarbeev

引用次数: 0

RoadSign at the SBFT 2023 Tool Competition Cyber-Physical Systems Track SBFT 2023工具竞赛网络物理系统赛道上的道路标志

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00006

J. Ayerdi, Aitor Arrieta, M. Illarramendi

引用次数: 1

SBFT Tool Competition 2023 - Cyber-Physical Systems Track SBFT工具竞赛2023 -信息-物理系统轨道

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00010

Matteo Biagiola, Stefan Klikovits, J. Peltomäki, Vincenzo Riccio

引用次数: 10

Grammar-Based Evolutionary Fuzzing for JSON-RPC APIs 基于语法的JSON-RPC api进化模糊分析

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00026

Lisette Veldkamp, Mitchell Olsthoorn, Annibale Panichella

{"title":"Grammar-Based Evolutionary Fuzzing for JSON-RPC APIs","authors":"Lisette Veldkamp, Mitchell Olsthoorn, Annibale Panichella","doi":"10.1109/SBFT59156.2023.00026","DOIUrl":"https://doi.org/10.1109/SBFT59156.2023.00026","url":null,"abstract":"Web Application Programming Interfaces (APIs) allow systems to be addressed programmatically and form the backbone of the internet. RESTful and RPC APIs are among the most common API architectures used. In the last decades, researchers have proposed various techniques for automated testing of RESTful APIs, however, to the best of the authors’ knowledge there exists no work on testing JSON-RPC (one of the two data formats supported by RPC) APIs. To address this limitation, we propose a grammar-based evolutionary fuzzing approach for testing JSON-RPC APIs that uses a novel black-box heuristic. Specifically, we use a diversity-based fitness function based on hierarchical clustering to quantity the differences in API method responses. Our hypothesis is that responses that are unlike previously seen ones are an indication that new uncovered code paths are reached. We evaluate our approach on the XRP ledger, a large-scale industrial blockchain system that uses JSON-RPC APIs. Our results show that the proposed approach performs significantly better than the baseline (grammar-based fuzzer) and covers an additional 240 branches.","PeriodicalId":309629,"journal":{"name":"2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)","volume":"208 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114979005","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

PASTIS: A Collaborative Approach to Combine Heterogeneous Software Testing Techniques PASTIS:一种结合异构软件测试技术的协作方法

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00014

Robin David, Richard Abou Chaaya, C. Heitman

{"title":"PASTIS: A Collaborative Approach to Combine Heterogeneous Software Testing Techniques","authors":"Robin David, Richard Abou Chaaya, C. Heitman","doi":"10.1109/SBFT59156.2023.00014","DOIUrl":"https://doi.org/10.1109/SBFT59156.2023.00014","url":null,"abstract":"The fuzzing research field experienced outstanding advances over the past decade, making it a very effective approach for software testing. Dynamic Symbolic Execution (DSE) also called whitebox fuzzing is another approach that also evolved significantly and has the advantage of being able to solve very complex path conditions. Given fuzzing advances, knowing whether DSE is still relevant to help improving fuzzing coverage is an open research question. This paper aims at answering this question by empirically studying software testing techniques in a collaborative environment, and especially combining fuzzing and DSE. We show that in some cases DSE helps uncover some code locations not reached by fuzzers or can speed up the discovery of such coverage. We propose a combination of fuzzing and DSE into an ensemble fuzzing framework called PASTIS that helps in circumventing engines inner-working discrepancies. In this line, we propose a few DSE optimizations to maximize its ability to provide relevant inputs to fuzzers. One of them is a coverage strategy called prefixed-edge, which is an optimization over edge coverage. Finally, we show the advantages and roadblocks one can meet in trying to combine heterogeneous fuzzers and give insights on how to do it more efficiently.","PeriodicalId":309629,"journal":{"name":"2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129779104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Automatic Generation of Smell-free Unit Tests 自动生成无异味的单元测试

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00013

João Afonso, José Campos

{"title":"Automatic Generation of Smell-free Unit Tests","authors":"João Afonso, José Campos","doi":"10.1109/SBFT59156.2023.00013","DOIUrl":"https://doi.org/10.1109/SBFT59156.2023.00013","url":null,"abstract":"Automated test generation tools, such as EvoSuite, typically aim to generate tests that maximize code coverage and do not adequately consider non-coverage aspects that may be relevant for developers, e.g., test’s code quality. Hence, automatically generated tests are often affected by test-specific bad programming practices, i.e., test smells, that may hinder the quality of the test’s source code and, ultimately, the quality of the code under test. Although EvoSuite uses secondary criteria and a post-processing procedure to optimize non-coverage aspects and improve the readability of the tests, it does not explicitly consider the usage of good programming practices. Thus, in this paper, we propose a novel approach to assist EvoSuite’s search algorithm in generating smell-free tests out of the box. To this aim, we first compile a set of 54 test smell metrics from several sources. Secondly, we systematically identify 30 smells that do not affect the tests generated by EvoSuite and eight smells that cannot be automatically computed. Thirdly, we incorporate the remaining 16 test smells as metrics into EvoSuite and empirically identify that only 14 smells affect the tests generated by the tool (e.g., Indirect Testing). Fourthly, we describe and integrate an approach to optimize test smell metrics into EvoSuite. Finally, we conduct an empirical study to (i) understand to what extend EvoSuite’s default mechanisms leads to the generation of fewer smelly tests. (ii) to assess whether our approach leads to the generation of fewer smelly tests. And (iii) how our approach affects the coverage and fault detection effectiveness of the generated tests. Our results report that our approach can generate 8.58% fewer smelly tests without significantly compromising their coverage or fault detection effectiveness.","PeriodicalId":309629,"journal":{"name":"2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT)","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123141008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

WOGAN at the SBFT 2023 Tool Competition - Cyber-Physical Systems Track WOGAN在SBFT 2023工具竞赛-网络物理系统赛道上

2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) Pub Date : 2023-05-01 DOI: 10.1109/SBFT59156.2023.00009

Jesper Winsten, Ivan Porres

引用次数: 3