Proceedings of the 1st International Workshop on Test Oracles最新文献

筛选

英文中文

Using machine learning to generate test oracles: a systematic literature review 使用机器学习生成测试预言机:系统的文献综述

Proceedings of the 1st International Workshop on Test Oracles Pub Date : 2021-07-02 DOI: 10.1145/3472675.3473974

Afonso Fontes, Gregory Gay

{"title":"Using machine learning to generate test oracles: a systematic literature review","authors":"Afonso Fontes, Gregory Gay","doi":"10.1145/3472675.3473974","DOIUrl":"https://doi.org/10.1145/3472675.3473974","url":null,"abstract":"Machine learning may enable the automated generation of test oracles. We have characterized emerging research in this area through a systematic literature review examining oracle types, researcher goals, the ML techniques applied, how the generation process was assessed, and the open research challenges in this emerging field. Based on a sample of 22 relevant studies, we observed that ML algorithms generated test verdict, metamorphic relation, and---most commonly---expected output oracles. Almost all studies employ a supervised or semi-supervised approach, trained on labeled system executions or code metadata---including neural networks, support vector machines, adaptive boosting, and decision trees. Oracles are evaluated using the mutation score, correct classifications, accuracy, and ROC. Work-to-date show great promise, but there are significant open challenges regarding the requirements imposed on training data, the complexity of modeled functions, the ML algorithms employed---and how they are applied---the benchmarks used by researchers, and replicability of the studies. We hope that our findings will serve as a roadmap and inspiration for researchers in this field.","PeriodicalId":103186,"journal":{"name":"Proceedings of the 1st International Workshop on Test Oracles","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132542418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 9

Proceedings of the 1st International Workshop on Test Oracles 第一届测试神谕国际研讨会论文集

Proceedings of the 1st International Workshop on Test Oracles Pub Date : 1900-01-01 DOI: 10.1145/3472675

引用次数: 1