A Study of Performance Testing in Configurable Software Systems

软件工程与应用(英文) Pub Date : 2021-09-02 DOI:10.4236/jsea.2021.149028

Xue Han

{"title":"A Study of Performance Testing in Configurable Software Systems","authors":"Xue Han","doi":"10.4236/jsea.2021.149028","DOIUrl":null,"url":null,"abstract":"Customizing applications through program configuration options has been \nproved by many open-source and commercial projects as one of the best practices \nin software engineering. However, traditional performance testing is not in \nsynch with this industrial practice. Traditional performance testing techniques \nconsider program inputs as the only external factor. It ignores the performance \ninfluence of configuration options. This study aims to stimulate research \ninterest in performance testing in the context of configurable software systems \nby answering three research questions. That is, why it is necessary to conduct \nresearch in performance testing, what are the state-of-the-art techniques, and \nhow do we conduct performance testing research in configurable software \nsystems. In this study, we examine the unique characteristics and challenges of \nperformance testing research in configurable software systems. We review and \ndiscuss research topics on the performance bug study, performance anti-patterns, \nprogram analysis, and performance testing. We share the research findings from \nthe empirical study and outline the opening opportunities for new and advanced \nresearchers to contribute to the research community.","PeriodicalId":62222,"journal":{"name":"软件工程与应用(英文)","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2021-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"软件工程与应用(英文)","FirstCategoryId":"1093","ListUrlMain":"https://doi.org/10.4236/jsea.2021.149028","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 2

Abstract

Customizing applications through program configuration options has been proved by many open-source and commercial projects as one of the best practices in software engineering. However, traditional performance testing is not in synch with this industrial practice. Traditional performance testing techniques consider program inputs as the only external factor. It ignores the performance influence of configuration options. This study aims to stimulate research interest in performance testing in the context of configurable software systems by answering three research questions. That is, why it is necessary to conduct research in performance testing, what are the state-of-the-art techniques, and how do we conduct performance testing research in configurable software systems. In this study, we examine the unique characteristics and challenges of performance testing research in configurable software systems. We review and discuss research topics on the performance bug study, performance anti-patterns, program analysis, and performance testing. We share the research findings from the empirical study and outline the opening opportunities for new and advanced researchers to contribute to the research community.

查看原文本刊更多论文

可配置软件系统的性能测试研究

通过程序配置选项定制应用程序已被许多开源和商业项目证明是软件工程中的最佳实践之一。然而，传统的性能测试与这种工业实践并不同步。传统的性能测试技术将程序输入视为唯一的外部因素。它忽略了配置选项对性能的影响。本研究旨在通过回答三个研究问题，激发可配置软件系统环境下性能测试的研究兴趣。也就是说，为什么有必要在性能测试方面进行研究，什么是最先进的技术，以及我们如何在可配置软件系统中进行性能测试研究。在这项研究中，我们考察了可配置软件系统性能测试研究的独特特点和挑战。我们回顾并讨论了有关性能缺陷研究、性能反模式、程序分析和性能测试的研究主题。我们分享了实证研究的研究结果，并概述了新的和先进的研究人员为研究界做出贡献的开放机会。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

软件工程与应用(英文)

自引率

0.00%

发文量

815