Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering最新文献_第2页

Effectiveness Assessment of an Early Testing Technique using Model-Level Mutants 使用模型级突变体的早期测试技术的有效性评估

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084257

Maria Fernanda Granda, Nelly Condori-Fernández, T. Vos, Ó. Pastor

{"title":"Effectiveness Assessment of an Early Testing Technique using Model-Level Mutants","authors":"Maria Fernanda Granda, Nelly Condori-Fernández, T. Vos, Ó. Pastor","doi":"10.1145/3084226.3084257","DOIUrl":"https://doi.org/10.1145/3084226.3084257","url":null,"abstract":"While modern software development technologies enhance the capabilities of model-based/driven development, they introduce challenges for testers such as how to perform early testing at model level to ensure the quality of the model. In this context, we have developed an early testing technique supported by the CoSTest tool to validate requirements at model level. In this paper we describe an empirical evaluation of CoSTest with respect to its effectiveness in terms of its fault detection and test suite adequacy. This evaluation is carried out by model-level mutation testing using first order mutants (created by injection of a single fault) and high order mutants (containing more than one fault) with seven conceptual schemas (of different sizes) that represent the functionality of different software systems in different domains. Our findings show that the tests generated by CoSTest are effective at killing a large number of mutants. However, there are also some fault types (e.g. delete the references to a class attribute or an operation call in a constraint) that our test suites were not able to detect. CoSTest was more effective in terms of detecting fault types using high order mutants that first order mutants. Thus, CoSTest's effectiveness is affected by the mutant type tested.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126638408","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 10

Alignment of Stakeholder Expectations about User Involvement in Agile Software Development 利益相关者对敏捷软件开发中用户参与的期望的一致性

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084251

Jim Buchan, Muneera Bano, D. Zowghi, Stephen G. MacDonell, Amrita Shinde

{"title":"Alignment of Stakeholder Expectations about User Involvement in Agile Software Development","authors":"Jim Buchan, Muneera Bano, D. Zowghi, Stephen G. MacDonell, Amrita Shinde","doi":"10.1145/3084226.3084251","DOIUrl":"https://doi.org/10.1145/3084226.3084251","url":null,"abstract":"Context: User involvement is generally considered to contributing to user satisfaction and project success and is central to Agile software development. In theory, the expectations about user involvement, such as the PO's, are quite demanding in this Agile way of working. But what are the expectations seen in practice, and are the expectations of user involvement aligned among the development team and users? Any misalignment could contribute to conflict and miscommunication among stakeholders that may result in ineffective user involvement. Objective: Our aim is to compare and contrast the expectations of two stakeholder groups (software development team, and software users) about user involvement in order to understand the expectations and assess their alignment. Method: We have conducted an exploratory case study of expectations about user involvement in an Agile software development. Qualitative data was collected through interviews to design a novel method for the assessing the alignment of expectations about user involvement by applying Repertory Grids (RG). Results: By aggregating the results from the interviews and RGs, varying degrees of expectation alignments were observed between the development team and user representatives. Conclusion: Alignment of expectations can be assessed in practice using the proposed RG instrument and can reveal misalignment between user roles and activities they participate in Agile software development projects. Although we used RG instrument retrospectively in this study, we posit that it could also be applied from the start of a project, or proactively as a diagnostic tool throughout a project to assess and ensure that expectations are aligned.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125858151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 17

ConfTest: Generating Comprehensive Misconfiguration for System Reaction Ability Evaluation ConfTest:为系统反应能力评估生成综合错配置

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084244

Wang Li, Shanshan Li, Xiangke Liao, Xiangyang Xu, Shulin Zhou, Zhouyang Jia

{"title":"ConfTest: Generating Comprehensive Misconfiguration for System Reaction Ability Evaluation","authors":"Wang Li, Shanshan Li, Xiangke Liao, Xiangyang Xu, Shulin Zhou, Zhouyang Jia","doi":"10.1145/3084226.3084244","DOIUrl":"https://doi.org/10.1145/3084226.3084244","url":null,"abstract":"Misconfigurations are not only prevalent, but also costly on diagnosing and troubleshooting. Unlike software bugs, misconfigurations are more vulnerable to users' mistakes. Improving system reaction to misconfigurations would ease the burden of users' diagnoses. Such effort can greatly benefit from a comprehensive study of system reaction ability towards misconfigurations based on errors injection method. Unfortunately, few such studies have achieved the above goal in the past, primarily because they fail to provide rich error types or only rely on generic alternations to generate misconfigurations. In this paper, we studied 8 mature opensource and commercial software and summarized a fine-grained classification of option types. On the basis of this classification, we could extract syntactic and semantic constraints of each type to generate misconfigurations. We implemented a tool named ConfTest to conduct misconfiguration injection and further analyze system reaction abilities to various of misconfigurations. We carried out comprehensive analyses upon 4 open-source software systems. Our evaluation results show that our option classification covers over 96% of 1582 options from Httpd, Yum, PostgreSQL and MySQL.Our constraint is more fined-grained and the accuracy is more than 90% of of real constraints through manual verification. We compared the capability in finding bad system reactions between ConfTest and ConfErr, showing that the ConfTest can find nearly 3 times the bad reactions found by ConfErr.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"63 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126806577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 13

Industry-academia collaborations in software engineering: An empirical analysis of challenges, patterns and anti-patterns in research projects 软件工程中的产学研合作:对研究项目中的挑战、模式和反模式的实证分析

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084279

V. Garousi, M. Felderer, J. Fernandes, Dietmar Pfahl, M. Mäntylä

{"title":"Industry-academia collaborations in software engineering: An empirical analysis of challenges, patterns and anti-patterns in research projects","authors":"V. Garousi, M. Felderer, J. Fernandes, Dietmar Pfahl, M. Mäntylä","doi":"10.1145/3084226.3084279","DOIUrl":"https://doi.org/10.1145/3084226.3084279","url":null,"abstract":"Research collaboration between industry and academia supports improvement and innovation in industry and helps to ensure industrial relevance in academic research. However, many researchers and practitioners believe that the level of joint industry-academia collaboration (IAC) in software engineering (SE) research is still relatively low, compared to the amount of activity in each of the two communities. The goal of the empirical study reported in this paper is to exploratory characterize the state of IAC with respect to a set of challenges, patterns and anti-patterns identified by a recent Systematic Literature Review study. To address the above goal, we gathered the opinions of researchers and practitioners w.r.t. their experiences in IAC projects. Our dataset includes 47 opinion data points related to a large set of projects conducted in 10 different countries. We aim to contribute to the body of evidence in the area of IAC, for the benefit of researchers and practitioners in conducting future successful IAC projects in SE. As an output, the study presents a set of empirical findings and evidence-based recommendations to increase the success of IAC projects.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130440481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 19

Exploring Automatic Search in Digital Libraries: A Caution Guide for Systematic Reviewers 探索数字图书馆的自动搜索:系统审稿人的谨慎指南

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084275

Paramvir Singh, Karanpreet Singh

引用次数: 13

Software Interoperability Analysis in Practice: A Survey 实践中的软件互操作性分析:综述

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084255

Hadil Abukwaik, H. D. Rombach

引用次数: 7

Automatic Classification of Non-Functional Requirements from Augmented App User Reviews 从增强的应用程序用户评论中自动分类非功能需求

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084241

Mengmeng Lu, Peng Liang

{"title":"Automatic Classification of Non-Functional Requirements from Augmented App User Reviews","authors":"Mengmeng Lu, Peng Liang","doi":"10.1145/3084226.3084241","DOIUrl":"https://doi.org/10.1145/3084226.3084241","url":null,"abstract":"Context: The leading App distribution platforms, Apple App Store, Google Play, and Windows Phone Store, have over 4 million Apps. Research shows that user reviews contain abundant useful information which may help developers to improve their Apps. Extracting and considering Non-Functional Requirements (NFRs), which describe a set of quality attributes wanted for an App and are hidden in user reviews, can help developers to deliver a product which meets users' expectations. Objective: Developers need to be aware of the NFRs from massive user reviews during software maintenance and evolution. Automatic user reviews classification based on an NFR standard provides a feasible way to achieve this goal. Method: In this paper, user reviews were automatically classified into four types of NFRs (reliability, usability, portability, and performance), Functional Requirements (FRs), and Others. We combined four classification techniques BoW, TF-IDF, CHI2, and AUR-BoW (proposed in this work) with three machine learning algorithms Naive Bayes, J48, and Bagging to classify user reviews. We conducted experiments to compare the F-measures of the classification results through all the combinations of the techniques and algorithms. Results: We found that the combination of AUR-BoW with Bagging achieves the best result (a precision of 71.4%, a recall of 72.3%, and an F-measure of 71.8%) among all the combinations. Conclusion: Our finding shows that augmented user reviews can lead to better classification results, and the machine learning algorithm Bagging is more suitable for NFRs classification from user reviews than Naïve Bayes and J48.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114987353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 127

A Machine Learning Approach for Semi-Automated Search and Selection in Literature Studies 文献研究中半自动检索与选择的机器学习方法

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084243

R. Ros, E. Bjarnason, P. Runeson

引用次数: 40

How are Conceptual Models used in Industrial Software Development?: A Descriptive Survey 概念模型在工业软件开发中是如何使用的?:一项描述性调查

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084256

H. Störrle

{"title":"How are Conceptual Models used in Industrial Software Development?: A Descriptive Survey","authors":"H. Störrle","doi":"10.1145/3084226.3084256","DOIUrl":"https://doi.org/10.1145/3084226.3084256","url":null,"abstract":"Background: There is a controversy about the relevance, role, and utility of models, modeling, and modeling languages in industry. For instance, while some consider UML as the \"lingua franca of software engineering\", others claim that \"the majority1 [of industry practitioners] simply do not use UML.\" Objective: We aspire to evolve this debate to differentiate the circumstances of modeling, and the degrees of formality of models. Method: We have conducted an online survey among industry practitioners and asked them how and for what purposes they use models. The raw (anonymized) survey data is published online. Results: We find that models are widely used in industry, and UML is indeed the leading language. Three distinct usage modes of models are reported, the most frequent of which is informal usage for communication and cognition. MDE-style usage is rare, but does occur. Software architects are believed to benefit most from modeling. Conclusions: Our study contrasts and complements existing studies, and offers explanations for some of the seeming contradictions of previous results. There might be cultural differences in modeling usage that are worth exploring in the future.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121518183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 31

Easier Said Than Done: Diagnosing Misconfiguration via Configuration Constraints Analysis: A Study of the Variance of Configuration Constraints in Source Code 说起来容易做起来难:通过配置约束分析诊断错误配置:源代码中配置约束方差的研究

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2017-06-15 DOI: 10.1145/3084226.3084276

Shulin Zhou, Shanshan Li, Xiaodong Liu, Xiangyang Xu, Si Zheng, Xiangke Liao, Yun Xiong

{"title":"Easier Said Than Done: Diagnosing Misconfiguration via Configuration Constraints Analysis: A Study of the Variance of Configuration Constraints in Source Code","authors":"Shulin Zhou, Shanshan Li, Xiaodong Liu, Xiangyang Xu, Si Zheng, Xiangke Liao, Yun Xiong","doi":"10.1145/3084226.3084276","DOIUrl":"https://doi.org/10.1145/3084226.3084276","url":null,"abstract":"Misconfigurations have drawn tremendous attention for their increasing prevalence and severity, and the main causes are the complexity of configurations as well as the lack of domain knowledge for software. To diagnose misconfigurations, one typical approach is to find out the conditions that configuration options should satisfy, which we refer to as configuration constraints. Current researches only handled part of the situations of configuration constraints in source code, which provide only limited help for misconfiguration diagnosis. To better extract configuration constraints, we conduct a comprehensive manual study on the existence and variance of the configuration constraints in source code from five pieces of popular open-source software. We summarized several findings from different aspects, including the general statistics about configuration constraints, the general features for specific configurations, and the obstacles in extraction of configuration constraints. Based on the findings, we propose several suggestions to maximize the automation of constraints extraction.","PeriodicalId":192290,"journal":{"name":"Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-06-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122656922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4