Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering最新文献

Quality assessment of systematic reviews in software engineering: a tertiary study 软件工程中系统评审的质量评估:一项高等教育研究

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745815

You Zhou, He Zhang, Xin Huang, Song Yang, M. Babar, Haoze Tang

引用次数: 56

On the effects of programming and testing skills on external quality and productivity in a test-driven development context 在测试驱动的开发环境中，编程和测试技能对外部质量和生产力的影响

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745826

D. Fucci, Burak Turhan, M. Oivo

{"title":"On the effects of programming and testing skills on external quality and productivity in a test-driven development context","authors":"D. Fucci, Burak Turhan, M. Oivo","doi":"10.1145/2745802.2745826","DOIUrl":"https://doi.org/10.1145/2745802.2745826","url":null,"abstract":"Background: In previous studies, a model was proposed that investigated how the developers' unit testing effort impacted their productivity as well as the external quality of the software they developed. Goal: The aim of this study is to enhance the proposed model by considering two additional factors related to the expertise of developers: programming and unit testing skills. The possibility of including such skills in a model that represents the relationship that testing effort has with the developer's productivity and the product's external quality was investigated. Method: Data collected from a test-first development task in academic setting was used in order to gauge the relationship between testing effort, external quality, and productivity. Furthermore, Analysis of Covariance (ANCOVA) was utilized to check the impact of developers' skills on productivity and quality. Result: The results obtained in previous studies were confirmed: there exists a positive effect of testing effort on productivity, but not on quality. Moreover, the developers' skills have an impact on productivity but none on external quality. Conclusion: Productivity improves with testing effort, a result consistent across previous, similar studies. The role of existing skills is a relevant factor in studying the effects of developers' unit testing effort on productivity. Nevertheless, more investigations are needed regarding the relationship between unit testing effort and external quality.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127455605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 15

Experiences from using snowballing and database searches in systematic literature studies 在系统文献研究中运用滚雪球法和数据库检索的经验

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745818

Deepika Badampudi, C. Wohlin, K. Petersen

{"title":"Experiences from using snowballing and database searches in systematic literature studies","authors":"Deepika Badampudi, C. Wohlin, K. Petersen","doi":"10.1145/2745802.2745818","DOIUrl":"https://doi.org/10.1145/2745802.2745818","url":null,"abstract":"Background: Systematic literature studies are commonly used in software engineering. There are two main ways of conducting the searches for these type of studies; they are snowballing and database searches. In snowballing, the reference list (backward snowballing - BSB) and citations (forward snowballing - FSB) of relevant papers are reviewed to identify new papers whereas in a database search, different databases are searched using predefined search strings to identify new papers. Objective: Snowballing has not been in use as extensively as database search. Hence it is important to evaluate its efficiency and reliability when being used as a search strategy in literature studies. Moreover, it is important to compare it to database searches. Method: In this paper, we applied snowballing in a literature study, and reflected on the outcome. We also compared database search with backward and forward snowballing. Database search and snowballing were conducted independently by different researchers. The searches of our literature study were compared with respect to the efficiency and reliability of the findings. Results: Out of the total number of papers found, snowballing identified 83% of the papers in comparison to 46% of the papers for the database search. Snowballing failed to identify a few relevant papers, which potentially could have been addressed by identifying a more comprehensive start set. Conclusion: The efficiency of snowballing is comparable to database search. It can potentially be more reliable than a database search however, the reliability is highly dependent on the creation of a suitable start set.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125394033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 168

Analyzing program readability based on WordNet 基于WordNet的程序可读性分析

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745837

Y. Liu, Xiaobing Sun, Yucong Duan

引用次数: 9

Towards an automation of the traceability of bugs from development logs: a study based on open source software 从开发日志中跟踪bug的自动化:一个基于开源软件的研究

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745833

Bilyaminu Auwal Romo, A. Capiluppi

{"title":"Towards an automation of the traceability of bugs from development logs: a study based on open source software","authors":"Bilyaminu Auwal Romo, A. Capiluppi","doi":"10.1145/2745802.2745833","DOIUrl":"https://doi.org/10.1145/2745802.2745833","url":null,"abstract":"Context: Information and tracking of defects can be severely incomplete in almost every Open Source project, resulting in a reduced traceability of defects into the development logs (i.e., version control commit logs). In particular, defect data often appears not in sync when considering what developers logged as their actions. Synchronizing or completing the missing data of the bug repositories, with the logs detailing the actions of developers, would benefit various branches of empirical software engineering research: prediction of software faults, software reliability, traceability, software quality, effort and cost estimation, bug prediction and bug fixing. Objective: To design a framework that automates the process of synchronizing and filling the gaps of the development logs and bug issue data for open source software projects. Method: We instantiate the framework with a sample of OSS projects from GitHub, and by parsing, linking and filling the gaps found in their bug issue data, and development logs. UML diagrams show the relevant modules that will be used to merge, link and connect the bug issue data with the development data. Results: Analysing a sample of over 300 OSS projects we observed that around 1/2 of bug-related data is present in either development logs or issue tracker logs: the rest of the data is missing from one or the other source. We designed an automated approach that fills the gaps of either source by making use of the available data, and we successfully mapped all the missing data of the analysed projects, when using one heuristics of annotating bugs. Other heuristics need to be investigated and implemented. Conclusion: In this paper a framework to synchronise the development logs and bug data used in empirical software engineering was designed to automatically fill the missing parts of development logs and bugs of issue data.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131751181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Using blind analysis for software engineering experiments 应用盲分析进行软件工程实验

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745832

Boyce Sigweni, M. Shepperd

{"title":"Using blind analysis for software engineering experiments","authors":"Boyce Sigweni, M. Shepperd","doi":"10.1145/2745802.2745832","DOIUrl":"https://doi.org/10.1145/2745802.2745832","url":null,"abstract":"Context: In recent years there has been growing concern about conflicting experimental results in empirical software engineering. This has been paralleled by awareness of how bias can impact research results. Objective: To explore the practicalities of blind analysis of experimental results to reduce bias. Method: We apply blind analysis to a real software engineering experiment that compares three feature weighting approaches with a naïve benchmark (sample mean) to the Finnish software effort data set. We use this experiment as an example to explore blind analysis as a method to reduce researcher bias. Results: Our experience shows that blinding can be a relatively straightforward procedure. We also highlight various statistical analysis decisions which ought not be guided by the hunt for statistical significance and show that results can be inverted merely through a seemingly inconsequential statistical nicety (i.e., the degree of trimming). Conclusion: Whilst there are minor challenges and some limits to the degree of blinding possible, blind analysis is a very practical and easy to implement method that supports more objective analysis of experimental results. Therefore we argue that blind analysis should be the norm for analysing software engineering experiments.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130269831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

Problems and challenges of user involvement in software development: an empirical study 用户参与软件开发的问题与挑战:一项实证研究

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745810

D. Zowghi, F. Rimini, Muneera Bano

{"title":"Problems and challenges of user involvement in software development: an empirical study","authors":"D. Zowghi, F. Rimini, Muneera Bano","doi":"10.1145/2745802.2745810","DOIUrl":"https://doi.org/10.1145/2745802.2745810","url":null,"abstract":"Context: The benefits of involving users in software development projects have been studied extensively in the last four decades and have been reported to contribute to user satisfaction thus leading to system success. However, the relationship between user involvement and system success, being a multi-faceted and complex concept, has introduced many problems and challenges for the practitioners. Objective: In this paper we present our findings from a case study to give a deeper understanding of the challenges and problems of user involvement during software development. Method: The data in the case study was collected from interviews, observations and project documents. Results: We present our results in four main categories related to users, communicative aspects, managerial considerations, and project issues. It was observed that system success is achievable even when there are problems and challenges in involving users. Conclusion: Understanding the nature of the problems related to user involvement helps the project managers to develop appropriate strategies for increasing the effectiveness of user involvement.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122874201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 18

The impact of students' skills and experiences on empirical results: a controlled experiment with undergraduate and graduate students 学生技能和经验对实证结果的影响:以本科生和研究生为对象的对照实验

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745829

Marian Daun, Andrea Salmon, Thorsten Weyer, K. Pohl

{"title":"The impact of students' skills and experiences on empirical results: a controlled experiment with undergraduate and graduate students","authors":"Marian Daun, Andrea Salmon, Thorsten Weyer, K. Pohl","doi":"10.1145/2745802.2745829","DOIUrl":"https://doi.org/10.1145/2745802.2745829","url":null,"abstract":"In empirical software engineering research, graduate students are often seen as legitimate substitutes for industry professionals. It has been also argued in the literature that the generalizability of empirical results from experiments with undergraduate students as participants holds to a much lower extent. In this paper, we report on a controlled experiment conducted separately with graduate students and undergraduate students in order to gain deeper insights whether the results from experiments with graduates and undergraduates in the software engineering field are equal or significantly different with respect to the conclusions that can be drawn. During the experiment, the students apply a specific validation technique for behavioral requirements of embedded software. We observed that graduates were significantly more effective, efficient, and confident in their tasks than the undergraduates. Nevertheless, the experiment with undergraduates also shows significant results, even though with a smaller effect size.","PeriodicalId":324836,"journal":{"name":"Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering","volume":"38 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-04-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131486884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 24

Environment modeling in model-based testing: concepts, prospects and research challenges: a systematic literature review 基于模型的测试中的环境建模:概念、前景和研究挑战:系统的文献综述

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745830

Faezeh Siavashi, D. Truscan

引用次数: 14

Systematic review toolbox: a catalogue of tools to support systematic reviews 系统评审工具箱:支持系统评审的工具目录

Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering Pub Date : 2015-04-27 DOI: 10.1145/2745802.2745824

C. Marshall, P. Brereton

引用次数: 32