2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry最新文献

Difficulty Factors of Obtaining Access for Empirical Studies in Industry 行业实证研究的准入困难因素

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.11

L. Prechelt, Franz Zieris, H. Schmeisky

{"title":"Difficulty Factors of Obtaining Access for Empirical Studies in Industry","authors":"L. Prechelt, Franz Zieris, H. Schmeisky","doi":"10.1109/CESI.2015.11","DOIUrl":"https://doi.org/10.1109/CESI.2015.11","url":null,"abstract":"Context: The difficulty (not just effort) of obtaining access for software engineering empirical studies in industry varies greatly. Supposedly, some of this variance in difficulty is particular, stemming from properties of individual contexts (the industrial partners and their work), while the rest is repeatable, related to properties of the research question and research design. Question: What are these recurring difficulty factors that arise from research question and research design? What mechanisms produce their influence? Method: We use ideation and knowledge extraction from research experience to identify potential difficulty factors, use expert discussion to understand their mechanisms, and use concept analysis to arrange them into a taxonomy. We evaluate the result by comparatively applying it to two research efforts pursued by the same research group. Results: We find six scope factors, five problematic intervention effects factors, and seven helpful intervention (side-)effects factors. Conclusion: Considering these factors systematically during the formulation of a research question and the design of a research method can help with balancing data collection difficulty with results validity and relevance.","PeriodicalId":222668,"journal":{"name":"2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry","volume":"11 6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114183271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

The Maturation of Empirical Studies 实证研究的成熟

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.7

H. D. Rombach, Andreas Jedlitschka

引用次数: 3

Planning for the Unknown: Lessons Learned from Ten Months of Non-participant Exploratory Observations in the Industry 未知的计划:从10个月的非参与性行业探索性观察中获得的经验教训

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.10

Mathieu Lavallée, P. Robillard

引用次数: 4

I'll Tell You What I Want, What I Really, Really Want: An Industry Perspective on the Effective Application of Research in Projects 我会告诉你我想要什么，我真的，真的想要什么:研究在项目中有效应用的行业视角

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.16

Alistair Mavin

引用次数: 5

A Holistic Overview of Software Engineering Research Strategies 软件工程研究策略的整体概述

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.15

Klaas-Jan Stol, Brian Fitzgerald

{"title":"A Holistic Overview of Software Engineering Research Strategies","authors":"Klaas-Jan Stol, Brian Fitzgerald","doi":"10.1109/CESI.2015.15","DOIUrl":"https://doi.org/10.1109/CESI.2015.15","url":null,"abstract":"Empirical research studies are the principal mechanism through which the software engineering research community studies and learns from software engineering practice. The focus on empirical studies has increased significantly in the past decade, more or less coinciding with the emergence of evidence-based software engineering, an idea that was proposed in 2004. As a consequence, the software engineering community is familiar with a range of empirical methods. However, while several overviews exist of popular empirical research methods, such as case studies and experiments, we lack a 'holistic' view of a more complete spectrum of research methods. Furthermore, while researchers will readily accept that all methods have inherent limitations, methods such as case study are still frequently critiqued for the lack of control that a researcher can exert in such a study, their use of qualitative data, and the limited generalizability that can be achieved. Controlled experiments are seen by many as yielding stronger evidence than case studies, but these can also be criticized due to the limited realism of the context in which they are conducted. We identify a holistic set of research methods and indicate their strengths and weaknesses in relation to various research elements.","PeriodicalId":222668,"journal":{"name":"2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125886156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 24

On the Alignment of Source Code Quality Perspectives through Experimentation: An Industrial Case 通过实验对源代码质量观点进行校准:一个工业案例

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.12

Talita Vieira Ribeiro, G. Travassos

{"title":"On the Alignment of Source Code Quality Perspectives through Experimentation: An Industrial Case","authors":"Talita Vieira Ribeiro, G. Travassos","doi":"10.1109/CESI.2015.12","DOIUrl":"https://doi.org/10.1109/CESI.2015.12","url":null,"abstract":"CONTEXT. Alignment is a key factor for success in many software development projects. Aligned teams are capable of bringing collaboration and positive results to companies; whereas misalignment among developers can make a conflicted environment and even lead the project to failure. OBJECTIVE. To assist developers in an embedded software development company in their conceptual alignment regarding source code quality. METHOD. In the organizational context, plan and perform a series of studies such as surveys, systematic literature review (SLR), qualitative data analysis and focus group to support the identification of conceptual misalignments among developers and establish common terminology and guidance concerning source code quality. RESULTS. The results from a survey conducted in one company showed a conceptual misalignment among developers regarding the source code quality that was triggering continuous rework during software evolution activities. Through an SLR and a qualitative analysis of code snippets, a set of evidence-based coding guidelines for readability and understandability of source code were formulated. These guidelines were evaluated and used as an instrument for aligning source code perspectives during a focus group, showing their feasibility and adequacy to the company's context. CONCLUSIONS. The use of all contextual information observed - e.g. teams' locations, software development context, and time constraints - along with the information gathered during the industry-academia collaboration was particularly important to help us appropriately chose research methods to be used, and formulate evidence-based coding guidelines that matched the company's needs and expectations. Further evaluations have to be carried out to ensure the quality impact of some guidelines proposed before using them all over the company.","PeriodicalId":222668,"journal":{"name":"2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133307845","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Difficulties in Running Experiments in the Software Industry: Experiences from the Trenches 在软件行业中运行实验的困难:来自第一线的经验

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.5555/2819303.2819307

S. Vegas, Óscar Dieste Tubío, Natalia Juristo Juzgado

{"title":"Difficulties in Running Experiments in the Software Industry: Experiences from the Trenches","authors":"S. Vegas, Óscar Dieste Tubío, Natalia Juristo Juzgado","doi":"10.5555/2819303.2819307","DOIUrl":"https://doi.org/10.5555/2819303.2819307","url":null,"abstract":"Controlled experiments in laboratory settings are relatively commonplace in software engineering, but experiments in industry are thin on the ground. Of the few existing cases, most are 1-1 (running one experiment at one company), just a few are n-1 (running n experiments at one company) and still fewer are 1-n (running one and the same experiment at n companies). In this paper we report the difficulties that we experienced running the same experiment at several companies. We ran the same experiment in five different settings at three companies, and the results were transferred to each company so that they could exploit the resulting evidence in their decision-making process. We have found that: 1) it was relatively easy to get companies involved; 2) they did not cooperate as much as they had agreed to in the project proposal; 3) our industrial environments imposed many more constraints on the experimental design than laboratory environments; 4) professionals were less motivated than students; 5) the reliability of the results could be compromised by subject characteristics and behaviour; and 6) experiment findings could not be transferred using just the standard reporting guidelines that are used for scientific articles.","PeriodicalId":222668,"journal":{"name":"2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121862832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 21

How to Increase the Likelihood of Successful Transfer to Industry -- Going Beyond the Empirical 如何提高产业转移成功的可能性——超越实证

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.9

T. Gorschek

引用次数: 4

Finding the Missing Link to Industry: LinkedIn Professional Groups as Facilitators of Empirical Research 寻找与行业缺失的联系:LinkedIn专业团体作为实证研究的推动者

2015 IEEE/ACM 3rd International Workshop on Conducting Empirical Studies in Industry Pub Date : 2015-05-16 DOI: 10.1109/CESI.2015.14

Naomi Unkelos-Shpigel, Sofia Sherman, I. Hadar

引用次数: 24