2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)最新文献

Agile Exponential Software Organizations 敏捷指数软件组织

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00027

Y. Dubinsky, O. Hazzan

引用次数: 2

Concolic Testing for High Test Coverage and Reduced Human Effort in Automotive Industry 在汽车工业中实现高测试覆盖率和减少人力

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00024

Yunho Kim, Dongju Lee, Junki Baek, Moonzoo Kim

引用次数: 11

OpenPnP: A Plug-and-Produce Architecture for the Industrial Internet of Things OpenPnP:即插即用的工业物联网架构

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00022

H. Koziolek, Andreas Burger, Marie Platenius-Mohr, Julius Rückert, G. Stomberg

{"title":"OpenPnP: A Plug-and-Produce Architecture for the Industrial Internet of Things","authors":"H. Koziolek, Andreas Burger, Marie Platenius-Mohr, Julius Rückert, G. Stomberg","doi":"10.1109/ICSE-SEIP.2019.00022","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00022","url":null,"abstract":"Industrial control systems are complex, software-intensive systems that manage mission-critical production processes. Commissioning such systems requires installing, configuring, and integrating thousands of sensors, actuators, and controllers and is still a largely manual and costly process. Therefore, practitioners and researchers have been working on \"plug and produce\" approaches that automate commissioning for more than 15 years, but have often focused on network discovery and proprietary technologies. We introduce the vendor-neutral OpenPnP reference architecture, which can largely automate the configuration and integration tasks for commissioning. Using an example implementation, we demonstrate that OpenPnP can reduce the configuration and integration effort up to 90 percent and scales up to tens of thousands of communicated signals per second for large Industrial Internet-of-Things (IIoT) systems. OpenPnP can serve as a template for practitioners implementing IIoT applications throughout the automation industry and streamline commissioning processes in many thousands of control system installations.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114287750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

Perception and Practices of Differential Testing 感知和实践的差异测试

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00016

Muhammad Ali Gulzar, Yongkang Zhu, Xiaofeng Han

{"title":"Perception and Practices of Differential Testing","authors":"Muhammad Ali Gulzar, Yongkang Zhu, Xiaofeng Han","doi":"10.1109/ICSE-SEIP.2019.00016","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00016","url":null,"abstract":"Tens of thousands engineers are contributing to Google's codebase that spans billions of lines of code. To ensure high code quality, tremendous amount of effort has been made with new testing techniques and frameworks. However, with increasingly complex data structures and software systems, traditional test case based testing strategies cannot scale well to achieve the desired level of test adequacy. Differential (Diff) is one of the new testing techniques adapted to fill this gap. It uses the same input to run two versions of a software system, namely base and test, where base is the verified/tested version of the system while test is the modified version. The output of two runs are then thoroughly compared to find abnormalities that may lead to possible bugs. Over the past few years, differential testing has been quickly adopted by hundreds of teams across all major product areas at Google. Meanwhile, many new differential testing frameworks were developed to simplify the creation, maintenance, and analysis of diff tests. Curious by this emerging popularity, we conducted the first empirical study on differential testing in practice at large scale. In this study, we investigated common practices and usage of diff tests. We further explore the features of diff tests that users value the most and the pain points of using diff tests. Through this user study, we discovered that differential testing does not replace fine-grained testing techniques such as unit tests. Instead it supplements existing testing suites. It helps users verify the impact on unmodified and unfamiliar components in the absence of a test oracle. In terms of limitations, diff tests often take long time to run and appear to generate noisy and flaky outcomes. Finally, we highlight problems (including smart data differencing, sampling, and traceability) to guide future research in differential testing.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"99 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115811860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 21

Experimentation in the Operating System: The Windows Experimentation Platform 操作系统的实验:Windows实验平台

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00011

P. Li, Pavel A. Dmitriev, Huibin Mary Hu, Xiaoyu Chai, Z. Dimov, Brandon Paddock, Ying Li, Alex Kirshenbaum, Irina Niculescu, T. Thoresen

{"title":"Experimentation in the Operating System: The Windows Experimentation Platform","authors":"P. Li, Pavel A. Dmitriev, Huibin Mary Hu, Xiaoyu Chai, Z. Dimov, Brandon Paddock, Ying Li, Alex Kirshenbaum, Irina Niculescu, T. Thoresen","doi":"10.1109/ICSE-SEIP.2019.00011","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00011","url":null,"abstract":"Online controlled experiments are the gold standard for evaluating improvements and accelerating innovations in online and app worlds. However, little is known about applicability, implementation, and efficacy of experimentation for operating systems (OS), where many features are non-user-facing. In this paper, we present the Windows Experimentation platform (WExp), and insights from implementation and execution of real-world experiments in the OS. We start by discussing the need for experimentation in OS, using real experiments to illustrate the benefits. We then describe the architecture of WExp, focusing on unique considerations in its engineering. Finally, we discuss learnings and challenges from conducting real-world experiments. Our experiences and insights can motivate practitioners to start experimenting as well as to help them to successfully build their experimentation platforms. The learnings can also guide experimenters with best-practices and highlight promising avenues for future research.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128392308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 12

Data-Driven Requirements Engineering - An Update 数据驱动需求工程——更新

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00041

W. Maalej, Maleknaz Nayebi, G. Ruhe

引用次数: 20

Big Bangs and Small Pops: On Critical Cyclomatic Complexity and Developer Integration Behavior 大爆炸和小爆炸:关于关键圈复杂度和开发者集成行为

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00017

Daniel Ståhl, A. Martini, Torvald Mårtensson

{"title":"Big Bangs and Small Pops: On Critical Cyclomatic Complexity and Developer Integration Behavior","authors":"Daniel Ståhl, A. Martini, Torvald Mårtensson","doi":"10.1109/ICSE-SEIP.2019.00017","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00017","url":null,"abstract":"Continuous integration is believed by many to improve software quality, including cyclomatic complexity. In this paper an exploratory study investigates the relationship between continuous integration behavior among developers and the cyclomatic complexity - particularly at critical levels - of the source code they commit, as a correct understanding of the consequences of a software development practice, particularly one as popular as continuous integration, is of crucial importance to industry professionals when deciding on improvement efforts. It is found that developer behavior differs significantly, as does their knowledge and awareness of cyclomatic complexity as a concept. We find that even though large commits (\"big bangs\") contribute proportionately slightly more to cyclomatic complexity, the effect is much less pronounced for critical cyclomatic complexity. It is also found that complex code tends to overlap with high levels of change activity, and that some developers deliberately change their integration behavior in the face of such hotspots, as a strategy to avoid merge conflicts.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129360507","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Improving Test Effectiveness Using Test Executions History: An Industrial Experience Report 使用测试执行历史提高测试效率:一份工业经验报告

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00031

Armin Najafi, Weiyi Shang, Peter C. Rigby

{"title":"Improving Test Effectiveness Using Test Executions History: An Industrial Experience Report","authors":"Armin Najafi, Weiyi Shang, Peter C. Rigby","doi":"10.1109/ICSE-SEIP.2019.00031","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00031","url":null,"abstract":"The cost of software testing has become a burden for software companies in the era of rapid release and continuous integration. Our industrial collaborator Ericsson also faces the challenges of expensive testing processes which are typically part of a complex and specialized testing environment. In order to assist Ericsson with improving the test effectiveness of one of its large subsystems, we adopt test selection and prioritization approaches based on test execution history from prior research. By adopting and simulating those approaches on six months of testing data from our subject system, we confirm the existence of valuable information in the test execution history. In particular, the association between test failures provide the most value to the test selection and prioritization processes. More importantly, during this exercise, we encountered various challenges that are unseen or undiscussed in prior research. We document the challenges, our solutions and the lessons learned as an experience report. Our experiences can be valuable for other software testing practitioners and researchers who would like to adopt existing test effectiveness improvement approaches into their work environment.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"77 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114843282","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 17

Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale 大规模在线控制实验可信分析的三个关键清单和补救措施

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00009

Aleksander Fabijan, Pavel A. Dmitriev, H. H. Olsson, J. Bosch, Lukas Vermeer, Dylan Lewis

{"title":"Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale","authors":"Aleksander Fabijan, Pavel A. Dmitriev, H. H. Olsson, J. Bosch, Lukas Vermeer, Dylan Lewis","doi":"10.1109/ICSE-SEIP.2019.00009","DOIUrl":"https://doi.org/10.1109/ICSE-SEIP.2019.00009","url":null,"abstract":"Online Controlled Experiments (OCEs) are transforming the decision-making process of data-driven companies into an experimental laboratory. Despite their great power in identifying what customers actually value, experimentation is very sensitive to data loss, skipped checks, wrong designs, and many other 'hiccups' in the analysis process. For this purpose, experiment analysis has traditionally been done by experienced data analysts and scientists that closely monitored experiments throughout their lifecycle. Depending solely on scarce experts, however, is neither scalable nor bulletproof. To democratize experimentation, analysis should be streamlined and meticulously performed by engineers, managers, or others responsible for the development of a product. In this paper, based on synthesized experience of companies that run thousands of OCEs per year, we examined how experts inspect online experiments. We reveal that most of the experiment analysis happens before OCEs are even started, and we summarize the key analysis steps in three checklists. The value of the checklists is threefold. First, they can increase the accuracy of experiment set-up and decision-making process. Second, checklists can enable novice data scientists and software engineers to become more autonomous in setting-up and analyzing experiments. Finally, they can serve as a base to develop trustworthy platforms and tools for OCE set-up and analysis.","PeriodicalId":378237,"journal":{"name":"2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131306358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 15

Practical Android Test Recording with Espresso Test Recorder 实用的安卓测试记录与浓缩咖啡测试记录器

2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) Pub Date : 2019-05-27 DOI: 10.1109/ICSE-SEIP.2019.00029

Stas Negara, N. Esfahani, Raymond P. L. Buse

引用次数: 15