2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering最新文献

Crowdsourcing Code and Process via Code Hunt 通过代码搜索众包代码和流程

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.10

Tao Xie, J. Bishop, R. Horspool, N. Tillmann, J. D. Halleux

引用次数: 8

Integrating Crowd Intelligence into Software 将群体智能集成到软件中

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.8

Rick Salay, F. Dalpiaz, M. Chechik

引用次数: 5

A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design 界面设计中的微任务众包工作流简论

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.16

Mengyao Zhao, A. Hoek

引用次数: 12

Dynamic Simulation of Software Workers and Task Completion 软件工作者动态仿真与任务完成

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.11

R. Saremi, Ye Yang

引用次数: 21

Exploring the Benefits of Using Redundant Responses in Crowdsourced Evaluations 探索在众包评估中使用冗余回应的好处

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.15

Kathryn T. Stolee, J. Saylor, Trevor Lund

{"title":"Exploring the Benefits of Using Redundant Responses in Crowdsourced Evaluations","authors":"Kathryn T. Stolee, J. Saylor, Trevor Lund","doi":"10.1109/CSI-SE.2015.15","DOIUrl":"https://doi.org/10.1109/CSI-SE.2015.15","url":null,"abstract":"Crowd sourcing can be an efficient and cost-effective way to evaluate software engineering research, particularly when the evaluation can be broken down into small, independent tasks. In prior work, we crowd sourced evaluations for a refactoring technique for web mashups and for a source code search engine, both using Amazon's Mechanical Turk. In the refactoring study, preference information was gathered when comparing a refactored with an unrefactored pipe, in addition to a free-text justification. In the code search study, information was gathered about whether a code snippet was relevant to a programming task and why. In both studies, we used redundant metrics and gathered quantitative and qualitative data in an effort to control response quality. Our prior work only analyzed the quantitative results. In this work, we explore the value of using such redundant metrics in crowd sourced evaluations. We code the free-text responses to unveil common themes among the responses and then compare those themes with the quantitative results. Our findings indicate high similarity between the quantitative and free-text responses, that the quantitative results are sometimes more positive than the free-text response, and that some of the qualitative responses point to potential inadequacies with the quantitative questions from the studies.","PeriodicalId":438005,"journal":{"name":"2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134510164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5

Crowd Intent: Annotation of Intentions Hidden in Online Discussions 群体意图:隐藏在网络讨论中的意图注释

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.12

Itzel Morales-Ramirez, Dimitra Papadimitriou, A. Perini

{"title":"Crowd Intent: Annotation of Intentions Hidden in Online Discussions","authors":"Itzel Morales-Ramirez, Dimitra Papadimitriou, A. Perini","doi":"10.1109/CSI-SE.2015.12","DOIUrl":"https://doi.org/10.1109/CSI-SE.2015.12","url":null,"abstract":"Stakeholders working in open-source software development use social media, emails or any available means in the Internet to communicate and express what they want or need through the use of text. The recognition of such needs or desires (that we call intentions) is usually done by a human reader, and it can require a considerable effort when the amount of messages in online discussions increases. The problem is that to support an automated recognition of the intentions hidden in the text, data are needed in the domain of software development for training classifiers. However, so far there is no data annotated with intentions that can be used for data mining purposes. In order to tackle the lack of data we have collected online discussions in the domain of software development and asked people to annotate such discussions with intentions. This collection has been performed by crowd sourcing the task of annotating sentences with their hidden intention. In this paper we report the experience of carrying out a crowd sourcing project with a heterogeneous crowd. We discuss how we applied the steps of the crowd sourcing workflow in Crowd Intent. Lessons learned and future work are also presented.","PeriodicalId":438005,"journal":{"name":"2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering","volume":"119 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132986424","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

Making Hard Fun in Crowdsourced Model Checking -- Balancing Crowd Engagement and Efficiency to Maximize Output in Proof by Games 在众包模型检查中创造困难的乐趣——平衡群体参与和效率以最大化游戏证明的产出

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.13

Kerry Moffitt, J. Ostwald, Ronald J. Watro, Eric Church

引用次数: 7

Crowd and Laboratory Testing, Can They Co-exist? An Exploratory Study 人群和实验室测试，它们能共存吗?一项探索性研究

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-16 DOI: 10.1109/CSI-SE.2015.14

Fabio Guaiani, H. Muccini

引用次数: 18

Crowd Build: A Methodology for Enterprise Software Development Using Crowdsourcing 群体构建:一种使用众包的企业软件开发方法

2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering Pub Date : 2015-05-01 DOI: 10.1109/CSI-SE.2015.9

Anurag Dwarakanath, Upendra Chintala, Shrikanth N. C., G. Virdi, A. Kass, Anitha Chandran, Shubhashis Sengupta, Sanjoy Paul

引用次数: 34