Toward actionable, broadly accessible contests in Software Engineering

J. Cleland-Huang, Yonghee Shin, E. Keenan, Adam Czauderna, Greg Leach, Evan Moritz, Malcom Gethers, D. Poshyvanyk, J. Hayes, Wenbin Li
{"title":"Toward actionable, broadly accessible contests in Software Engineering","authors":"J. Cleland-Huang, Yonghee Shin, E. Keenan, Adam Czauderna, Greg Leach, Evan Moritz, Malcom Gethers, D. Poshyvanyk, J. Hayes, Wenbin Li","doi":"10.1109/ICSE.2012.6227087","DOIUrl":null,"url":null,"abstract":"Software Engineering challenges and contests are becoming increasingly popular for focusing researchers' efforts on particular problems. Such contests tend to follow either an exploratory model, in which the contest holders provide data and ask the contestants to discover “interesting things” they can do with it, or task-oriented contests in which contestants must perform a specific task on a provided dataset. Only occasionally do contests provide more rigorous evaluation mechanisms that precisely specify the task to be performed and the metrics that will be used to evaluate the results. In this paper, we propose actionable and crowd-sourced contests: actionable because the contest describes a precise task, datasets, and evaluation metrics, and also provides a downloadable operating environment for the contest; and crowd-sourced because providing these features creates accessibility to Information Technology hobbyists and students who are attracted by the challenge. Our proposed approach is illustrated using research challenges from the software traceability area as well as an experimental workbench named TraceLab.","PeriodicalId":420187,"journal":{"name":"2012 34th International Conference on Software Engineering (ICSE)","volume":"07 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"14","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 34th International Conference on Software Engineering (ICSE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSE.2012.6227087","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 14

Abstract

Software Engineering challenges and contests are becoming increasingly popular for focusing researchers' efforts on particular problems. Such contests tend to follow either an exploratory model, in which the contest holders provide data and ask the contestants to discover “interesting things” they can do with it, or task-oriented contests in which contestants must perform a specific task on a provided dataset. Only occasionally do contests provide more rigorous evaluation mechanisms that precisely specify the task to be performed and the metrics that will be used to evaluate the results. In this paper, we propose actionable and crowd-sourced contests: actionable because the contest describes a precise task, datasets, and evaluation metrics, and also provides a downloadable operating environment for the contest; and crowd-sourced because providing these features creates accessibility to Information Technology hobbyists and students who are attracted by the challenge. Our proposed approach is illustrated using research challenges from the software traceability area as well as an experimental workbench named TraceLab.
在软件工程领域开展可操作、可广泛参与的竞赛
软件工程挑战赛和竞赛越来越受研究人员的青睐,因为它们可以将研究人员的精力集中在特定问题上。这类竞赛往往采用探索模式,即竞赛主办方提供数据,要求参赛者发现他们能用这些数据做的 "有趣的事情";或者采用任务导向型竞赛,即参赛者必须在提供的数据集上执行特定任务。只有在偶尔的情况下,竞赛才会提供更严格的评估机制,精确规定要执行的任务和用于评估结果的指标。在本文中,我们提出了可操作竞赛和众包竞赛:可操作竞赛是因为竞赛描述了精确的任务、数据集和评估指标,还为竞赛提供了可下载的操作环境;众包竞赛是因为提供这些功能为信息技术爱好者和学生创造了无障碍环境,他们会被竞赛所吸引。我们提出的方法通过软件可追溯性领域的研究挑战以及名为 TraceLab 的实验工作台来说明。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信