2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE)最新文献

On the Accuracy of Bot Detection Techniques 机器人检测技术的准确性研究

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-05-01 DOI: 10.1145/3528228.3528406

M. Golzadeh, Alexandre Decan, Natarajan Chidambaram

{"title":"On the Accuracy of Bot Detection Techniques","authors":"M. Golzadeh, Alexandre Decan, Natarajan Chidambaram","doi":"10.1145/3528228.3528406","DOIUrl":"https://doi.org/10.1145/3528228.3528406","url":null,"abstract":"Development bots are often used to automate a wide variety of repetitive tasks in collaborative software development. Such bots are commonly among the most active project contributors in terms of commit activity. As such, tools that analyse contributor activity (e.g., for recognizing and giving credit to project members for their contributions) need to take into account the bots and exclude their activity. While there are a few techniques to detect bots in software repositories, these techniques are not perfect and may miss some bots or may wrongly identify some human accounts as bots. In this paper, we present an exploratory study on the accuracy of bot detection techniques on a set of 540 accounts from 27 GitHub projects. We show that none of the bot detection techniques are accurate enough to detect bots among the 20 most active contributors of each project. We show that combining these techniques drastically increases the accuracy and recall of bot detection. We also highlight the importance of considering bots when attributing contributions to humans, since bots are prevalent among the top contributors and responsible for large proportions of commits.","PeriodicalId":431263,"journal":{"name":"2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128502154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 8

An Exploratory Study of Reactions to Bot Comments on GitHub 对GitHub上Bot评论反应的探索性研究

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-05-01 DOI: 10.1145/3528228.3528409

Juan Carlos Farah, Basile Spaenlehauer, Xinyang Lu, Sandy Ingram, D. Gillet

{"title":"An Exploratory Study of Reactions to Bot Comments on GitHub","authors":"Juan Carlos Farah, Basile Spaenlehauer, Xinyang Lu, Sandy Ingram, D. Gillet","doi":"10.1145/3528228.3528409","DOIUrl":"https://doi.org/10.1145/3528228.3528409","url":null,"abstract":"The widespread use of bots to support software development makes social coding platforms such as GitHub a particularly rich source of data for the study of human-bot interaction. Software development bots are used to automate repetitive tasks, interacting with their human counterparts via comments posted on the various discussion interfaces available on such platforms. One type of interaction supported by GitHub involves reacting to comments using predefined emoji. To investigate how users react to bot comments, we conducted an observational study comprising 54 million GitHub comments, with a particular focus on comments that elicited the laugh reaction. The results from our analysis suggest that some reaction types are not equally distributed across human and bot comments and that a bot's design and purpose influence the types of reactions it receives. Furthermore, while the laugh reaction is not exclusively used to express laughter, it can be used to convey humor when a bot behaves unexpectedly. These insights could inform the way bots are designed and help developers equip them with the ability to recognize and recover from unanticipated situations. In turn, bots could better support the communication, collaboration, and productivity of teams using social coding platforms.","PeriodicalId":431263,"journal":{"name":"2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128864031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

Classifying Issues into Custom Labels in GitBot 在GitBot中将问题分类为自定义标签

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-05-01 DOI: 10.1145/3528228.3528404

Doje Park, Heetae Cho, Seonah Lee

引用次数: 1

On the Adoption of a TODO Bot on GITHuB: A Preliminary Study 关于在GITHuB上采用TODO Bot:初步研究

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-05-01 DOI: 10.1145/3528228.3528408

Hamid Mohayeji, Felipe Ebert, Eric Arts, Eleni Constantinou, Alexander Serebrenik

{"title":"On the Adoption of a TODO Bot on GITHuB: A Preliminary Study","authors":"Hamid Mohayeji, Felipe Ebert, Eric Arts, Eleni Constantinou, Alexander Serebrenik","doi":"10.1145/3528228.3528408","DOIUrl":"https://doi.org/10.1145/3528228.3528408","url":null,"abstract":"Bots support different software maintenance and evolution activities, such as code review or executing tests. Recently, several bots have been proposed to help developers to keep track of postponed activities, expressed by means of TODO comments: e.g., TODO Bot automatically creates a GITHuB issue when a TODO comment is added to a repository, increasing visibility of TODO comments. In this work, we perform a preliminary evaluation of the impact of the TODO Bot on software development practice. We conjecture that the introduction of the TODO Bot would facilitate keeping track of the TODO comments, and hence encourage developers to use more TODO comments in their code changes. To evaluate this conjecture, we analyze all the 2,208 repositories which have at least one GITHuB issue created by the TODO Bot. Firstly, we investigate to what extent the bot is being used and describe the repositories using the bot. We observe that the majority (54%) of the repositories which adopted the TODO Bot are new, i.e., were created within less than one month of first issue created by the bot, and from those, more than 60% have the issue created within three days. We observe a statistically significant increase in the number of the TODO comments after the adoption of the bot, however with a small effect size. Our results suggest that the adoption of the TODO Bot encourages developers to introduce TODO comments rendering the postponed decisions more visible. Nevertheless, it does not speed up the process of addressing TODO comments or corresponding GITHuB issues.","PeriodicalId":431263,"journal":{"name":"2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120966203","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Survey of Automation Practices in Model-Driven Development and Operations 模型驱动开发和操作中的自动化实践综述

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-05-01 DOI: 10.1145/3528228.3528405

C. Ponsard, Valéry Ramon

引用次数: 1

Digital Mentor: towards a conversational bot to identify hypotheses for software startups 数字导师:为软件初创公司提供对话机器人识别假设

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-04-01 DOI: 10.1145/3528228.3528407

Jorge Melegati, Xiaofeng Wang

引用次数: 1

Leveraging Predictions From Multiple Repositories to Improve Bot Detection 利用来自多个存储库的预测来改进Bot检测

2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE) Pub Date : 2022-03-31 DOI: 10.1145/3528228.3528403

Natarajan Chidambaram, Alexandre Decan, M. Golzadeh

{"title":"Leveraging Predictions From Multiple Repositories to Improve Bot Detection","authors":"Natarajan Chidambaram, Alexandre Decan, M. Golzadeh","doi":"10.1145/3528228.3528403","DOIUrl":"https://doi.org/10.1145/3528228.3528403","url":null,"abstract":"Contemporary social coding platforms such as GitHub facilitate collaborative distributed software development. Developers engaged in these platforms often use machine accounts (bots) for automating effort-intensive or repetitive activities. Determining whether a contributor corresponds to a bot or a human account is important in socio-technical studies, for example to assess the positive and negative impact of using bots, analyse the evolution of bots and their usage, identify top human contributors, and so on. BoDeGHa is one of the bot detection tools that have been proposed in the literature. It relies on comment activity within a single repository to predict whether an account is driven by a bot or by a human. This paper presents preliminary results on how the effectiveness of BoDeGHa can be improved by combining the predictions obtained from many repositories at once. We found that doing this not only increases the number of cases for which a prediction can be made, but that many diverging predictions can be fixed this way. These promising, albeit preliminary, results suggest that the “wisdom of the crowd” principle can improve the effectiveness of bot detection tools.","PeriodicalId":431263,"journal":{"name":"2022 IEEE/ACM 4th International Workshop on Bots in Software Engineering (BotSE)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2022-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121473399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4