The Daily Smirk: A Preliminary Prototype for Continuous Peer Assessment of Team-based Projects

Yu Lu, André van der Hoek
{"title":"The Daily Smirk: A Preliminary Prototype for Continuous Peer Assessment of Team-based Projects","authors":"Yu Lu, André van der Hoek","doi":"10.1109/CSEET58097.2023.00014","DOIUrl":null,"url":null,"abstract":"Team-based projects are common in many software engineering classes, but come with a host of well-known problems such as social loafing, free-riding, and undesirable team dynamics. To counter these issues, many instructors use peer assessment. Unfortunately, current peer assessment approaches exhibit several limitations, including a typically time-consuming evaluation process, feedback being too infrequent or too late to make a difference for the project, and student ratings being unreliable. In this paper, we introduce the Daily Smirk, a preliminary prototype of a new peer assessment tool that is based on three primary design decisions: (1) peer assessment is continuous throughout the project, (2) assessment is through a lightweight smiley-based rating system, and (3) assessment is normalized around a neutral state so that additional feedback is only needed for outlier ratings. We elaborate on the design of the Daily Smirk and its primary functionality, and report on a preliminary evaluation in a software design course with three team-based projects.","PeriodicalId":256885,"journal":{"name":"2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 35th International Conference on Software Engineering Education and Training (CSEE&T)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CSEET58097.2023.00014","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Team-based projects are common in many software engineering classes, but come with a host of well-known problems such as social loafing, free-riding, and undesirable team dynamics. To counter these issues, many instructors use peer assessment. Unfortunately, current peer assessment approaches exhibit several limitations, including a typically time-consuming evaluation process, feedback being too infrequent or too late to make a difference for the project, and student ratings being unreliable. In this paper, we introduce the Daily Smirk, a preliminary prototype of a new peer assessment tool that is based on three primary design decisions: (1) peer assessment is continuous throughout the project, (2) assessment is through a lightweight smiley-based rating system, and (3) assessment is normalized around a neutral state so that additional feedback is only needed for outlier ratings. We elaborate on the design of the Daily Smirk and its primary functionality, and report on a preliminary evaluation in a software design course with three team-based projects.
每日傻笑:团队项目持续同行评估的初步原型
基于团队的项目在许多软件工程课程中都很常见,但是伴随着许多众所周知的问题,例如社会懒惰、搭便车和不受欢迎的团队动态。为了解决这些问题,许多教师采用同伴评估。不幸的是,当前的同行评估方法显示出一些局限性,包括典型的耗时的评估过程,反馈太少或太迟而无法对项目产生影响,以及学生评分不可靠。在本文中,我们介绍了Daily Smirk,这是一个基于三个主要设计决策的新同行评估工具的初步原型:(1)同行评估在整个项目中是连续的,(2)评估是通过一个轻量级的基于微笑的评级系统进行的,(3)评估是围绕中性状态规范化的,因此只需要对异常值评级进行额外的反馈。我们详细阐述了Daily Smirk的设计及其主要功能,并在软件设计课程中报告了三个基于团队的项目的初步评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信