Technology-enhanced self and peer assessment to support student agency during group projects

Marion Blumenstein, Asma Shakil, Peter Swedlund
{"title":"Technology-enhanced self and peer assessment to support student agency during group projects","authors":"Marion Blumenstein, Asma Shakil, Peter Swedlund","doi":"10.14742/apubs.2023.509","DOIUrl":null,"url":null,"abstract":"Teamwork and collaborative problem solving competencies are important 21st century skills and considered key graduate attributes for employability and lifelong learning (e.g., Csapó & Funke, 2017). For students to develop collaborative skills and competencies, group work and peer learning are widely-used approaches in higher education.  Effective teamwork skills are often implicitly taught and notoriously disliked by students for many reasons including freeriding (social loafing), member dominance or disengagement. Well-functioning teams are underpinned by social-affective dimensions of group work such as respect for reviewers (Carless & Boud, 2018) and social cohesion (Bakhtiar et al., 2018). To positively influence group cohesion and develop team skills, formative peer evaluation of team members’ contributions have been shown to effectively support student agency in this process (Stenalt 2021, Sridharan et al., 2018).   This case study explores the affordances of the digital peer review tools Feedback Fruits and Peer Assess Pro to facilitate feedback processes for the successful completion of high-stakes capstone group projects. Bachelor of Science students engage with anonymous team member evaluations of task completion as well as self-evaluation of team skills. To aid a major curriculum transformation at our university towards relational pedagogies, we embarked on an iterative and deliberate approach to scaling peer feedback. The approach aligns with educational design research integrating research and design processes for theoretical and practical outcomes (McKenney & Reeves, 2012, p. 76). Specifically, we aimed to understand 1) the student perception of technology facilitated peer feedback as learning for improved outcomes and raised self-awareness of teamwork skills, and 2) provide a non-threatening environment that enabled personal and collective agency for students as providers and receivers of feedback underpinned by Bandura’s (2001) social cognitive theory and human agency. Applying Bandura’s notion to group work, student agency can be enacted through a learner’s capacity to self-reflect on own capabilities (personal agency) as well as socially coordinated and interdependent efforts towards desired outcomes (collective agency).   Questionnaire data on self-regulation (N=42) confirmed the usefulness of peer evaluation of team members’ contributions. However, only half of the students thought that peer feedback positively impacted group coherence and effectiveness such as time management, quality of submissions, or their own performance. Feedback and self-reflections on students’ own strengths and weaknesses were found to be empowering and generally supported team effectiveness. This was also evident from students’ comments (N=110) within the Feedback Fruits tool where students rated their self- and peer efficacy on six criteria: initiative, engagement, contribution, ideas and communication, focus, and harmony. We identified issues with timeliness and active engagement of the feedback received requiring further iterations of purposefully designed rubrics for intended learning outcomes. The impact of peer feedback on perceived self- and collective efficacy is highly complex and influenced by personal as well as sociocultural values (Bandura, 2001, p. 14). Our emphasis on feedback as a learning-centred process under controlled conditions (technology enhanced with clear rubrics) has shown that students can make the information work for themselves and their teams to improve high-stakes group project outcomes. Importantly, in agreement with Molloy et al. (2019), the development of feedback literacy helps to build academic skills, supports self-regulation and acknowledges feedback as a reciprocal process for future employability.","PeriodicalId":236417,"journal":{"name":"ASCILITE Publications","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ASCILITE Publications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.14742/apubs.2023.509","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Teamwork and collaborative problem solving competencies are important 21st century skills and considered key graduate attributes for employability and lifelong learning (e.g., Csapó & Funke, 2017). For students to develop collaborative skills and competencies, group work and peer learning are widely-used approaches in higher education.  Effective teamwork skills are often implicitly taught and notoriously disliked by students for many reasons including freeriding (social loafing), member dominance or disengagement. Well-functioning teams are underpinned by social-affective dimensions of group work such as respect for reviewers (Carless & Boud, 2018) and social cohesion (Bakhtiar et al., 2018). To positively influence group cohesion and develop team skills, formative peer evaluation of team members’ contributions have been shown to effectively support student agency in this process (Stenalt 2021, Sridharan et al., 2018).   This case study explores the affordances of the digital peer review tools Feedback Fruits and Peer Assess Pro to facilitate feedback processes for the successful completion of high-stakes capstone group projects. Bachelor of Science students engage with anonymous team member evaluations of task completion as well as self-evaluation of team skills. To aid a major curriculum transformation at our university towards relational pedagogies, we embarked on an iterative and deliberate approach to scaling peer feedback. The approach aligns with educational design research integrating research and design processes for theoretical and practical outcomes (McKenney & Reeves, 2012, p. 76). Specifically, we aimed to understand 1) the student perception of technology facilitated peer feedback as learning for improved outcomes and raised self-awareness of teamwork skills, and 2) provide a non-threatening environment that enabled personal and collective agency for students as providers and receivers of feedback underpinned by Bandura’s (2001) social cognitive theory and human agency. Applying Bandura’s notion to group work, student agency can be enacted through a learner’s capacity to self-reflect on own capabilities (personal agency) as well as socially coordinated and interdependent efforts towards desired outcomes (collective agency).   Questionnaire data on self-regulation (N=42) confirmed the usefulness of peer evaluation of team members’ contributions. However, only half of the students thought that peer feedback positively impacted group coherence and effectiveness such as time management, quality of submissions, or their own performance. Feedback and self-reflections on students’ own strengths and weaknesses were found to be empowering and generally supported team effectiveness. This was also evident from students’ comments (N=110) within the Feedback Fruits tool where students rated their self- and peer efficacy on six criteria: initiative, engagement, contribution, ideas and communication, focus, and harmony. We identified issues with timeliness and active engagement of the feedback received requiring further iterations of purposefully designed rubrics for intended learning outcomes. The impact of peer feedback on perceived self- and collective efficacy is highly complex and influenced by personal as well as sociocultural values (Bandura, 2001, p. 14). Our emphasis on feedback as a learning-centred process under controlled conditions (technology enhanced with clear rubrics) has shown that students can make the information work for themselves and their teams to improve high-stakes group project outcomes. Importantly, in agreement with Molloy et al. (2019), the development of feedback literacy helps to build academic skills, supports self-regulation and acknowledges feedback as a reciprocal process for future employability.
通过技术强化的自我和同伴评估,支持学生在小组项目中发挥能动作用
团队合作和协作解决问题的能力是 21 世纪的重要技能,被认为是毕业生就业能力和终身学习的关键属性(例如,Csapó & Funke, 2017)。为了培养学生的协作技能和能力,小组合作和同伴学习是高等教育中广泛使用的方法。 有效的团队合作技能往往是潜移默化的,也是学生不喜欢的,原因有很多,包括自由散漫(社交闲逛)、成员主导地位或脱离。运作良好的团队是由小组工作的社会情感维度支撑的,如尊重审查者(Carless & Boud, 2018)和社会凝聚力(Bakhtiar et al.)为了积极影响小组凝聚力和发展团队技能,对小组成员贡献的形成性同伴评价已被证明能在这一过程中有效支持学生代理(Stenalt 2021, Sridharan et al.) 本案例研究探讨了数字同行评议工具 Feedback Fruits 和 Peer Assess Pro 在促进成功完成高风险毕业设计小组项目的反馈过程中的功能。理科学士学生参与团队成员对任务完成情况的匿名评价以及对团队技能的自我评价。为了帮助本校进行重大课程改革,实现关系教学法,我们采用了一种迭代和深思熟虑的方法来扩大同伴反馈的规模。该方法与教育设计研究相一致,整合了研究和设计过程,以取得理论和实践成果(McKenney & Reeves, 2012, p.76)。具体来说,我们的目标是了解:1)学生对技术促进的同伴反馈的感知,将其视为提高学习成绩和团队合作技能的自我意识的学习方式;2)根据班杜拉(2001 年)的社会认知理论和人的能动性,提供一个无威胁的环境,使学生作为反馈的提供者和接收者,能够发挥个人和集体能动性。将班杜拉的概念应用到小组合作中,学生的能动性可以通过学习者对自身能力的自我反思(个人能动性)以及为实现预期结果而进行的社会协调和相互依赖的努力(集体能动性)来实现。 关于自我调节的问卷数据(N=42)证实了同伴评价对团队成员贡献的作用。然而,只有一半的学生认为同伴反馈对小组的一致性和有效性(如时间管理、提交材料的质量或自身表现)产生了积极影响。对学生自身优缺点的反馈和自我反思被认为是一种赋权,总体上有助于提高团队效率。这一点从学生在 "反馈果实 "工具中的评论(N=110)中也可以看出,学生根据以下六项标准对自我和同伴的效率进行了评分:主动性、参与度、贡献、想法和沟通、专注度以及和谐度。我们发现了所收到的反馈在及时性和积极参与性方面存在的问题,这需要进一步迭代有目的设计的评分标准,以达到预期的学习效果。同伴反馈对自我和集体效能感的影响非常复杂,受到个人和社会文化价值观的影响(Bandura, 2001, 第 14 页)。我们强调反馈是在可控条件下以学习为中心的过程(通过明确的评分标准进行技术强化),这表明学生可以让信息为他们自己和他们的团队服务,以改善高风险的小组项目成果。重要的是,与莫罗伊等人(2019)的观点一致,培养反馈素养有助于培养学术技能,支持自我调节,并承认反馈是未来就业能力的一个互惠过程。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信