Visualizing Topics and Opinions Helps Students Interpret Large Collections of Peer Feedback for Creative Projects

IF 4.8 2区计算机科学 Q1 COMPUTER SCIENCE, CYBERNETICS

ACM Transactions on Computer-Human Interaction Pub Date : 2022-12-20 DOI:10.1145/3571817

P. Crain, Jaewook Lee, Yu-Chun Yen, Joy Kim, Alyssa Aiello, B. Bailey

{"title":"Visualizing Topics and Opinions Helps Students Interpret Large Collections of Peer Feedback for Creative Projects","authors":"P. Crain, Jaewook Lee, Yu-Chun Yen, Joy Kim, Alyssa Aiello, B. Bailey","doi":"10.1145/3571817","DOIUrl":null,"url":null,"abstract":"We deployed a feedback visualization tool to learn how students used the tool for interpreting feedback from peers and teaching assistants. The tool visualizes the topic and opinion structure in a collection of feedback and provides interaction for reviewing providers’ backgrounds. A total of 18 teams engaged with the tool to interpret feedback for course projects. We surveyed students (N = 69) to learn about their sensemaking goals, use of the tool to accomplish those goals, and perceptions of specific features. We interviewed students (N = 12) and TAs (N = 2) to assess the tool’s impact on students’ review processes and course instruction. Students discovered valuable feedback, assessed project quality, and justified design decisions to teammates by exploring specific icon patterns in the visualization. The interviews revealed that students mimicked strategies implemented in the tool when reviewing new feedback without the tool. Students found the benefits of the visualization outweighed the cost of labeling feedback.","PeriodicalId":50917,"journal":{"name":"ACM Transactions on Computer-Human Interaction","volume":"30 1","pages":"1 - 30"},"PeriodicalIF":4.8000,"publicationDate":"2022-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Computer-Human Interaction","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1145/3571817","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 0

Abstract

We deployed a feedback visualization tool to learn how students used the tool for interpreting feedback from peers and teaching assistants. The tool visualizes the topic and opinion structure in a collection of feedback and provides interaction for reviewing providers’ backgrounds. A total of 18 teams engaged with the tool to interpret feedback for course projects. We surveyed students (N = 69) to learn about their sensemaking goals, use of the tool to accomplish those goals, and perceptions of specific features. We interviewed students (N = 12) and TAs (N = 2) to assess the tool’s impact on students’ review processes and course instruction. Students discovered valuable feedback, assessed project quality, and justified design decisions to teammates by exploring specific icon patterns in the visualization. The interviews revealed that students mimicked strategies implemented in the tool when reviewing new feedback without the tool. Students found the benefits of the visualization outweighed the cost of labeling feedback.

查看原文本刊更多论文

可视化的主题和观点帮助学生解释大量的同伴反馈的创意项目

我们部署了一个反馈可视化工具，以了解学生如何使用该工具来解释来自同伴和助教的反馈。该工具在一组反馈中可视化主题和意见结构，并为审查提供者的背景提供交互。总共有18个团队使用该工具来解释课程项目的反馈。我们调查了学生(N = 69)，了解他们的语义目标，使用工具来实现这些目标，以及对特定特征的感知。我们采访了学生(N = 12)和助教(N = 2)，以评估该工具对学生复习过程和课程教学的影响。学生们发现了有价值的反馈，评估了项目质量，并通过探索可视化中的特定图标模式向队友证明了设计决策的合理性。访谈显示，学生在没有工具的情况下回顾新的反馈时，会模仿工具中实施的策略。学生们发现可视化的好处超过了标注反馈的成本。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

ACM Transactions on Computer-Human Interaction 工程技术-计算机：控制论

CiteScore

8.50

自引率

5.40%

发文量

审稿时长

>12 weeks

期刊介绍： This ACM Transaction seeks to be the premier archival journal in the multidisciplinary field of human-computer interaction. Since its first issue in March 1994, it has presented work of the highest scientific quality that contributes to the practice in the present and future. The primary emphasis is on results of broad application, but the journal considers original work focused on specific domains, on special requirements, on ethical issues -- the full range of design, development, and use of interactive systems.