比较ChatGPT反馈和同伴反馈对学生统计分析评价判断的影响:一个案例研究。

IF 2.5 3区 心理学 Q2 PSYCHOLOGY, MULTIDISCIPLINARY
Xiao Xie, Lawrence Jun Zhang, Aaron J Wilson
{"title":"比较ChatGPT反馈和同伴反馈对学生统计分析评价判断的影响:一个案例研究。","authors":"Xiao Xie, Lawrence Jun Zhang, Aaron J Wilson","doi":"10.3390/bs15070884","DOIUrl":null,"url":null,"abstract":"<p><p>Higher Degree by Research (HDR) students in language and education disciplines, particularly those enrolled in thesis-only programmes, are increasingly expected to interpret complex statistical data. However, many lack the analytical skills required for independent statistical analysis, posing challenges to their research competence. This study investigated the pedagogical potential of ChatGPT-4o feedback and peer feedback in supporting students' evaluative judgement during a 14-week doctoral-level statistical analysis course at a research-intensive university. Thirty-two doctoral students were assigned to receive either ChatGPT feedback or peer feedback on a mid-term assignment. They were then required to complete written reflections. Follow-up interviews with six selected participants revealed that each feedback modality influenced their evaluative judgement differently across three dimensions: hard (accuracy-based), soft (value-based), and dynamic (process-based). While ChatGPT provided timely and detailed guidance, it offered limited support for students' confidence in verifying accuracy. Peer feedback promoted critical reflection and collaboration but varied in quality. We therefore argue that strategically combining ChatGPT feedback and peer feedback may better support novice researchers in developing statistical competence in hybrid human-AI learning environments.</p>","PeriodicalId":8742,"journal":{"name":"Behavioral Sciences","volume":"15 7","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2025-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comparing ChatGPT Feedback and Peer Feedback in Shaping Students' Evaluative Judgement of Statistical Analysis: A Case Study.\",\"authors\":\"Xiao Xie, Lawrence Jun Zhang, Aaron J Wilson\",\"doi\":\"10.3390/bs15070884\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Higher Degree by Research (HDR) students in language and education disciplines, particularly those enrolled in thesis-only programmes, are increasingly expected to interpret complex statistical data. However, many lack the analytical skills required for independent statistical analysis, posing challenges to their research competence. This study investigated the pedagogical potential of ChatGPT-4o feedback and peer feedback in supporting students' evaluative judgement during a 14-week doctoral-level statistical analysis course at a research-intensive university. Thirty-two doctoral students were assigned to receive either ChatGPT feedback or peer feedback on a mid-term assignment. They were then required to complete written reflections. Follow-up interviews with six selected participants revealed that each feedback modality influenced their evaluative judgement differently across three dimensions: hard (accuracy-based), soft (value-based), and dynamic (process-based). While ChatGPT provided timely and detailed guidance, it offered limited support for students' confidence in verifying accuracy. Peer feedback promoted critical reflection and collaboration but varied in quality. We therefore argue that strategically combining ChatGPT feedback and peer feedback may better support novice researchers in developing statistical competence in hybrid human-AI learning environments.</p>\",\"PeriodicalId\":8742,\"journal\":{\"name\":\"Behavioral Sciences\",\"volume\":\"15 7\",\"pages\":\"\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2025-06-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Behavioral Sciences\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.3390/bs15070884\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Behavioral Sciences","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.3390/bs15070884","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

语言和教育学科的高级研究学位(HDR)学生,特别是那些只参加论文课程的学生,越来越多地被期望解释复杂的统计数据。然而,许多人缺乏独立统计分析所需的分析技能,这对他们的研究能力构成了挑战。本研究调查了chatgpt - 40反馈和同伴反馈在一所研究型大学为期14周的博士级统计分析课程中支持学生评估性判断的教学潜力。32名博士生被分配接受ChatGPT反馈或同行对期中作业的反馈。然后要求他们完成书面反思。对六名选定的参与者的后续访谈显示,每种反馈方式在三个维度上对他们的评估判断产生了不同的影响:硬(基于准确性)、软(基于价值)和动态(基于过程)。虽然ChatGPT提供了及时和详细的指导,但它对学生验证准确性的信心提供了有限的支持。同行反馈促进了批判性反思和合作,但质量参差不齐。因此,我们认为策略性地结合ChatGPT反馈和同伴反馈可以更好地支持新手研究人员在混合人类-人工智能学习环境中发展统计能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Comparing ChatGPT Feedback and Peer Feedback in Shaping Students' Evaluative Judgement of Statistical Analysis: A Case Study.

Higher Degree by Research (HDR) students in language and education disciplines, particularly those enrolled in thesis-only programmes, are increasingly expected to interpret complex statistical data. However, many lack the analytical skills required for independent statistical analysis, posing challenges to their research competence. This study investigated the pedagogical potential of ChatGPT-4o feedback and peer feedback in supporting students' evaluative judgement during a 14-week doctoral-level statistical analysis course at a research-intensive university. Thirty-two doctoral students were assigned to receive either ChatGPT feedback or peer feedback on a mid-term assignment. They were then required to complete written reflections. Follow-up interviews with six selected participants revealed that each feedback modality influenced their evaluative judgement differently across three dimensions: hard (accuracy-based), soft (value-based), and dynamic (process-based). While ChatGPT provided timely and detailed guidance, it offered limited support for students' confidence in verifying accuracy. Peer feedback promoted critical reflection and collaboration but varied in quality. We therefore argue that strategically combining ChatGPT feedback and peer feedback may better support novice researchers in developing statistical competence in hybrid human-AI learning environments.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Behavioral Sciences
Behavioral Sciences Social Sciences-Development
CiteScore
2.60
自引率
7.70%
发文量
429
审稿时长
11 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信