{"title":"通过多模态学习分析解读求助过程:ChatGPT 与人类专家的比较研究","authors":"Angxuan Chen , Mengtong Xiang , Junyi Zhou , Jiyou Jia , Junjie Shang , Xinyu Li , Dragan Gašević , Yizhou Fan","doi":"10.1016/j.compedu.2024.105198","DOIUrl":null,"url":null,"abstract":"<div><div>Help-seeking is an active learning strategy tied to self-regulated learning (SRL), where learners seek assistance when facing challenges. They may seek help from teachers, peers, intelligent tu-tor systems, and more recently, generative artificial intelligence (AI). However, there is limited empirical research on how learners’ help-seeking process differs between generative AI and hu-man experts. To address this, we conducted a lab experiment with 38 university students tasked with essay writing and revising. The students were randomly divided into two groups: one seeking help from ChatGPT (AI Group) and the other from an experienced teacher (HE Group). To examine their help-seeking processes, we used a combination of statistical testing and process mining methods, analyzing multimodal data (e.g., trace data, eye-tracking data, and conversa-tional data). Our results indicated that the AI Group exhibited a nonlinear help-seeking process, such as skipping evaluation, differing significantly from the linear model observed in the HE Group which also aligned with classic help-seeking theory. Detailed analysis revealed that the AI Group asked more operational questions, showing pragmatic help-seeking activities, whereas the HE Group was more proactive in evaluating and processing received feedback. We discussed factors such as social pressure, metacognitive off-loading, and over-reliance on AI in these different help-seeking scenarios. More importantly, this study offers innovative insights and evidence, based on multimodal data, to better understand and scaffold learners learning with generative AI.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"226 ","pages":"Article 105198"},"PeriodicalIF":8.9000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unpacking help-seeking process through multimodal learning analytics: A comparative study of ChatGPT vs Human expert\",\"authors\":\"Angxuan Chen , Mengtong Xiang , Junyi Zhou , Jiyou Jia , Junjie Shang , Xinyu Li , Dragan Gašević , Yizhou Fan\",\"doi\":\"10.1016/j.compedu.2024.105198\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Help-seeking is an active learning strategy tied to self-regulated learning (SRL), where learners seek assistance when facing challenges. They may seek help from teachers, peers, intelligent tu-tor systems, and more recently, generative artificial intelligence (AI). However, there is limited empirical research on how learners’ help-seeking process differs between generative AI and hu-man experts. To address this, we conducted a lab experiment with 38 university students tasked with essay writing and revising. The students were randomly divided into two groups: one seeking help from ChatGPT (AI Group) and the other from an experienced teacher (HE Group). To examine their help-seeking processes, we used a combination of statistical testing and process mining methods, analyzing multimodal data (e.g., trace data, eye-tracking data, and conversa-tional data). Our results indicated that the AI Group exhibited a nonlinear help-seeking process, such as skipping evaluation, differing significantly from the linear model observed in the HE Group which also aligned with classic help-seeking theory. Detailed analysis revealed that the AI Group asked more operational questions, showing pragmatic help-seeking activities, whereas the HE Group was more proactive in evaluating and processing received feedback. We discussed factors such as social pressure, metacognitive off-loading, and over-reliance on AI in these different help-seeking scenarios. More importantly, this study offers innovative insights and evidence, based on multimodal data, to better understand and scaffold learners learning with generative AI.</div></div>\",\"PeriodicalId\":10568,\"journal\":{\"name\":\"Computers & Education\",\"volume\":\"226 \",\"pages\":\"Article 105198\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2024-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers & Education\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0360131524002124\",\"RegionNum\":1,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Education","FirstCategoryId":"95","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0360131524002124","RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Unpacking help-seeking process through multimodal learning analytics: A comparative study of ChatGPT vs Human expert
Help-seeking is an active learning strategy tied to self-regulated learning (SRL), where learners seek assistance when facing challenges. They may seek help from teachers, peers, intelligent tu-tor systems, and more recently, generative artificial intelligence (AI). However, there is limited empirical research on how learners’ help-seeking process differs between generative AI and hu-man experts. To address this, we conducted a lab experiment with 38 university students tasked with essay writing and revising. The students were randomly divided into two groups: one seeking help from ChatGPT (AI Group) and the other from an experienced teacher (HE Group). To examine their help-seeking processes, we used a combination of statistical testing and process mining methods, analyzing multimodal data (e.g., trace data, eye-tracking data, and conversa-tional data). Our results indicated that the AI Group exhibited a nonlinear help-seeking process, such as skipping evaluation, differing significantly from the linear model observed in the HE Group which also aligned with classic help-seeking theory. Detailed analysis revealed that the AI Group asked more operational questions, showing pragmatic help-seeking activities, whereas the HE Group was more proactive in evaluating and processing received feedback. We discussed factors such as social pressure, metacognitive off-loading, and over-reliance on AI in these different help-seeking scenarios. More importantly, this study offers innovative insights and evidence, based on multimodal data, to better understand and scaffold learners learning with generative AI.
期刊介绍:
Computers & Education seeks to advance understanding of how digital technology can improve education by publishing high-quality research that expands both theory and practice. The journal welcomes research papers exploring the pedagogical applications of digital technology, with a focus broad enough to appeal to the wider education community.