RECIPE4U:EFL 写作教育中的学生聊天 GPT 互动数据集

Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Tak Yeon Lee, So-Yeon Ahn, Alice Oh
{"title":"RECIPE4U:EFL 写作教育中的学生聊天 GPT 互动数据集","authors":"Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Tak Yeon Lee, So-Yeon Ahn, Alice Oh","doi":"arxiv-2403.08272","DOIUrl":null,"url":null,"abstract":"The integration of generative AI in education is expanding, yet empirical\nanalyses of large-scale and real-world interactions between students and AI\nsystems still remain limited. Addressing this gap, we present RECIPE4U (RECIPE\nfor University), a dataset sourced from a semester-long experiment with 212\ncollege students in English as Foreign Language (EFL) writing courses. During\nthe study, students engaged in dialogues with ChatGPT to revise their essays.\nRECIPE4U includes comprehensive records of these interactions, including\nconversation logs, students' intent, students' self-rated satisfaction, and\nstudents' essay edit histories. In particular, we annotate the students'\nutterances in RECIPE4U with 13 intention labels based on our coding schemes. We\nestablish baseline results for two subtasks in task-oriented dialogue systems\nwithin educational contexts: intent detection and satisfaction estimation. As a\nfoundational step, we explore student-ChatGPT interaction patterns through\nRECIPE4U and analyze them by focusing on students' dialogue, essay data\nstatistics, and students' essay edits. We further illustrate potential\napplications of RECIPE4U dataset for enhancing the incorporation of LLMs in\neducational frameworks. RECIPE4U is publicly available at\nhttps://zeunie.github.io/RECIPE4U/.","PeriodicalId":501030,"journal":{"name":"arXiv - CS - Computation and Language","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education\",\"authors\":\"Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Tak Yeon Lee, So-Yeon Ahn, Alice Oh\",\"doi\":\"arxiv-2403.08272\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The integration of generative AI in education is expanding, yet empirical\\nanalyses of large-scale and real-world interactions between students and AI\\nsystems still remain limited. Addressing this gap, we present RECIPE4U (RECIPE\\nfor University), a dataset sourced from a semester-long experiment with 212\\ncollege students in English as Foreign Language (EFL) writing courses. During\\nthe study, students engaged in dialogues with ChatGPT to revise their essays.\\nRECIPE4U includes comprehensive records of these interactions, including\\nconversation logs, students' intent, students' self-rated satisfaction, and\\nstudents' essay edit histories. In particular, we annotate the students'\\nutterances in RECIPE4U with 13 intention labels based on our coding schemes. We\\nestablish baseline results for two subtasks in task-oriented dialogue systems\\nwithin educational contexts: intent detection and satisfaction estimation. As a\\nfoundational step, we explore student-ChatGPT interaction patterns through\\nRECIPE4U and analyze them by focusing on students' dialogue, essay data\\nstatistics, and students' essay edits. We further illustrate potential\\napplications of RECIPE4U dataset for enhancing the incorporation of LLMs in\\neducational frameworks. RECIPE4U is publicly available at\\nhttps://zeunie.github.io/RECIPE4U/.\",\"PeriodicalId\":501030,\"journal\":{\"name\":\"arXiv - CS - Computation and Language\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Computation and Language\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2403.08272\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Computation and Language","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2403.08272","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

生成式人工智能在教育领域的应用正在不断扩大,但对学生与人工智能系统之间大规模真实互动的实证分析仍然有限。为了弥补这一不足,我们展示了 RECIPE4U(RECIPEfor University),这是一个数据集,来源于一项为期一学期的实验,实验对象是 212 名学习英语作为外语(EFL)写作课程的大学生。RECIPE4U 包含这些交互的全面记录,包括对话日志、学生的意图、学生的自我满意度评价以及学生的论文编辑历史。特别是,我们根据编码方案为 RECIPE4U 中的学生话语标注了 13 个意图标签。我们为教育背景下以任务为导向的对话系统中的两个子任务建立了基准结果:意图检测和满意度估计。作为基础步骤,我们通过 RECIPE4U 探索了学生与 ChatGPT 的交互模式,并通过关注学生的对话、论文数据统计和学生的论文编辑进行了分析。我们进一步说明了 RECIPE4U 数据集的潜在应用,以加强将 LLM 纳入教育框架。RECIPE4U可在https://zeunie.github.io/RECIPE4U/。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education
The integration of generative AI in education is expanding, yet empirical analyses of large-scale and real-world interactions between students and AI systems still remain limited. Addressing this gap, we present RECIPE4U (RECIPE for University), a dataset sourced from a semester-long experiment with 212 college students in English as Foreign Language (EFL) writing courses. During the study, students engaged in dialogues with ChatGPT to revise their essays. RECIPE4U includes comprehensive records of these interactions, including conversation logs, students' intent, students' self-rated satisfaction, and students' essay edit histories. In particular, we annotate the students' utterances in RECIPE4U with 13 intention labels based on our coding schemes. We establish baseline results for two subtasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. As a foundational step, we explore student-ChatGPT interaction patterns through RECIPE4U and analyze them by focusing on students' dialogue, essay data statistics, and students' essay edits. We further illustrate potential applications of RECIPE4U dataset for enhancing the incorporation of LLMs in educational frameworks. RECIPE4U is publicly available at https://zeunie.github.io/RECIPE4U/.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信