Impacts of interacting with an AI chatbot on preservice teachers' responsive teaching skills in math education

IF 5.1 2区教育学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Journal of Computer Assisted Learning Pub Date : 2024-11-08 DOI:10.1111/jcal.13091

Dabae Lee, Taekwon Son, Sheunghyun Yeo

{"title":"Impacts of interacting with an AI chatbot on preservice teachers' responsive teaching skills in math education","authors":"Dabae Lee, Taekwon Son, Sheunghyun Yeo","doi":"10.1111/jcal.13091","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Artificial Intelligence (AI) technologies offer unique capabilities for preservice teachers (PSTs) to engage in authentic and real-time interactions using natural language. However, the impact of AI technology on PSTs' responsive teaching skills remains uncertain.</p>\n </section>\n \n <section>\n \n <h3> Objectives</h3>\n \n <p>The primary objective of this study is to examine whether interaction with a responsive AI-based chatbot that acts as a virtual student improves pre-service teachers' noticing abilities. The second objective is to compare how the presence or absence of chatbot responses affects changes in PSTs' questioning practices. Finally, the third objective is to investigate how the experience of interacting with the responsive virtual student affects PSTs' perceptions of the effectiveness of their questioning, their satisfaction with the interactions, and their confidence about interacting with a real student compared to the non-responsive chatbot.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A randomised controlled pre- and post-test design was used with 50 PSTs. PSTs' noticing, interaction with the chatbot, and post-survey data were collected, and a <i>t</i>-test was conducted to examine significant differences by group.</p>\n </section>\n \n <section>\n \n <h3> Results and Conclusion</h3>\n \n <p>In the experimental group, the virtual student responded to PSTs' questions, while in the control group, she did not. Notable differences were observed in their questioning practices.</p>\n </section>\n \n <section>\n \n <h3> Takeaways</h3>\n \n <p>Overall, AI-based chatbots hold promise for enhancing PSTs' responsive teaching skills. Future research is needed to examine the long-term impact of responsive chatbot use on PSTs' noticing skills.</p>\n </section>\n </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"41 1","pages":""},"PeriodicalIF":5.1000,"publicationDate":"2024-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Computer Assisted Learning","FirstCategoryId":"95","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jcal.13091","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Artificial Intelligence (AI) technologies offer unique capabilities for preservice teachers (PSTs) to engage in authentic and real-time interactions using natural language. However, the impact of AI technology on PSTs' responsive teaching skills remains uncertain.

Objectives

The primary objective of this study is to examine whether interaction with a responsive AI-based chatbot that acts as a virtual student improves pre-service teachers' noticing abilities. The second objective is to compare how the presence or absence of chatbot responses affects changes in PSTs' questioning practices. Finally, the third objective is to investigate how the experience of interacting with the responsive virtual student affects PSTs' perceptions of the effectiveness of their questioning, their satisfaction with the interactions, and their confidence about interacting with a real student compared to the non-responsive chatbot.

Methods

A randomised controlled pre- and post-test design was used with 50 PSTs. PSTs' noticing, interaction with the chatbot, and post-survey data were collected, and a t-test was conducted to examine significant differences by group.

Results and Conclusion

In the experimental group, the virtual student responded to PSTs' questions, while in the control group, she did not. Notable differences were observed in their questioning practices.

Takeaways

Overall, AI-based chatbots hold promise for enhancing PSTs' responsive teaching skills. Future research is needed to examine the long-term impact of responsive chatbot use on PSTs' noticing skills.

查看原文本刊更多论文

与AI聊天机器人互动对数学教育中职前教师响应式教学技能的影响

人工智能（AI）技术为职前教师（pst）提供了独特的能力，使他们能够使用自然语言进行真实和实时的互动。然而，人工智能技术对pst响应式教学技能的影响仍不确定。本研究的主要目的是研究与响应式人工智能聊天机器人（作为虚拟学生）的互动是否能提高职前教师的注意能力。第二个目标是比较聊天机器人反应的存在或不存在如何影响pst提问实践的变化。最后，第三个目标是调查与响应性虚拟学生互动的体验如何影响pst对提问有效性的看法，他们对互动的满意度，以及他们对与真实学生互动的信心，而不是与无响应的聊天机器人。方法采用随机对照试验前后设计，共50例pst。收集pst的注意、与聊天机器人的互动以及调查后的数据，并进行t检验以检验组间的显著差异。结果与结论实验组虚拟学生回答了PSTs的问题，而对照组虚拟学生没有回答PSTs的问题。他们的提问方式存在显著差异。总的来说，基于人工智能的聊天机器人有望提高pst的响应性教学技能。未来的研究需要检验响应式聊天机器人对pst注意技能的长期影响。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Computer Assisted Learning EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

9.70

自引率

6.00%

发文量

116

期刊介绍： The Journal of Computer Assisted Learning is an international peer-reviewed journal which covers the whole range of uses of information and communication technology to support learning and knowledge exchange. It aims to provide a medium for communication among researchers as well as a channel linking researchers, practitioners, and policy makers. JCAL is also a rich source of material for master and PhD students in areas such as educational psychology, the learning sciences, instructional technology, instructional design, collaborative learning, intelligent learning systems, learning analytics, open, distance and networked learning, and educational evaluation and assessment. This is the case for formal (e.g., schools), non-formal (e.g., workplace learning) and informal learning (e.g., museums and libraries) situations and environments. Volumes often include one Special Issue which these provides readers with a broad and in-depth perspective on a specific topic. First published in 1985, JCAL continues to have the aim of making the outcomes of contemporary research and experience accessible. During this period there have been major technological advances offering new opportunities and approaches in the use of a wide range of technologies to support learning and knowledge transfer more generally. There is currently much emphasis on the use of network functionality and the challenges its appropriate uses pose to teachers/tutors working with students locally and at a distance. JCAL welcomes: -Empirical reports, single studies or programmatic series of studies on the use of computers and information technologies in learning and assessment -Critical and original meta-reviews of literature on the use of computers for learning -Empirical studies on the design and development of innovative technology-based systems for learning -Conceptual articles on issues relating to the Aims and Scope