IEEE Transactions on Learning Technologies最新文献

{"title":"Empowering Instructors: Augmented Reality Authoring Toolkit for Aviation Weather Education","authors":"Jiwon Kim;Jack Miller;Kexin Wang;Michael C. Dorneich;Eliot Winer;Lori J. Brown","doi":"10.1109/TLT.2024.3486630","DOIUrl":"https://doi.org/10.1109/TLT.2024.3486630","url":null,"abstract":"This study introduces an augmented reality (AR) authoring tool tailored for flight instructors without technical expertise. While AR offers potential in aviation weather education and instructors desire to use it in the classroom, they face challenges due to limited digital proficiency and complexity of authoring tools. Many existing AR authoring tools prioritize technical aspects over user experience. To address these challenges, a no-programming-required AR authoring tool was developed based on instructor-informed requirements, such as incorporating features of flight waypoints and weather phenomena. A total of 41 participants tested the tool by crafting three AR learning modules. After using the tool, there was a significant increase in participants’ confidence in AR content creation (+30%), AR authoring process (+51%), and interactive AR development (+50%). In addition, there was a significant decrease in their concerns about technical complexity (–19%), mental effort (–30%), and time consumption (–30%). Participants rated the incorporated functions highly preferable and indicated the tool has high usability. Participants completed the most challenging task quickly and with a low cognitive load. The findings demonstrate the tool's effectiveness in enabling participants to competently and efficiently author AR content, reducing technical concerns. Such tools can facilitate the integration of AR technology into the classroom, offering students improved access to interactive 3-D visualizations of dynamic subjects, such as aviation weather, which require students to mentally visualize weather conditions and understand their manifestations.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2195-2206"},"PeriodicalIF":2.9,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Guest Editorial Intelligence Augmentation: The Owl of Athena","authors":"Chris Dede","doi":"10.1109/TLT.2024.3456072","DOIUrl":"https://doi.org/10.1109/TLT.2024.3456072","url":null,"abstract":"","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2154-2155"},"PeriodicalIF":2.9,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10726640","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142452739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Designing Learning Technologies: Assessing Attention in Children With Autism Through a Single Case Study","authors":"Yussy Chinchay;César A. Collazos;Javier Gomez;Germán Montoro","doi":"10.1109/TLT.2024.3475741","DOIUrl":"https://doi.org/10.1109/TLT.2024.3475741","url":null,"abstract":"This research focuses on the assessment of attention to identify the design needs for optimized learning technologies for children with autism. Within a single case study incorporating a multiple-baseline design involving baseline, intervention, and postintervention phases, we developed an application enabling personalized attention strategies. These strategies were assessed for their efficacy in enhancing attentional abilities during digital learning tasks. Data analysis of children's interaction experience, support requirements, task completion time, and attentional patterns was conducted using a tablet-based application. The findings contribute to a comprehensive understanding of how children with autism engage with digital learning activities and underscore the significance of personalized attention strategies. Key interaction design principles were identified to address attention-related challenges and promote engagement in the learning experience. This study advances the development of inclusive digital learning environments for children on the autism spectrum by leveraging attention assessment.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2172-2182"},"PeriodicalIF":2.9,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10706829","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142518000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Investigating the Efficacy of ChatGPT-3.5 for Tutoring in Chinese Elementary Education Settings","authors":"Yu Bai;Jun Li;Jun Shen;Liang Zhao","doi":"10.1109/TLT.2024.3464560","DOIUrl":"https://doi.org/10.1109/TLT.2024.3464560","url":null,"abstract":"The potential of artificial intelligence (AI) in transforming education has received considerable attention. This study aims to explore the potential of large language models (LLMs) in assisting students with studying and passing standardized exams, while many people think it is a hype situation. Using primary education as an example, this research investigates whether ChatGPT-3.5 can achieve satisfactory performance on the Chinese Primary School Exams and whether it can be used as a teaching aid or tutor. We designed an experimental framework and constructed a benchmark that comprises 4800 questions collected from 48 tasks in Chinese elementary education settings. Through automatic and manual evaluations, we observed that ChatGPT-3.5’s pass rate was below the required level of accuracy for most tasks, and the correctness of ChatGPT-3.5’s answer interpretation was unsatisfactory. These results revealed a discrepancy between the findings and our initial expectations. However, the comparative experiments between ChatGPT-3.5 and ChatGPT-4 indicated significant improvements in model performance, demonstrating the potential of using LLMs as a teaching aid. This article also investigates the use of the trans-prompting strategy to reduce the impact of language bias and enhance question understanding. We present a comparison of the models' performance and the improvement under the trans-lingual problem decomposition prompting mechanism. Finally, we discuss the challenges associated with the appropriate application of AI-driven language models, along with future directions and limitations in the field of AI for education.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2156-2171"},"PeriodicalIF":2.9,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142517999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Impact of Gamified Learning Experience on Online Learning Effectiveness","authors":"Xiangping Cui;Chen Du;Jun Shen;Susan Zhang;Juan Xu","doi":"10.1109/TLT.2024.3462892","DOIUrl":"10.1109/TLT.2024.3462892","url":null,"abstract":"Research shows that gamified learning experiences can effectively improve the outstanding issues of students in online learning, such as lack of continuous motivation and easy burnout, thereby improving the effectiveness of online learning. However, how to enhance the gamified learning experience in online learning, and what impact there is between the gamified learning experience and the effectiveness of online learning, remain to be further explored. This research article is based on the theory of gamified learning experience and uses structural equation modeling methodology to explore the relationship among the three dimensions of situation-based cognitive experience, collaboration-based social experience, and motivation-based subjectivity experience and the effectiveness of online learning. The results indicate that there is a significant positive correlation among the three dimensions, and all three dimensions have a significant positive impact on the online learning effectiveness. The subjective experience based on motivation has the greatest impact on the online learning effectiveness, and the other two dimensions have a significant positive impact on the online learning effectiveness. The impact on online learning effectiveness is similar. Finally, the article makes recommendations based on the research conclusions, expecting to provide a research foundation for enhancing the gamified learning experience and improving the effectiveness of online learning.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2130-2139"},"PeriodicalIF":2.9,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142266332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Guest Editorial Education in the World of ChatGPT and Generative AI","authors":"Seng Chee Tan;Kay Wijekumar;Huaqing Hong;Justin Olmanson;Robert Twomey;Tanmay Sinha","doi":"10.1109/TLT.2024.3451050","DOIUrl":"https://doi.org/10.1109/TLT.2024.3451050","url":null,"abstract":"","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2062-2064"},"PeriodicalIF":2.9,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10673879","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142174017","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"AI-Based Automatic Detection of Online Teamwork Engagement in Higher Education","authors":"Alejandra J. Magana;Syed Tanzim Mubarrat;Dominic Kao;Bedrich Benes","doi":"10.1109/TLT.2024.3456447","DOIUrl":"10.1109/TLT.2024.3456447","url":null,"abstract":"Fostering productive engagement within teams has been found to improve student learning outcomes. Consequently, characterizing productive and unproductive time during teamwork sessions is a critical preliminary step to increase engagement in teamwork meetings. However, research from the cognitive sciences has mainly focused on characterizing levels of productive engagement. Thus, the theoretical contribution of this study focuses on characterizing active and passive forms of engagement, as well as negative and positive forms of engagement. In tandem, researchers have used computer-based methods to supplement quantitative and qualitative analyses to investigate teamwork engagement. Yet, these studies have been limited to information extracted primarily from one data stream. For instance, text data from discussion forums or video data from recordings. We developed an artificial intelligence (AI)-based automatic system that detects productive and unproductive engagement during live teamwork sessions. The technical contribution of this study focuses on the use of three data streams from an interactive session: audio, video, and text. We automatically analyze them and determine each team's level of engagement, such as productive engagement, unproductive engagement, disengagement, and idle. The AI-based system was validated based on hand-coded data. We used the system to characterize productive and unproductive engagement patterns in teams using deep learning methods. Results showed that there were \u0000<inline-formula><tex-math>$&gt;$</tex-math></inline-formula>\u000091% prediction accuracy and \u0000<inline-formula><tex-math>$&lt; $</tex-math></inline-formula>\u00007% mismatches between predictions for the three engagement detectors. Moreover, Pearson's \u0000<inline-formula><tex-math>$r$</tex-math></inline-formula>\u0000 values between the predictions of the three detectors were \u0000<inline-formula><tex-math>$&gt;$</tex-math></inline-formula>\u00000.844. On a scale of \u0000<inline-formula><tex-math>$-$</tex-math></inline-formula>\u00001 (unproductive engagement) to 1 (productive engagement), the scores for all teams were 0.94 \u0000<inline-formula><tex-math>$pm$</tex-math></inline-formula>\u0000 0.04, suggesting high productive engagement. In addition, teams tended to mostly be in productive engagement before transitioning to disengagement (\u0000<inline-formula><tex-math>$&gt;$</tex-math></inline-formula>\u000090.34% of the time) and to idle (\u0000<inline-formula><tex-math>$&gt;$</tex-math></inline-formula>\u000093.69% of the time). Before transitioning to productive engagement, we noticed almost equal fractions of teams being in idle and disengagement modes. These results show that the system effectively detects engagement and can be a viable tool for characterizing productive and unproductive engagement patterns in teamwork sessions.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2091-2106"},"PeriodicalIF":2.9,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10669806","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142225550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Exploring the Answering Capability of Large Language Models in Addressing Complex Knowledge in Entrepreneurship Education","authors":"Qi Lang;Shengjing Tian;Mo Wang;Jianan Wang","doi":"10.1109/TLT.2024.3456128","DOIUrl":"10.1109/TLT.2024.3456128","url":null,"abstract":"Entrepreneurship education is critical in encouraging students' innovation, creativity, and entrepreneurial spirit. It provides essential skills and knowledge, enabling them to open their creative potential and apply innovative thinking across diverse professional fields. With the widespread application of large language models in education, intelligent-assisted teaching in entrepreneurship education is stepping into a new learning phase anytime and anywhere. Entrepreneurship education extends across interdisciplinary knowledge fields, incorporating subjects like finance and risk management, which require advanced mathematical computational skills. This complexity presents new challenges for artificial-intelligence-assisted question-and-answer models. The study explores how students can maximize the knowledge repository of current large language models to improve learning efficiency and experimentally validates the performance differences between large language models and graph convolutional reasoning models regarding the complex semantic reasoning and mathematical computational demands in entrepreneurship education questions. Based on case studies, it is found that despite the broad prospects of large language models in entrepreneurship education, they still need to improve in practical applications. Especially in tasks within entrepreneurship education that demand precision, such as mathematical computations and risk assessment, the accuracy and efficiency of existing models still need improvement. Therefore, further exploration into algorithm optimization, model fusion, and other technical enhancements can improve the processing capabilities of intelligent question-and-answer systems for specific domain issues, aiming to meet the practical needs of entrepreneurship education.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2107-2116"},"PeriodicalIF":2.9,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142199105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"HSVRS: A Virtual Reality System of the Hide-and-Seek Game to Enhance Gaze Fixation Ability for Autistic Children","authors":"Chengyan Yu;Shihuan Wang;Dong Zhang;Yingying Zhang;Chaoqun Cen;Zhixiang You;Xiaobing Zou;Hongzhu Deng;Ming Li","doi":"10.1109/TLT.2024.3451462","DOIUrl":"https://doi.org/10.1109/TLT.2024.3451462","url":null,"abstract":"Numerous children diagnosed with autism spectrum disorder (ASD) exhibit abnormal eye gaze pattern in communication and social interaction. In this study, we aim to investigate the effectiveness of the hide-and-seek virtual reality system (HSVRS) in improving gaze fixation abilities in children with ASD. Our hypothesis is that engaging in a hide-and-seek game within a virtual environment, particularly with a customized avatar resembling a familiar figure, would significantly enhance gaze fixation skills compared to traditional interventions without supplementary virtual reality (VR) intervention. In total, 36 children with ASD were involved in this pilot study in three groups: the avatar customized group, the avatar uncustomized group, and the control group. The control group only received human intervention, while the avatar group received additional VR-assisted interventions. The effect of HSVRS was measured by a six-point Likert subjective questionnaire and demonstrated significant improvements in gaze fixation abilities in the VR-assisted intervention groups compared to the control group (\u0000<inline-formula><tex-math>$P$</tex-math></inline-formula>\u0000 = 0.006, 0.001). Moreover, the avatar customized group, which interacted with a familiar-looking avatar, obtained noticeable increments in gaze fixation metrics (\u0000<inline-formula><tex-math>$P$</tex-math></inline-formula>\u0000 = 0.036, 0.005, 0.001). Experimental results show the effectiveness of utilizing VR technology to complement regular interventions in terms of improving gaze fixation abilities for young children with ASD.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2065-2078"},"PeriodicalIF":2.9,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142173973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Implementing Artificial Intelligence in Physiotherapy Education: A Case Study on the Use of Large Language Models (LLM) to Enhance Feedback","authors":"Ignacio Villagrán;Rocío Hernández;Gregory Schuit;Andrés Neyem;Javiera Fuentes-Cimma;Constanza Miranda;Isabel Hilliger;Valentina Durán;Gabriel Escalona;Julián Varas","doi":"10.1109/TLT.2024.3450210","DOIUrl":"10.1109/TLT.2024.3450210","url":null,"abstract":"This article presents a controlled case study focused on implementing and using generative artificial intelligence, specifically large language models (LLMs), in physiotherapy education to assist instructors with formulating effective technology-mediated feedback for students. It outlines how these advanced technologies have been integrated into an existing feedback-oriented platform to guide instructors in providing feedback inputs and establish a reference framework for future innovations in practical skills training for health professions education. Specifically, the proposed solution uses LLMs to automatically evaluate feedback inputs made by instructors based on predefined and literature-based quality criteria and generates actionable textual explanations for reformulation. In addition, if the instructor requires, the tool supports summary generation for large sets of text inputs to achieve better student reception and understanding. The case study describes how these features were integrated into the feedback-oriented platform, how their effectiveness was evaluated in a controlled setting with documented feedback inputs, and the results of its implementation with real users through cognitive walkthroughs. Initial results indicate that this innovative implementation holds great potential to enhance learning and performance in physiotherapy education and has the potential to expand to other health disciplines where the development of procedural skills is critical, offering a valuable tool to assess and improve feedback based on quality standards for effective feedback processes. The cognitive walkthroughs allowed us to determine participants' usability decisions in the face of these new features and to evaluate the perceived usefulness, how this would integrate into their workload, and their opinion regarding the potential for the future within this teaching strategy. This article concludes with a discussion of the implications of these findings for practice and future research directions in this developing field.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"2079-2090"},"PeriodicalIF":2.9,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142225554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}