IEEE Transactions on Learning Technologies最新文献

{"title":"A Flipped Remote Lab: Using a Peer-Assessment Tool for Learning 3-D Modeling","authors":"Mario Vallarino;Saverio Iacono;Edoardo Bellanti;Gianni V. Vercelli","doi":"10.1109/TLT.2024.3358800","DOIUrl":"10.1109/TLT.2024.3358800","url":null,"abstract":"This article introduces a novel approach to remote laboratory instruction, specifically designed for teaching three-dimensional modeling using Blender software. The lab uses virtual machines to provide students with the necessary computational power to carry out the course activities, along with the correct version of the software. The flipped remote lab approach combines the elements of flipped classroom and peer assessment, making it suitable for face-to-face, totally online, or hybrid classes. Prior to each of the two lectures, students begin to practice by replicating the instructor's demonstrations in a set of concise tutorials. Upon completion of the assigned tasks, students carry out self-assessments of their own modeling, in addition to assessing two models created by their peers. A rubric comprising three questions facilitates the assessment process and allows providing feedback on each response. During the subsequent lecture, students work together with the instructor to address challenges encountered in their modeling, exploring also the advanced aspects of software usage that time constraints preclude in a traditional setting. The analysis of the flipped remote lab results reveals that student responses in peer-assessment activities are relevant to the posed questions. Moreover, the students who realized the models demonstrated a comparable level of rigor in self-assessment as their mates who reviewed their works. While students express a high degree of appreciation for the laboratory activities, a notable concern is the highlighted heavy workload. Increasing the allocated time for task completion can help mitigate the workload impact. The article concludes with insights gained from the implementation of the flipped remote lab approach.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1140-1154"},"PeriodicalIF":3.7,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139945546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Learning Style Identification Using Semisupervised Self-Taught Labeling","authors":"Hani Y. Ayyoub;Omar S. Al-Kadi","doi":"10.1109/TLT.2024.3358864","DOIUrl":"https://doi.org/10.1109/TLT.2024.3358864","url":null,"abstract":"Education is a dynamic field that must be adaptable to sudden changes and disruptions caused by events like pandemics, war, and natural disasters related to climate change. When these events occur, traditional classrooms with traditional or blended delivery can shift to fully online learning, which requires an efficient learning environment that meets students’ needs. While learning management systems support teachers’ productivity and creativity, they typically provide the same content to all learners in a course, ignoring their unique learning styles. To address this issue, we propose a semisupervised machine learning approach that detects students’ learning styles using a data mining technique. We use the commonly used Felder-Silverman learning style model and demonstrate that our semisupervised method can produce reliable classification models with few labeled data. We evaluate our approach on two different courses and achieve an accuracy of 88.83% and 77.35%, respectively. Our work shows that educational data mining and semisupervised machine learning techniques can identify different learning styles and create a personalized learning environment.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1093-1106"},"PeriodicalIF":3.7,"publicationDate":"2024-01-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139738982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Supporting Collaborative Writing Tasks in Large-Scale Distance Education","authors":"Marc Burchart;Joerg M. Haake","doi":"10.1109/TLT.2024.3355791","DOIUrl":"https://doi.org/10.1109/TLT.2024.3355791","url":null,"abstract":"In distance education courses with a large number of students and groups, the organization and facilitation of collaborative writing tasks are challenging. Teachers need support for planning, specification, execution, monitoring, and evaluation of collaborative writing tasks in their course. This requires a collaborative learning platform for coordinating all of the different phases in the writing process. In order to enable the design of such a platform, we created a process model of collaborative writing tasks that is based on the identification of participants, activities, phases, and orchestration from the literature. This model may serve as a basis for teachers to specify the instances for such tasks and can be used to determine the functional requirements needed for supporting model-compliant tasks on a collaborative learning platform. We present a general architecture for a platform of this kind that is independent of a concrete learning management systerm (LMS) system or shared editor and demonstrate its implementation using Moodle, Etherpad Lite, and Docker. The platform makes it easier for teachers to create groups and automatically assign members to collaborative workspaces. It enables asynchronous as well as synchronous text editing and communication. It also respects the European information security and data protection requirements and helps teachers monitor both the writing and reviewing activities. The platform was evaluated over a period of three semesters in distance learning courses with more than 4500 students. It proved a scalable and robust environment for coordinating the collaborative writing process of teachers and students and enables analysis of collaborative writing behavior by teachers and researchers.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1051-1068"},"PeriodicalIF":3.7,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139676134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Assessment of Kinematic and Kinetic Attributes of Graphic Execution of Children With Autism and Typically Developing Children Using a Digitized Platform","authors":"Pragya Verma;Niravkumar Patel;Prachi Sharma;Manasi Anand Kanetkar;Madhu Singh;Uttama Lahiri","doi":"10.1109/TLT.2024.3355793","DOIUrl":"https://doi.org/10.1109/TLT.2024.3355793","url":null,"abstract":"Intact graphic execution ability is considered an important gateway to one's academic success. It is often reported that the graphic execution ability of neurotypical children and those having autism, i.e., children with autism spectrum disorder (ASD) is differentiated. Although insightful, these reports had been mostly for text handwriting task that is not language agnostic (with observations related to a writer's language skills), thereby emphasizing the importance of assessing graphic execution ability during language-agnostic graphic task. The assessment can be carried out in terms of kinetic (e.g., grip force exerted on the pen barrel, in-hand manipulation of the pen, etc.) and kinematic (e.g., speed of the pen-tip, pen-tip pressure, etc.) attributes. Given the importance of assessing one's graphic execution ability and the use of language-agnostic platform, in our study, we present the design of a language-agnostic digitized platform that can assess the kinematic and kinetic attributes of one's graphic execution ability. We included shape drawing (with varying turns) as the graphic task. Also, we carried out a study in which 25 neurotypical children and 25 children with ASD took part. Results indicated that, irrespective of the shape being drawn, the kinematic and kinetic attributes of graphic execution were differentiated between the two participant groups. Our system has the potential to help teachers, therapists, etc., to assess one's graphic execution ability and adopt timely strategies addressing the difficulties (if any) faced by a child.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1082-1092"},"PeriodicalIF":3.7,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139700457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Student Perceptions of ChatGPT Use in a College Essay Assignment: Implications for Learning, Grading, and Trust in Artificial Intelligence","authors":"Chad C. Tossell;Nathan L. Tenhundfeld;Ali Momen;Katrina Cooley;Ewart J. de Visser","doi":"10.1109/TLT.2024.3355015","DOIUrl":"https://doi.org/10.1109/TLT.2024.3355015","url":null,"abstract":"This article examined student experiences before and after an essay writing assignment that required the use of ChatGPT within an undergraduate engineering course. Utilizing a pre–post study design, we gathered data from 24 participants to evaluate ChatGPT's support for both completing and grading an essay assignment, exploring its educational value and impact on the learning process. Our quantitative and thematic analyses uncovered that ChatGPT did not simplify the writing process. Instead, the tool transformed the student learning experience yielding mixed responses. Participants reported finding ChatGPT valuable for learning, and their comfort with its ethical and benevolent aspects increased postuse. Concerns with ChatGPT included poor accuracy and limited feedback on the confidence of its output. Students preferred instructors to use ChatGPT to help grade their assignments, with appropriate oversight. They did not trust ChatGPT to grade by itself. Student views of ChatGPT evolved from a perceived “cheating tool” to a collaborative resource that requires human oversight and calibrated trust. Implications for writing, education, and trust in artificial intelligence are discussed.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1069-1081"},"PeriodicalIF":3.7,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10400910","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139700502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Student-Facing Learning Analytics Dashboard for Remote Lab Practical Work","authors":"David P. Reid;Timothy D. Drysdale","doi":"10.1109/TLT.2024.3354128","DOIUrl":"https://doi.org/10.1109/TLT.2024.3354128","url":null,"abstract":"The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment to provide feedback to students during remote lab activities. Feedback is based upon graphical visualizations of student actions performed during lab tasks and comparison to expected procedures using TaskCompare—our custom, asymmetric graph dissimilarity measure that distinguishes students who miss expected actions from those who perform additional actions, a capability missing in existing graph distance (symmetrical dissimilarity) measures. Using a total of \u0000<inline-formula><tex-math>$N = 235$</tex-math></inline-formula>\u0000 student graphs collected during authentic learning in two different engineering courses, we describe the validation of TaskCompare and evaluate the impact of the SFLA dashboard on task completion during remote lab activities. In addition, we use components of the motivated strategies for learning questionnaire as covariates for propensity score matching to account for potential bias in self-selection of use of the dashboard. We find that those students who used the SFLA dashboard achieved significantly better task completion rate (nearly double) than those who did not, with a significant difference in TaskCompare score between the two groups (Mann–Whitney \u0000<inline-formula><tex-math>$U = 453.5$</tex-math></inline-formula>\u0000, \u0000<inline-formula><tex-math>$p &lt; 0.01$</tex-math></inline-formula>\u0000 and Cliff's \u0000<inline-formula><tex-math>$delta = 0.43$</tex-math></inline-formula>\u0000, large effect size). This difference remains after accounting for self-selection. We also report that students' positive rating of the usefulness of the SFLA dashboard for completing lab work is significantly above a neutral response (\u0000<inline-formula><tex-math>$S = 21.0$</tex-math></inline-formula>\u0000 and \u0000<inline-formula><tex-math>$p &lt; 0.01$</tex-math></inline-formula>\u0000). These findings provide evidence that our SFLA dashboard is an effective means of providing formative assessment during remote laboratory activities.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1037-1050"},"PeriodicalIF":3.7,"publicationDate":"2024-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139676214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Collaborative Learning in the Edu-Metaverse Era: An Empirical Study on the Enabling Technologies","authors":"Chen Li;Yue Jiang;Peter H. F. Ng;Yixin Dai;Francis Cheung;Henry C. B. Chan;Ping Li","doi":"10.1109/TLT.2024.3352743","DOIUrl":"https://doi.org/10.1109/TLT.2024.3352743","url":null,"abstract":"Computer-supported collaborative learning aims to use information technologies to support collaborative knowledge construction by practicing the relevant pedagogical approaches, especially in the distance learning setting. The enabling technologies are fast advancing, and the need for solutions during the COVID-19 global pandemic led to the emergence of the Edu-Metaverse, which is conceptualized as a collection of networked virtual worlds (i.e., the Metaverse) for learning. There is a great necessity to investigate how these more recent enabling technologies can support collaborative learning. This empirical study aims to collect both quantitative and qualitative results to fill the knowledge gaps. Specifically, 20 undergraduate students (three females and 17 males) taking the Game Design and Development course voluntarily participated in this study. The participants used three representative collaboration platforms (i.e., AltSpace, Gather, and ZOOM) in our laboratory for discussing three course-specific topics, simulating the undertaking of collaborative learning tasks in the distance learning setting. The results suggest that the participants were more engaged in the learning activities using the Metaverse platforms that offer avatar-mediated communications and collaborations (i.e., AltSpace and Gather). These platforms also gave the participants a stronger sense of copresence and belonging to the learning community. Potential improvements to the usability and the participants' feedback are also discussed in the article. We hope the results can contribute to the fast-growing use of the Metaverse-enabling technologies for educational purposes.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1107-1119"},"PeriodicalIF":3.7,"publicationDate":"2024-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10399380","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139738983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"PERKC: Personalized kNN With CPT for Course Recommendations in Higher Education","authors":"Gina George;Anisha M. Lal","doi":"10.1109/TLT.2023.3346645","DOIUrl":"https://doi.org/10.1109/TLT.2023.3346645","url":null,"abstract":"E-learning is increasingly being used by students in the higher education level for their university credit purpose and some for improving their knowledge. E-learning is also used for skill enhancement purpose by organizations. Due to the availability of wide-ranging options, recommender systems that provide personalized suggestions are much needed. The proposed methodology takes advantage of compact prediction tree (CPT), a popular sequence prediction algorithm. In this article, a new prediction model based on applying CPT over similar students which is found in a novel manner is proposed. The aim of the work is to recommend courses to students at university level. The methodology was evaluated in terms of accuracy and results show the proposed work performs better than applying only CPT, when applying fuzzy C-means with CPT, and when applying k nearest neighbors with CPT.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"885-892"},"PeriodicalIF":3.7,"publicationDate":"2024-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139419476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"When the Past != The Future: Assessing the Impact of Dataset Drift on the Fairness of Learning Analytics Models","authors":"Oscar Blessed Deho;Lin Liu;Jiuyong Li;Jixue Liu;Chen Zhan;Srecko Joksimovic","doi":"10.1109/TLT.2024.3351352","DOIUrl":"https://doi.org/10.1109/TLT.2024.3351352","url":null,"abstract":"Learning analytics (LA), like much of machine learning, assumes the training and test datasets come from the same distribution. Therefore, LA models built on past observations are (implicitly) expected to work well for future observations. However, this assumption does not always hold in practice because the dataset may drift. Recently, algorithmic fairness has gained significant attention. Nevertheless, algorithmic fairness research has paid little attention to dataset drift. Majority of the existing fairness algorithms are “statically” designed. Put another way, LA models \u0000<italic>tuned</i>\u0000 to be “fair” on past data are expected to still be “fair” when dealing with current/future data. However, it is counter-intuitive to deploy a \u0000<italic>statically</i>\u0000 fair algorithm to a \u0000<italic>nonstationary</i>\u0000 world. There is, therefore, a need to assess the impact of dataset drift on the unfairness of LA models. For this reason, we investigate the relationship between dataset drift and unfairness of LA models. Specifically, we first measure the degree of drift in the features (i.e., covariates) and target label of our dataset. After that, we train predictive models on the dataset and evaluate the relationship between the dataset drift and the unfairness of the predictive models. Our findings suggest a directly proportional relationship between dataset drift and unfairness. Further, we find covariate drift to have the most impact on unfairness of models as compared to target drift, and there are no guarantees that a once fair model would consistently remain fair. Our findings imply that “robustness” of fair LA models to dataset drift is necessary before deployment.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"1007-1020"},"PeriodicalIF":3.7,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139572651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A Modular Serious Game Development Framework for Virtual Laboratory Courses","authors":"Furkan Yücel;Hasret Sultan Ünal;Elif Surer;Nejan Huvaj","doi":"10.1109/TLT.2024.3349579","DOIUrl":"https://doi.org/10.1109/TLT.2024.3349579","url":null,"abstract":"Laboratory experience is an integral part of the undergraduate curriculum in most engineering courses. When physical learning is not feasible, and when the demand cannot be met through actual hands-on laboratory sessions, as has been during the COVID-19 pandemic, virtual laboratory courses can be considered as an alternative education medium. This study focuses on developing a generic modular virtual laboratory framework that allows engineers, game designers, and developers to build lab experiments as serious games—games with ulterior motives rather than only entertainment—without writing additional code. A virtual lab serious game for civil engineering's soil mechanics course was created in Unity3D as a WebGL game, and it was tested within the framework by 24 students (12 from the Civil Engineering Department, the rest from computer science-related degrees). Seven faculty members evaluated if the serious game met the learning outcomes. In addition, nine engineers and designers assessed the framework's capabilities and analyzed its flexibility and reuse aspects. To analyze the usability and acceptability of the created game, standard questionnaires such as the technology acceptance model, system usability scale, and presence were employed. The study was done in two phases: participants tested the first version of the game, and the second version was built based on their feedback on the first version. The findings indicate that the modular structure has significant potential for use in a variety of fields and laboratory courses. The proposed game has received very positive feedback and can be considered a use case for the potential of games in interactive virtual laboratories.","PeriodicalId":49191,"journal":{"name":"IEEE Transactions on Learning Technologies","volume":"17 ","pages":"966-981"},"PeriodicalIF":3.7,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139504438","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}