Lucia Mason , Barbara Carretti , Angelica Ronconi , Eleonora Pizzigallo , Ymkje E. Haverkamp , Ivar Bråten
{"title":"“Should you really chat while reading?” effects of on-screen multitasking and text disfluency on integrated understanding","authors":"Lucia Mason , Barbara Carretti , Angelica Ronconi , Eleonora Pizzigallo , Ymkje E. Haverkamp , Ivar Bråten","doi":"10.1016/j.compedu.2024.105172","DOIUrl":"10.1016/j.compedu.2024.105172","url":null,"abstract":"<div><div>Students' multitasking during lectures or academic assignments is a common activity that may have negative effects on performance. It is therefore relevant to investigate under what conditions such negative effects can be reduced. The current study brought together two separate lines of research to examine the effects of on-screen multitasking and text disfluency. Multitasking required students to read and respond to social media messages during reading. Text disfluency was perceptual in the form of harder-to-read versus easy-to-read text. We included 208 university students, who were randomly assigned to one of the four conditions resulting from a 2 x 2 between-subjects design. Participants read two dual-positional texts on sun exposure and health. Dependent on the assigned condition, they could read perceptually fluent or disfluent texts, and they could intermittently receive, or not receive, on-screen social media messages while reading. As outcome variables, we measured participants’ perception of cognitive load, integrated text understanding, and metacognitive calibration of text understanding. We also controlled the possible contributions of the individual differences of prior knowledge, reading comprehension skills, working memory, and cognitive flexibility. Results showed a negative effect of multitasking on the integrated understanding of the dual positional texts with non-multitaskers outperforming multitaskers. Perception of cognitive load and metacognitive calibration were not affected by multitasking. No impact of disfluency was observed for any of the outcome variables, and the interactive effect of multitasking and disfluency was also not statistically significant. Limitations and directions for future research are discussed.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"224 ","pages":"Article 105172"},"PeriodicalIF":8.9,"publicationDate":"2024-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142418283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using multilayer network analysis to detect the collaborative knowledge construction characteristics among learner groups with low, medium, and high levels of cognitive engagement","authors":"Fan Ouyang, Mian Wu, Jianmin Gu","doi":"10.1016/j.compedu.2024.105173","DOIUrl":"10.1016/j.compedu.2024.105173","url":null,"abstract":"<div><div>Collaborative knowledge construction (CKC) is advanced by group members' cognitive engagement across three levels: individual-level knowledge processing and proposing, the peer-level social interactions and knowledge exchanges between two group members, and the group-level coordination and construction of knowledge across multiple group members. The interconnected and transformative relationship among three levels is an essential factor during the CKC process. Individual viewpoints can trigger peer feedback, which can be further refined by other group members; the group-level consensus can provide foundations for subsequent individual- or peer-level cognitive engagement. The group-level coordination of knowledge advancement involves the processing, synthesis, and reflection of knowledge from multiple members to reach a group consensus. However, previous analytical approaches have faced challenges in modeling distinct types of interconnections across the individual, peer, and group levels during the CKC process. To address this gap, this research employed multilayer network analysis (MNA) to model and quantify the multi-level and interconnected characteristics of CKC in a series of face-to-face, computer-supported CKC activities in China's higher education. First, small groups were categorized into the high, medium, and low levels of cognitive engagement groups. Second, multilayer networks were constructed for each category, where students' use of cognitive strategies were set as nodes, the interconnections between cognitive strategies were set as edges, and three levels (i.e., individual, peer, and group levels) were set as layers. The node-, layer-, and network-level metrics were calculated to quantify the overall characteristics of the networks, the interconnected characteristics within a level and across the three levels. The MNA results revealed that, compared to lower level of cognitive engagement groups, groups with higher cognitive engagement demonstrated (1) more influential moderate and deep cognitive strategies at group and peer levels; (2) interconnections between cognitive strategies with higher diversity, connectivity, and more balanced distribution across three levels, but relatively lower information exchanging efficiency; and (3) communities with more interconnections related to the moderate and deep cognitive strategies at peer and group levels. Based on the empirical findings, this research proposed pedagogical implications for CKC practices and analytical implications for using MNA to improve the understanding of computer-supported collaborative learning mechanisms.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105173"},"PeriodicalIF":8.9,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Who says statistics classes are boring? How a virtual escape room enhances statistics learning","authors":"Woon Chien Cecilia Teng, Gek Ling Claire Tan","doi":"10.1016/j.compedu.2024.105171","DOIUrl":"10.1016/j.compedu.2024.105171","url":null,"abstract":"<div><div>Escape rooms (ERs) have gained traction in higher education over the past decade, but studies on ERs for statistics education are scant. In this study, a virtual ER was developed, piloted, and implemented in an undergraduate introductory statistics class, and its impact on learning was evaluated over three iterations. The escapED framework informed the design of the ER. A quasi-experimental pre-test–post-test design was used to evaluate learning gains. A post-activity questionnaire was used to collect student perceptions about the game. Significant learning gains were observed, with large effect sizes across all cohorts. Similarly, analyses of the qualitative data revealed that the game enhanced learning in the cognitive, affective, behavioural, and interpersonal domains, and was well-received by students. The ER was effective in improving learning outcomes. ERs can be a powerful approach in fostering peer learning and shifting negative attitudes about difficult subjects. Educators keen in exploring ERs in their classrooms are highly encouraged to consider pedagogically-informed game designs and leverage technology in creating engaging and effective learning experiences.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"224 ","pages":"Article 105171"},"PeriodicalIF":8.9,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142528116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Danial Hooshyar , Xiaojing Weng , Paula Joanna Sillat , Kairit Tammets , Minhong Wang , Raija Hämäläinen
{"title":"The effectiveness of personalized technology-enhanced learning in higher education: A meta-analysis with association rule mining","authors":"Danial Hooshyar , Xiaojing Weng , Paula Joanna Sillat , Kairit Tammets , Minhong Wang , Raija Hämäläinen","doi":"10.1016/j.compedu.2024.105169","DOIUrl":"10.1016/j.compedu.2024.105169","url":null,"abstract":"<div><div>Personalized technology-enhanced learning (TEL) has emerged as a prominent tool used by universities to cater to students' diverse individual needs. Many higher education researchers and educators have explored the adoption of personalized TEL as an important tool to foster student learning outcomes from diverse perspectives. However, despite its significance and the substantial body of existing research, a notable gap exists in systematically evaluating the effectiveness of personalized TEL with meta-analysis approach within the higher education. To address the research gap, we investigated the effectiveness of personalized TEL in developing students' cognitive skills and non-cognitive characteristics in higher education context by utilizing the methods of meta-analysis and association rule mining. Our study reveals that the cognitive skills are reported more than non-cognitive characteristics as the learning outcomes of adopting personalized TEL. Overall, utilizing personalized TEL can improve students' cognitive skills and non-cognitive characteristics at the medium level effect size. Factors of research settings, mean of delivery, and modelled characteristics can influence students’ non-cognitive characteristics while using personalized TEL. Based on our rule mining findings, future teachers, researchers, and instructional designers can consider combining the modelling of learners' skills/knowledge or preferences with adaptive learning support strategies, such as recommending materials and scaffolding, to achieve positive effects, particularly in the fields of Social Sciences and Engineering.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105169"},"PeriodicalIF":8.9,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142358817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Online peer feedback via Moodle forum: Implications for longitudinal feedback design and feedback quality","authors":"Qin Xie , Chang Zhang","doi":"10.1016/j.compedu.2024.105167","DOIUrl":"10.1016/j.compedu.2024.105167","url":null,"abstract":"<div><div>This study experimented with four design elements and examined their impact on feedback quality—<em>anonymizing feedback writers, providing teacher-made rubrics and a feedback template</em>, <em>and making feedback traceable</em>. The study adopted a quasi-experimental design and involved 75 undergraduates who produced 362 feedback entries on peers' presentations over eight weeks. The feedback comments were scored against detailed rubrics of feedback quality, focusing on nine features grouped under <em>ideational, interpersonal, and textual</em> dimensions according to the functional linguistics perspective. The scores were analyzed using a two-way repeated measures ANOVA to compare the experimental and the control groups' overall performance and week-by-week changes. The results were complex and mixed. Anonymity encouraged feedback writers to be more critical but negatively affected the interpersonal dimension of their writing. Providing templates and rubrics assisted them in the ideational dimension and enabled them to write from multiple aspects. Making feedback traceable helped them learn accumulatively from past efforts. Overall, the design elements substantially improved feedback quality in the first two weeks; however, their advantages diminished over time. In the eighth week, the two groups’ feedback became similar in quality. The study provides new insights for research and practice, highlighting the need to reassess and modify feedback design for longitudinal and routinized feedback activities.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105167"},"PeriodicalIF":8.9,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142425847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lingyun Huang , Min Liang , Yuhan Xiong , Xiaomeng Wu , Cher Ping Lim
{"title":"A systematic review of technology-enabled teacher professional development during COVID -19 pandemic","authors":"Lingyun Huang , Min Liang , Yuhan Xiong , Xiaomeng Wu , Cher Ping Lim","doi":"10.1016/j.compedu.2024.105168","DOIUrl":"10.1016/j.compedu.2024.105168","url":null,"abstract":"<div><div>Technologies have the potential to support and enable teacher professional development (TPD) programs for inclusive and equitable quality education and lifelong learning for all (United Nations, 2023). This paper reviews the technology-enabled TPD programs that took place during the COVID-19 pandemic and investigated their effectiveness on teachers' learning and professional growth. Drawing on the TPD@Scale model, we systematically analyzed the quality, equity, and efficiency dimensions of 37 technology-enabled TPD programs implemented during the pandemic. The findings demonstrate that technology-enabled TPD programs could develop teachers’ knowledge and skills critical to quality teaching during the pandemic and create environments that foster active learning and collaboration among teachers. However, there needs to be significant improvements in using technology to provide expert support and facilitate feedback and reflections. Furthermore, equity and efficiency were not specifically discussed in these TPD programs. Lessons learned from the present study have allowed us to provide recommendations to researchers, policymakers, practitioners, and educators.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105168"},"PeriodicalIF":8.9,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142358818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Torbjørn Netland, Oliver von Dzengelevski, Katalin Tesch, Daniel Kwasnitschka
{"title":"Comparing human-made and AI-generated teaching videos: An experimental study on learning effects","authors":"Torbjørn Netland, Oliver von Dzengelevski, Katalin Tesch, Daniel Kwasnitschka","doi":"10.1016/j.compedu.2024.105164","DOIUrl":"10.1016/j.compedu.2024.105164","url":null,"abstract":"<div><div>In the age of generative AI, can teaching videos be efficiently and effectively generated by large language models? In this study, the authors used generative AI tools to develop four short teaching videos for a management course and then compared them with human-generated videos on the same subjects in an online experiment. In an across-subject experimental design, 447 participants completed two treatment conditions presenting different mixes of AI-generated and human-made videos. The participants were asked to rate their learning experiences after each video and had their learning outcomes tested in a multiple-choice exam at the end of the session (N = 1788 video treatments). The findings show that human-generated videos provided a statistically significant but small advantage to participants in terms of learning experience, indicating that the participants still prefer to be taught by human teachers. However, a comparison of exam results between the experimental groups implies that the participants eventually acquired knowledge about the content to a similar degree. Given these findings and the ease with which AI-generated teaching videos can be created, this study concludes that AI-generated teaching videos will likely proliferate.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"224 ","pages":"Article 105164"},"PeriodicalIF":8.9,"publicationDate":"2024-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Miguel Alvarez-Garcia , Mar Arenas-Parra , Raquel Ibar-Alonso
{"title":"Uncovering student profiles. An explainable cluster analysis approach to PISA 2022","authors":"Miguel Alvarez-Garcia , Mar Arenas-Parra , Raquel Ibar-Alonso","doi":"10.1016/j.compedu.2024.105166","DOIUrl":"10.1016/j.compedu.2024.105166","url":null,"abstract":"<div><div>Educational data mining (EDM) applied to the wealth of data generated from international large-scale assessments (ILSAs) shows potential for identifying successful educational initiatives. Despite limited research on clustering methods in ILSAs, leveraging these methods to uncover student profiles can help decision-making in designing tailored programs. This study aims to identify and characterize 15-year-old student profiles using PISA 2022 data and reveal insights into the relationship between these profiles and factors such as ICT availability and use, gender, academic performance, and educational expectations. We analyzed PISA 2022 Spanish student data (n = 30,800) with a selection of 74 contextual variables, applying an end-to-end explainable cluster analysis methodology that integrates different machine learning (ML) and explainable artificial intelligence (XAI) techniques. This methodology covered data pre-processing, dimensionality reduction, clustering, and classification to ensure data quality and result explainability. We obtained 16 derived variables, 7 student clusters, and an optimal XGBoost classifier with a global accuracy of 0.8643. Using local and global SHAP values, we interpreted clusters, finding that socio-economic status and ICT availability and use at home are the most important factors differentiating student profiles. Our findings suggest the need to emphasize (i) proper ICT accessibility and use, as well as student support networks to improve academic performance, (ii) gender-specific well-being programs, and (iii) the encouragement of educational expectations tailored to students’ gender and their exposure to higher education. These results pave the way for personalized academic policies and programs through ML-based tools for uncovering student profiles.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105166"},"PeriodicalIF":8.9,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142323862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shan Zhang , Chris Davis Jaldi , Noah L. Schroeder , Alexis A. López , Jessica R. Gladstone , Steffi Heidig
{"title":"Pedagogical agent design for K-12 education: A systematic review","authors":"Shan Zhang , Chris Davis Jaldi , Noah L. Schroeder , Alexis A. López , Jessica R. Gladstone , Steffi Heidig","doi":"10.1016/j.compedu.2024.105165","DOIUrl":"10.1016/j.compedu.2024.105165","url":null,"abstract":"<div><div>Pedagogical agents (PAs) are increasingly being integrated into educational technologies. Although previous reviews have examined the impact of PAs on learning and learning-related outcomes, it still remains unclear what specific design features, social cues, and other contextual elements of PA implementation can optimize the learning process. These questions are even more prevalent with regards to the K-12 population, as most reviews to date have largely focused on post-secondary learners. To address this gap in the literature, we systematically review empirical studies around the design of PAs for K-12 learners. After reviewing 1374 studies for potential inclusion, we analyzed 44 studies that met our inclusion criteria using Heidig and Clarebout's (2011) frameworks. Our findings showed that learners had preferences for specific types of PAs. While these preferences were not always associated with increased learning outcomes, there is a lack of research specifically investigating the intersection of perceptions and learning. Our results also showed that pedagogical strategies that are effective for human teachers were effective when used by PAs. We highlight what specific design features instructional designers can use to design PAs for K-12 learners and discuss promising research directions based on the extant work in the field.</div></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105165"},"PeriodicalIF":8.9,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142329479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jorge A. Vázquez Mendoza , Cèsar Ferri Ramírez , Carlos Monserrat Aranda
{"title":"Analysis and discovery of procrastination patterns in a language learning MOOC","authors":"Jorge A. Vázquez Mendoza , Cèsar Ferri Ramírez , Carlos Monserrat Aranda","doi":"10.1016/j.compedu.2024.105154","DOIUrl":"10.1016/j.compedu.2024.105154","url":null,"abstract":"<div><p>Online learning has been gaining a broad notoriety in society in the last years. The ease with which users from all over the world can learn is one of its main attractions. MOOCs are one of these technologies, which have enabled users to learn almost any subject of their interest. The use of MOOCs generates a massive amount of data that has been used by researchers with different goals: to predict dropout, predict grades and determine learning styles. Users of MOOCs face several challenges, some of which have been extensively studied. However, there are some of them, such as procrastination, whose study as a determining factor in the failure of such courses has not been addressed in sufficient depth. Through this paper, the influence of procrastination on the failure rates of users in a MOOC has been uncovered. Furthermore, by using process mining, this research has revealed the existence of a pattern of procrastination and the type of material used during study sessions by the users who fail the course. Speclifically, diverse forms of procrastination have been identified, resulting in differing effects on the educational outcomes attained by the user. These findings possess considerable implications, as they underscore the potential worth of detecting specific procrastination patterns to ascertain users who necessitate supplementary support during their educational pursuits within MOOCs.</p></div>","PeriodicalId":10568,"journal":{"name":"Computers & Education","volume":"223 ","pages":"Article 105154"},"PeriodicalIF":8.9,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0360131524001684/pdfft?md5=f6cc7379b9c5dbfbccc25f0b96b6b1d7&pid=1-s2.0-S0360131524001684-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142241602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}