J. Learn. Anal.Pub Date : 2023-02-28DOI: 10.18608/jla.2023.7743
Irina Rets, C. Herodotou, Ann Gillespie
{"title":"Six Practical Recommendations Enabling Ethical Use of Predictive Learning Analytics in Distance Education","authors":"Irina Rets, C. Herodotou, Ann Gillespie","doi":"10.18608/jla.2023.7743","DOIUrl":"https://doi.org/10.18608/jla.2023.7743","url":null,"abstract":"The progressive move of higher education institutions (HEIs) towards blended and online environments, accelerated by COVID-19, and their access to a greater variety of student data has heightened the need for ethical learning analytics (LA). This need is particularly salient in light of a lack of comprehensive, evidence-based guidelines on ethics that address gaps voiced in LA ethics research. Studies on the topic are predominantly conceptual, representing mainly institutional rather than stakeholder views, with some areas of ethics remaining underexplored. In this paper, we address this need by using a case of four years of interdisciplinary research in developing the award-winning Early Alerts Indicators (EAI) dashboard at a distance learning university. Through a lens focused on ethical considerations and informed by the practical approach to ethics, we conducted a case study review, using 10 relevant publications that report on the development and implementation of the tool. Our six practical recommendations on how to ethically engage with LA can inform an ethical development of LA that not only protects student privacy, but also ensures that LA tools are used in ways that effectively support student learning and development.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116899210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2023-02-28DOI: 10.18608/jla.2023.7793
Adrian Grimm, Anneke Steegh, M. Kubsch, K. Neumann
{"title":"Learning Analytics in Physics Education: Equity-Focused Decision-Making Lacks Guidance!","authors":"Adrian Grimm, Anneke Steegh, M. Kubsch, K. Neumann","doi":"10.18608/jla.2023.7793","DOIUrl":"https://doi.org/10.18608/jla.2023.7793","url":null,"abstract":"Learning Analytics are an academic field with promising usage scenarios for many educational domains. At the same time, learning analytics come with threats such as the amplification of historically grown inequalities. A range of general guidelines for more equity-focused learning analytics have been proposed but fail to provide sufficiently clear guidance for practitioners. With this paper, we attempt to address this theory–practice gap through domain-specific (physics education) refinement of the general guidelines We propose a process as a starting point for this domain-specific refinement that can be applied to other domains as well. Our point of departure is a domain-specific analysis of historically grown inequalities in order to identify the most relevant diversity categories and evaluation criteria. Through two focal points for normative decision-making, namely equity and bias, we analyze two edge cases and highlight where domain-specific refinement of general guidance is necessary. Our synthesis reveals a necessity to work towards domain-specific standards and regulations for bias analyses and to develop counter-measures against (intersectional) discrimination. Ultimately, this should lead to a stronger equity-focused practice in future.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129461313","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-16DOI: 10.18608/jla.2022.7937
Rebecca Ferguson, X. Ochoa, Vitomir Kovanovíc
{"title":"Learning Analytics: Practitioners, Take Note: Journal of Learning Analytics Editorial 2022","authors":"Rebecca Ferguson, X. Ochoa, Vitomir Kovanovíc","doi":"10.18608/jla.2022.7937","DOIUrl":"https://doi.org/10.18608/jla.2022.7937","url":null,"abstract":"The editorial looks back at the journal in 2022 and forward to 2023. For this editorial, we analysed all ‘Notes for Practice’ published in the journal from when they first appeared in issue 5(1) to the end of November, 2022. Our goals were to examine critically the ways in which these notes have been used to foster collaboration between researchers and practitioners, and also to summarise key findings that practitioners can use to inform their work. Our analysis covers 434 Notes for Practice from 130 different papers. The full dataset used for this analysis is provided as a supplementary file.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116174999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-16DOI: 10.18608/jla.2022.7929
Y. Kim, José A. Ruipérez Valiente, Dirk Ifenthaler, Erik Harpstead, Elizabeth Rowe
{"title":"Analytics for Game-Based Learning","authors":"Y. Kim, José A. Ruipérez Valiente, Dirk Ifenthaler, Erik Harpstead, Elizabeth Rowe","doi":"10.18608/jla.2022.7929","DOIUrl":"https://doi.org/10.18608/jla.2022.7929","url":null,"abstract":"The purpose of this special section is to collect in one place how data in game-based learning environments may be turned into valuable analytics for student assessment, support of learning, and/or improvement of the game, using existing or emerging empirical research methodologies from various fields, including computer science, software engineering, educational data mining, learning analytics, learning sciences, statistics, and information visualization. Four contributions form this special section, which will inspire future high-quality research studies and contribute to the growing knowledge base of learning analytics and game-based learning research and practice.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116808312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-13DOI: 10.18608/jla.2022.7577
Joshua Weidlich, D. Gašević, H. Drachsler
{"title":"Causal Inference and Bias in Learning Analytics: A Primer on Pitfalls Using Directed Acyclic Graphs","authors":"Joshua Weidlich, D. Gašević, H. Drachsler","doi":"10.18608/jla.2022.7577","DOIUrl":"https://doi.org/10.18608/jla.2022.7577","url":null,"abstract":"As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they may be reluctant to draw causal inferences. The past decades have seen much progress concerning causal inference in the absence of experimental data. This paper introduces directed acyclic graphs (DAGs), an increasingly popular tool to visually determine the validity of causal claims. Based on this, three basic pitfalls are outlined: confounding bias, overcontrol bias, and collider bias. Further, the paper shows how these pitfalls may be present in the published LA literature alongside possible remedies. Finally, this approach is discussed in light of practical constraints and the need for theoretical development.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123095683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-13DOI: 10.18608/jla.2022.7751
Olga Viberg, Chantal Mutimukwe, Å. Grönlund
{"title":"Privacy in LA Research: Understanding the Field to Improve the Practice","authors":"Olga Viberg, Chantal Mutimukwe, Å. Grönlund","doi":"10.18608/jla.2022.7751","DOIUrl":"https://doi.org/10.18608/jla.2022.7751","url":null,"abstract":"Protection of student privacy is critical for scaling up the use of learning analytics (LA) in education. Poorly implemented frameworks for privacy protection may negatively impact LA outcomes and undermine trust in the discipline. To design and implement models and tools for privacy protection, we need to understand privacy itself. To develop better understanding and build ground for developing tools and models for privacy protection, this paper examines how privacy hitherto has been defined by LA scholars, and how those definitions relate to the established approaches to define privacy. We conducted a scoping review of 59 articles focused on privacy in LA. In most of these studies (74%), privacy was not defined at all; 6% defined privacy as a right, 11% as a state, 15% as control, and 16% used other approaches to explain privacy in LA. The results suggest a need to define privacy in LA to be able to enact a responsible approach to the use of student data for analysis and decision-making.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128810311","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-13DOI: 10.18608/jla.2022.7637
Min Liu, Ying Cai, Song-Ae Han, Peixia Shao
{"title":"Understanding Student Navigation Patterns in Game-Based Learning","authors":"Min Liu, Ying Cai, Song-Ae Han, Peixia Shao","doi":"10.18608/jla.2022.7637","DOIUrl":"https://doi.org/10.18608/jla.2022.7637","url":null,"abstract":"Research on learning analytics (LA) has focused mostly at the university level. LA research in the K–12 setting is needed. This study aimed to understand 4,115 middle school students’ learning paths based on their behavioural patterns and the relationship with performance levels when they used a digital learning game as their science curriculum. The findings showed significant positive relationships between various tool uses and performance measures and varied tool use patterns at different problem-solving phases by high- and low-performing students. The results indicated that students who used tools appropriately and wisely, given the phase they were at, were more likely to succeed. The findings offered an insightful glimpse of learners’ navigation patterns in relation to their performance and provided much-needed empirical evidence to support using analytics for game-based learning in K–12 education. The findings also revealed that log data cannot explain all learners’ actions. Implications for both research and practice are discussed.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127087399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-09DOI: 10.18608/jla.2022.7633
Cristina Alonso-Fernández, Antonio Calvo-Morata, M. Freire, I. Martínez-Ortiz, Baltasar Fernandez-Manjon
{"title":"Game Learning Analytics:: Blending Visual and Data Mining Techniques to Improve Serious Games and to Better Understand Player Learning","authors":"Cristina Alonso-Fernández, Antonio Calvo-Morata, M. Freire, I. Martínez-Ortiz, Baltasar Fernandez-Manjon","doi":"10.18608/jla.2022.7633","DOIUrl":"https://doi.org/10.18608/jla.2022.7633","url":null,"abstract":"Game learning analytics (GLA) comprise the collection, analysis, and visualization of player interactions with serious games. The information gathered from these analytics can help us improve serious games and better understand player actions and strategies, as well as improve player assessment. However, the application of analytics is a complex and costly process that is not yet generalized in serious games. Using a standard data format to collect player interactions is essential: the standardization allows us to simplify and systematize every step in developing tools and processes compatible with multiple games. In this paper, we explore a combination of 1) an exploratory visualization tool that analyzes player interactions in the game and provides an overview of their actions, and 2) an assessment approach, based on the collection of interaction data for player assessment. We describe some of the different opportunities offered by analytics in game-based learning, the relevance of systematizing the process by using standards and game-independent analyses and visualizations, and the different techniques (visualizations, data mining models) that can be applied to yield meaningful information to better understand learners’ actions and results in serious games.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116590208","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-12-07DOI: 10.18608/jla.2022.7639
Jiaqi Yu, Wenchao Ma, Jewoong Moon, André R. Denham
{"title":"Developing a Stealth Assessment System Using a Continuous Conjunctive Model","authors":"Jiaqi Yu, Wenchao Ma, Jewoong Moon, André R. Denham","doi":"10.18608/jla.2022.7639","DOIUrl":"https://doi.org/10.18608/jla.2022.7639","url":null,"abstract":"Integrating learning analytics in digital game-based learning has gained popularity in recent decades. The interactive nature of educational games creates an ideal environment for learning analytics data collection. However, past research has limited success in producing accessible and effective assessments using game learning analytics. In this study, a mathematics educational game called The Nomads was designed and developed to train learners’ adaptive expertise in rational number arithmetic. Players’ game log data were captured and fitted to a cognitive diagnostic model (CDM) — CCM (continuous conjunctive model). CCM lends itself well to the complex and dynamic nature of game learning analytics. Unlike traditional CDMs, CCM generates parameters at an attribute level and offers more parsimonious diagnoses using continuous variables. The findings suggest that learners’ attribute mastery improved during the gameplay and that learners benefit from using the scaffolds for three of the attributes instructed by the game. This study presents the application of a powerful new tool for game learning analytics. Future studies can benefit from more generalized analytics models and more specified learning attributes and game tasks.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132344722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Learn. Anal.Pub Date : 2022-11-20DOI: 10.18608/jla.2022.7631
Jewoong Moon, Fengfeng Ke, Zlatko Sokolikj, Ibrahim Dahlstrom‐Hakki
{"title":"Multimodal Data Fusion to Track Students' Distress during Educational Gameplay","authors":"Jewoong Moon, Fengfeng Ke, Zlatko Sokolikj, Ibrahim Dahlstrom‐Hakki","doi":"10.18608/jla.2022.7631","DOIUrl":"https://doi.org/10.18608/jla.2022.7631","url":null,"abstract":"Using multimodal data fusion techniques, we built and tested prediction models to track middle-school student distress states during educational gameplay. We collected and analyzed 1,145 data instances, sampled from a total of 31 middle-school students’ audio- and video-recorded gameplay sessions. We conducted data wrangling with student gameplay data from multiple data sources, such as individual facial expression recordings and gameplay logs. Using supervised machine learning, we built and tested candidate classifiers that yielded an estimated probability of distress states. We then conducted confidence-based data fusion that averaged the estimated probability scores from the unimodal classifiers with a single data source. The results of this study suggest that the classifier with multimodal data fusion improves the performance of tracking distress states during educational gameplay, compared to the performance of unimodal classifiers. The study finding suggests the feasibility of multimodal data fusion in developing game-based learning analytics. Also, this study proposes the benefits of optimizing several methodological means for multimodal data fusion in educational game research.","PeriodicalId":145357,"journal":{"name":"J. Learn. Anal.","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131593997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}