LAK23: 13th International Learning Analytics and Knowledge Conference最新文献_第4页

Are We on the Same Page? Modeling Linguistic Synchrony and Math Literacy in Mathematical Discussions 我们在同一页吗?数学讨论中的语言同步建模与数学素养

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576082

Yukyeong Song, Wanli Xing, Xiaoyi Tian, Chenglu Li

{"title":"Are We on the Same Page? Modeling Linguistic Synchrony and Math Literacy in Mathematical Discussions","authors":"Yukyeong Song, Wanli Xing, Xiaoyi Tian, Chenglu Li","doi":"10.1145/3576050.3576082","DOIUrl":"https://doi.org/10.1145/3576050.3576082","url":null,"abstract":"Mathematical discussions have become a popular educational strategy to promote math literacy. While some studies have associated math literacy with linguistic factors such as verbal ability and phonological skills, no studies have examined the relationship between linguistic synchrony and math literacy. In this study, we modeled linguistic synchrony and students’ math literacy from 20,776 online mathematical discussion threads between students and facilitators. We conducted Cross-Recurrence Quantification Analysis (CRQA) to calculate linguistic synchrony within each thread. The statistical testing result comparing CRQA indices between high and low math literacy groups shows that students with high math literacy have a significantly higher Recurrence Rate (RR), Number of Recurrence Lines (NRLINE), and the average Length of lines (L), but lower Determinism (DET) and normalized Entropy (rENTR). This result implies that students with high math literacy are more likely to share common words with facilitators, but they would paraphrase them. On the other hand, students with low math literacy tend to repeat the exact same phrases from the facilitators. The findings provide a better understanding of mathematical discussions and can potentially guide teachers in promoting effective mathematical discussions.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130063268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Investigating Student's Problem-solving Approaches in MOOCs using Natural Language Processing 利用自然语言处理调查mooc学生解决问题的方法

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576091

ByeongJo Kong, Erik Hemberg, Ana Bell, Una-May O’Reilly

{"title":"Investigating Student's Problem-solving Approaches in MOOCs using Natural Language Processing","authors":"ByeongJo Kong, Erik Hemberg, Ana Bell, Una-May O’Reilly","doi":"10.1145/3576050.3576091","DOIUrl":"https://doi.org/10.1145/3576050.3576091","url":null,"abstract":"Problem-solving approaches are an essential part of learning. Knowing how students approach solving problems can help instructors improve their instructional designs and effectively guide the learning process of students. We propose a natural language processing (NLP) driven method to capture online learners’ problem-solving approaches at scale while using Massive Open Online Courses (MOOCs) as a learning platform. We employ an online survey to gather data, NLP techniques, and existing educational theories to investigate this in the lens of both computer science and education. The paper shows how NLP techniques, i.e. preprocessing, topic modeling, and text summarization, must be tuned to extract information from a large-scale text corpus. The proposed method discovered 18 problem-solving approaches from the text data, such as using pen and paper, peer learning, trial and error, etc. We also observed topics that appear over the years, such as clarifying code logic, watching videos, etc. We observed that students heavily rely on \"tools\" for solving programming problems and can expect that such selection of methods can vary depending on the type of task.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116481908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Towards explainable prediction of essay cohesion in Portuguese and English 论葡萄牙语和英语短文衔接的可解释性预测

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576152

Hilário Oliveira, Rafael Ferreira Mello, Bruno Alexandre Barreiros Rosa, Mladen Raković, Pericles Miranda, T. Cordeiro, Seiji Isotani, I. Bittencourt, D. Gašević

{"title":"Towards explainable prediction of essay cohesion in Portuguese and English","authors":"Hilário Oliveira, Rafael Ferreira Mello, Bruno Alexandre Barreiros Rosa, Mladen Raković, Pericles Miranda, T. Cordeiro, Seiji Isotani, I. Bittencourt, D. Gašević","doi":"10.1145/3576050.3576152","DOIUrl":"https://doi.org/10.1145/3576050.3576152","url":null,"abstract":"Textual cohesion is an essential aspect of a formally written text, related to linguistic mechanisms that connect elements such as words, sentences, and paragraphs. Several studies have proposed approaches to estimate textual cohesion in essays automatically. There is limited research that aims to study the extent to which the use of machine learning approaches can predict the textual cohesion of essays written in different languages (not just English). This paper reports on the findings of a study that aimed to propose and evaluate approaches that automatically estimate the cohesion of essays in Portuguese and English. The study proposed regression-based models grounded in conventional feature-based machine learning methods and deep learning-based pre-trained language models. The study also examined the explainability of automated approaches to scrutinize their predictions. We analyzed two datasets composed of 4,570 (Portuguese) and 7,101 (English) essays. The results demonstrate that a deep learning-based model achieved the best performance on both datasets with a moderate Pearson correlation with human-rated cohesion scores. However, the explainability of the automatic cohesion estimations based on conventional machine learning models offered a stronger potential than that of the deep learning model.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125956410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Student Profiles of Change in a University Course: A Complex Dynamical Systems Perspective 大学课程中学生的变化概况:一个复杂动力系统的视角

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576077

Oleksandra Poquet, J. Jovanović, Abelardo Pardo

{"title":"Student Profiles of Change in a University Course: A Complex Dynamical Systems Perspective","authors":"Oleksandra Poquet, J. Jovanović, Abelardo Pardo","doi":"10.1145/3576050.3576077","DOIUrl":"https://doi.org/10.1145/3576050.3576077","url":null,"abstract":"Learning analytics approaches to profiling students based on their study behaviour remain limited in how they integrate temporality and change. To advance this area of work, the current study examines profiles of change in student study behaviour in a blended undergraduate engineering course. The study is conceptualised through complex dynamical systems theory and its applications in psychological and cognitive science research. Students were profiled based on the changes in their behaviour as observed in clickstream data. Measure of entropy in the recurrence of student behaviour was used to indicate the change of a student state, consistent with the evidence from cognitive sciences. Student trajectories of weekly entropy values were clustered to identify distinct profiles. Three patterns were identified: stable weekly study, steep changes in weekly study, and moderate changes in weekly study. The students with steep changes in their weekly study activity had lower exam grades and showed destabilisation of weekly behaviour earlier in the course. The study investigated the relationships between these profiles of change, student performance, and other approaches to learner profiling, such as self-reported measures of self-regulated learning, and profiles based on the sequences of learning actions.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125142247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 2

The Student Zipf Theory: Inferring Latent Structures in Open-Ended Student Work To Help Educators 学生Zipf理论:推断开放式学生作业中的潜在结构以帮助教育者

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576116

Yunsung Kim, C. Piech

{"title":"The Student Zipf Theory: Inferring Latent Structures in Open-Ended Student Work To Help Educators","authors":"Yunsung Kim, C. Piech","doi":"10.1145/3576050.3576116","DOIUrl":"https://doi.org/10.1145/3576050.3576116","url":null,"abstract":"Are there structures underlying student work that are universal across every open-ended task? We demonstrate that, across many subjects and assignment types, the probability distribution underlying student-generated open-ended work is close to Zipf’s Law. Inferring this latent structure for classroom assignments can help learning analytics researchers, instruction designers, and educators understand the landscape of various student approaches, assess the complexity of assignments, and prioritise pedagogical attention. However, typical classrooms are way too small to witness even the contour of the Zipfian pattern, and it is generally impossible to perform inference for Zipf’s law from such small number of samples. We formalise this difficult task as the Zipf Inference Challenge: (1) Infer the ordering of student-generated works by their underlying probabilities, and (2) Estimate the shape parameter of the underlying distribution in a typical-sized classroom. Our key insight in addressing this challenge is to leverage the densities of the student response landscapes represented by semantic similarity. We show that our “Semantic Density Estimation” method is able to do a much better job at inferring the latent Zipf shape and the probability-ordering of student responses for real world education datasets.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127678237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Informing Expert Feature Engineering through Automated Approaches: Implications for Coding Qualitative Classroom Video Data 通过自动化方法通知专家特征工程:编码定性课堂视频数据的含义

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576090

Paul Hur, Nessrine Machaka, Christina Krist, Nigel Bosch

{"title":"Informing Expert Feature Engineering through Automated Approaches: Implications for Coding Qualitative Classroom Video Data","authors":"Paul Hur, Nessrine Machaka, Christina Krist, Nigel Bosch","doi":"10.1145/3576050.3576090","DOIUrl":"https://doi.org/10.1145/3576050.3576090","url":null,"abstract":"While classroom video data are detailed sources for mining student learning insights, their complex and unstructured nature makes them less than straightforward for researchers to analyze. In this paper, we compared the differences between the processes of expert-informed manual feature engineering and automated feature engineering using positional data for predicting student group interaction in four middle school and high school mathematics classroom videos. Our results highlighted notable differences, including improved model accuracy for the combined (manual features + automated features) models compared to the only-manual-features models (mean AUC = .778 vs. .706) at the cost of feature interpretability, increased number of features for automated feature engineering (1523 vs. 178), and engineering approach (domain-agnostic in automated vs. domain-knowledge-informed in manual). We carried out feature importance analyses and discuss the implications of the results for potentially augmenting human perspectives about qualitatively coding classroom video data by confirming and expanding views on which body areas and characteristics may be relevant to the target interaction behavior. Lastly, we discuss our study’s limitations and future work.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129963916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

When the Tutor Becomes the Student: Design and Evaluation of Efficient Scenario-based Lessons for Tutors 当导师变成学生:高效情境化导师课程设计与评价

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576089

Danielle R. Thomas, Xinyu Yang, Shivang Gupta, A. Adeniran, Elizabeth Mclaughlin, K. Koedinger

{"title":"When the Tutor Becomes the Student: Design and Evaluation of Efficient Scenario-based Lessons for Tutors","authors":"Danielle R. Thomas, Xinyu Yang, Shivang Gupta, A. Adeniran, Elizabeth Mclaughlin, K. Koedinger","doi":"10.1145/3576050.3576089","DOIUrl":"https://doi.org/10.1145/3576050.3576089","url":null,"abstract":"Tutoring is among the most impactful educational influences on student achievement, with perhaps the greatest promise of combating student learning loss. Due to its high impact, organizations are rapidly developing tutoring programs and discovering a common problem- a shortage of qualified, experienced tutors. This mixed methods investigation focuses on the impact of short (∼15 min.), online lessons in which tutors participate in situational judgment tests based on everyday tutoring scenarios. We developed three lessons on strategies for supporting student self-efficacy and motivation and tested them with 80 tutors from a national, online tutoring organization. Using a mixed-effects logistic regression model, we found a statistically significant learning effect indicating tutors performed about 20% higher post-instruction than pre-instruction (β = 0.811, p < 0.01). Tutors scored ∼30% better on selected compared to constructed responses at posttest with evidence that tutors are learning from selected-response questions alone. Learning analytics and qualitative feedback suggest future design modifications for larger scale deployment, such as creating more authentically challenging selected-response options, capturing common misconceptions using learnersourced data, and varying modalities of scenario delivery with the aim of maintaining learning gains while reducing time and effort for tutor participants and trainers.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121216455","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 3

How Do Teachers Use Dashboards Enhanced with Data Storytelling Elements According to their Data Visualisation Literacy Skills? 教师如何根据他们的数据可视化技能使用增强了数据讲故事元素的仪表板?

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576063

Stanislav Pozdniakov, Roberto Martínez-Maldonado, Yi-Shan Tsai, Vanessa Echeverría, Namrata Srivastava, D. Gašević

{"title":"How Do Teachers Use Dashboards Enhanced with Data Storytelling Elements According to their Data Visualisation Literacy Skills?","authors":"Stanislav Pozdniakov, Roberto Martínez-Maldonado, Yi-Shan Tsai, Vanessa Echeverría, Namrata Srivastava, D. Gašević","doi":"10.1145/3576050.3576063","DOIUrl":"https://doi.org/10.1145/3576050.3576063","url":null,"abstract":"There is a proliferation of learning analytics (LA) dashboards aimed at supporting teachers. Yet, teachers still find it challenging to make sense of LA dashboards, thereby making informed decisions. Two main strategies to address this are emerging: i) upskilling teachers’ data literacy; ii) improving the explanatory design features of current dashboards (e.g., adding visual cues or text) to minimise the skills required by teachers to effectively use dashboards. While each approach has its own trade-offs, no previous work has explored the interplay between the dashboard design and such \"data skills\". In this paper, we explore how teachers with varying visualisation literacy (VL) skills use LA dashboards enhanced with (explanatory) data storytelling elements. We conducted a quasi-experimental study with 23 teachers of varied VL inspecting two versions of an authentic multichannel dashboard enhanced with data storytelling elements. We used an eye-tracking device while teachers inspected the students’ data captured from Zoom and Google Docs, followed by interviews. Results suggest that high VL teachers adopted complex exploratory strategies and were more sensitive to subtle inconsistencies in the design; while low VL teachers benefited the most from more explicit data storytelling guidance such as accompanying complex graphs with narrative and semantic colour encoding.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128170602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Names, Nicknames, and Spelling Errors: Protecting Participant Identity in Learning Analytics of Online Discussions 姓名、昵称和拼写错误:在在线讨论的学习分析中保护参与者身份

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576070

Elaine Farrow, Johanna D. Moore, D. Gašević

{"title":"Names, Nicknames, and Spelling Errors: Protecting Participant Identity in Learning Analytics of Online Discussions","authors":"Elaine Farrow, Johanna D. Moore, D. Gašević","doi":"10.1145/3576050.3576070","DOIUrl":"https://doi.org/10.1145/3576050.3576070","url":null,"abstract":"Messages exchanged between participants in online discussion forums often contain personal names and other details that need to be redacted before the data is used for research purposes in learning analytics. However, removing the names entirely makes it harder to track the exchange of ideas between individuals within a message thread and across threads, and thereby reduces the value of this type of conversational data. In contrast, the consistent use of pseudonyms allows contributions from individuals to be tracked across messages, while also hiding the real identities of the contributors. Several factors can make it difficult to identify all instances of personal names that refer to the same individual, including spelling errors and the use of shortened forms. We developed a semi-automated approach for replacing personal names with consistent pseudonyms. We evaluated our approach on a data set of over 1,700 messages exchanged during a distance-learning course, and compared it to a general-purpose pseudonymisation tool that used deep neural networks to identify names to be redacted. We found that our tailored approach out-performed the general-purpose tool in both precision and recall, correctly identifying all but 31 substitutions out of 2,888.","PeriodicalId":394433,"journal":{"name":"LAK23: 13th International Learning Analytics and Knowledge Conference","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121572312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Blockly-DS: Blocks Programming for Data Science with Visual, Statistical, Descriptive and Predictive Analysis block - ds:基于可视化、统计、描述和预测分析的数据科学块编程

LAK23: 13th International Learning Analytics and Knowledge Conference Pub Date : 2023-03-13 DOI: 10.1145/3576050.3576097

Luiz Barboza, Rafael Mello, M. Modell, E. Teixeira

引用次数: 0