Sequential contrastive learning for progressive knowledge tracing

IF 7.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Yi-Fei Wen , Hang Liang , Carl Yang , Tao Zhou , Jia Liu , Yajun Du , Yan-Li Lee
{"title":"Sequential contrastive learning for progressive knowledge tracing","authors":"Yi-Fei Wen ,&nbsp;Hang Liang ,&nbsp;Carl Yang ,&nbsp;Tao Zhou ,&nbsp;Jia Liu ,&nbsp;Yajun Du ,&nbsp;Yan-Li Lee","doi":"10.1016/j.knosys.2025.114413","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, knowledge tracing has received significant attention in personalized education. It dynamically assesses users’ knowledge states based on their historical response sequence. User response sequences are central to knowledge tracing. While most studies focus on modeling short-term and long-term dependencies, few consider the order in which interactions occur. A recent study argues that the interaction order has little impact on users’ knowledge states (Lee <em>et al.</em>, The Web Conference, 2022), which contradicts both our intuition and constructivist learning theory. To address this contradiction, we propose a <strong>S</strong>equential Contrastive Learning algorithm for <strong>P</strong>rogressive <strong>K</strong>nowledge <strong>T</strong>racing, termed <strong>SPKT</strong>, to test the effectiveness of order information within the response sequences for assessing users’ knowledge states. SPKT embeds order information into the response sequence representation through a carefully designed contrastive learning module, and captures users’ monotonic memory decay patterns using a carefully designed non-symmetrical augmented view construction method. The enhanced sequence representation is subsequently utilized to decode user behavior with a progressive learning process module. Extensive experiments demonstrate that, on average, SPKT outperforms 10 baselines by up to 14 % in AUC and 8 % in ACC across 6 real-world datasets. Furthermore, the results highlight that the order information in response sequences significantly improves algorithmic performance-sometimes even more than the correctness of the responses themselves. Moreover, SPKT more accurately evaluates users with better academic performance and shorter learning sequences. For the same user, longer response sequences are more helpful in assessing a user’s knowledge state.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"329 ","pages":"Article 114413"},"PeriodicalIF":7.6000,"publicationDate":"2025-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125014522","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, knowledge tracing has received significant attention in personalized education. It dynamically assesses users’ knowledge states based on their historical response sequence. User response sequences are central to knowledge tracing. While most studies focus on modeling short-term and long-term dependencies, few consider the order in which interactions occur. A recent study argues that the interaction order has little impact on users’ knowledge states (Lee et al., The Web Conference, 2022), which contradicts both our intuition and constructivist learning theory. To address this contradiction, we propose a Sequential Contrastive Learning algorithm for Progressive Knowledge Tracing, termed SPKT, to test the effectiveness of order information within the response sequences for assessing users’ knowledge states. SPKT embeds order information into the response sequence representation through a carefully designed contrastive learning module, and captures users’ monotonic memory decay patterns using a carefully designed non-symmetrical augmented view construction method. The enhanced sequence representation is subsequently utilized to decode user behavior with a progressive learning process module. Extensive experiments demonstrate that, on average, SPKT outperforms 10 baselines by up to 14 % in AUC and 8 % in ACC across 6 real-world datasets. Furthermore, the results highlight that the order information in response sequences significantly improves algorithmic performance-sometimes even more than the correctness of the responses themselves. Moreover, SPKT more accurately evaluates users with better academic performance and shorter learning sequences. For the same user, longer response sequences are more helpful in assessing a user’s knowledge state.
递进式知识追踪的顺序对比学习
近年来,知识溯源在个性化教育中受到广泛关注。它根据用户的历史响应顺序动态评估用户的知识状态。用户响应序列是知识跟踪的核心。虽然大多数研究关注的是短期和长期依赖关系的建模,但很少有人考虑到相互作用发生的顺序。最近的一项研究认为,交互顺序对用户的知识状态几乎没有影响(Lee et al., the Web Conference, 2022),这与我们的直觉和建构主义学习理论相矛盾。为了解决这一矛盾,我们提出了一种用于渐进式知识跟踪的顺序对比学习算法,称为SPKT,以测试响应序列中顺序信息评估用户知识状态的有效性。SPKT通过精心设计的对比学习模块将有序信息嵌入到响应序列表示中,并使用精心设计的非对称增强视图构建方法捕获用户的单调记忆衰减模式。随后,利用增强的序列表示通过渐进学习过程模块解码用户行为。广泛的实验表明,在6个真实数据集中,SPKT在AUC和ACC上的平均表现分别比10个基线高出14%和8%。此外,结果强调,响应序列中的顺序信息显着提高了算法性能,有时甚至比响应本身的正确性更重要。此外,SPKT更准确地评估了学习成绩更好、学习时间更短的用户。对于同一用户,较长的响应序列更有助于评估用户的知识状态。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Knowledge-Based Systems
Knowledge-Based Systems 工程技术-计算机:人工智能
CiteScore
14.80
自引率
12.50%
发文量
1245
审稿时长
7.8 months
期刊介绍: Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信