{"title":"A Framework for Elastic Adaptation of User Multiple Intents in Sequential Recommendation","authors":"Zhikai Wang;Yanyan Shen","doi":"10.1109/TKDE.2024.3354796","DOIUrl":null,"url":null,"abstract":"Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ both capsule networks and self-attention techniques to effectively capture diverse underlying intents within a user's interaction sequence, thereby achieving the most advanced performance in sequential recommendation. However, users could potentially form novel intents from fresh interactions as the lengths of user interaction sequences grow. Consequently, models need to be continually updated or even extended to adeptly encompass these emerging user intents, referred as incremental multi-intent sequential recommendation. In this paper, we propose an effective \n<bold>I</b>\nncremental learning framework for user \n<bold>M</b>\nulti-intent \n<bold>A</b>\ndaptation in sequential recommendation called IMA, which augments the traditional fine-tuning strategy with the existing-intents retainer, new-intents detector, and projection-based intents trimmer to adaptively expand the model to accommodate user's new intents and prevent it from forgetting user's existing intents. Furthermore, we upgrade the IMA into an \n<bold>E</b>\nlastic \n<bold>M</b>\nulti-intent \n<bold>A</b>\ndaptation (EMA) framework which can elastically remove inactive intents and compress user intent vectors under memory space limit. Extensive experiments on real-world datasets verify the effectiveness of the proposed IMA and EMA on incremental multi-intent sequential recommendation, compared with various baselines.","PeriodicalId":13496,"journal":{"name":"IEEE Transactions on Knowledge and Data Engineering","volume":"36 12","pages":"7340-7352"},"PeriodicalIF":8.9000,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Knowledge and Data Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10400839/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Recently, substantial research has been conducted on sequential recommendation, with the objective of forecasting the subsequent item by leveraging a user's historical sequence of interacted items. Prior studies employ both capsule networks and self-attention techniques to effectively capture diverse underlying intents within a user's interaction sequence, thereby achieving the most advanced performance in sequential recommendation. However, users could potentially form novel intents from fresh interactions as the lengths of user interaction sequences grow. Consequently, models need to be continually updated or even extended to adeptly encompass these emerging user intents, referred as incremental multi-intent sequential recommendation. In this paper, we propose an effective
I
ncremental learning framework for user
M
ulti-intent
A
daptation in sequential recommendation called IMA, which augments the traditional fine-tuning strategy with the existing-intents retainer, new-intents detector, and projection-based intents trimmer to adaptively expand the model to accommodate user's new intents and prevent it from forgetting user's existing intents. Furthermore, we upgrade the IMA into an
E
lastic
M
ulti-intent
A
daptation (EMA) framework which can elastically remove inactive intents and compress user intent vectors under memory space limit. Extensive experiments on real-world datasets verify the effectiveness of the proposed IMA and EMA on incremental multi-intent sequential recommendation, compared with various baselines.
最近,人们对顺序推荐进行了大量研究,目的是利用用户的历史交互项目序列来预测后续项目。先前的研究采用了胶囊网络和自我关注技术,以有效捕捉用户交互序列中的各种潜在意图,从而实现最先进的顺序推荐性能。然而,随着用户交互序列长度的增长,用户有可能从新的交互中形成新的意图。因此,模型需要不断更新甚至扩展,以便熟练地涵盖这些新出现的用户意图,这就是增量多意图顺序推荐。在本文中,我们提出了一种有效的增量式学习框架,用于在顺序推荐中进行用户多意图适应(Multi-intent Adaptation),称为 IMA,它通过现有意图保留器、新意图检测器和基于投影的意图修剪器来增强传统的微调策略,从而自适应地扩展模型,以适应用户的新意图,并防止遗忘用户的现有意图。此外,我们还将 IMA 升级为弹性多意图适应(EMA)框架,它可以在内存空间有限的情况下弹性移除非活动意图并压缩用户意图向量。在真实数据集上进行的大量实验验证了所提出的 IMA 和 EMA 与各种基线相比在增量多意图顺序推荐上的有效性。
期刊介绍:
The IEEE Transactions on Knowledge and Data Engineering encompasses knowledge and data engineering aspects within computer science, artificial intelligence, electrical engineering, computer engineering, and related fields. It provides an interdisciplinary platform for disseminating new developments in knowledge and data engineering and explores the practicality of these concepts in both hardware and software. Specific areas covered include knowledge-based and expert systems, AI techniques for knowledge and data management, tools, and methodologies, distributed processing, real-time systems, architectures, data management practices, database design, query languages, security, fault tolerance, statistical databases, algorithms, performance evaluation, and applications.