Shuxu Chen, Yuanyuan Liu, Chao Che, Ziqi Wei, Zhaoqian Zhong
{"title":"DualCFGL:双通道融合全局和本地功能,用于顺序推荐","authors":"Shuxu Chen, Yuanyuan Liu, Chao Che, Ziqi Wei, Zhaoqian Zhong","doi":"10.1007/s40747-024-01734-3","DOIUrl":null,"url":null,"abstract":"<p>Sequential recommendation systems capture the dynamic interests of users and predict their future preferences. A noteworthy problem in sequential recommendation is coping with the intrinsic changes of user interests. The sequence of user interactions is generated by more than a single and stable global preference, users may have interest drift that occur in a short period of time. We call this short-term interest drift as the local preference of users, which is often a key factor affecting the final choice of users. However, existing methods have limitations in observing local preferences, which leads to an incomplete consideration of the local preferences. Moreover, using a single model to represent global–local preferences obscure the distinct features of each, limiting the potential synergistic benefits. To alleviate the above limitations, we propose a novel model with a dual-channel structure to monitor both global and local preferences and ensure they complement each other. The model extracts the global preferences of users with a bidirectional Transformer using random masking and a sliding window, and extracts the local preferences with a patch-based stacked bottleneck residual convolution. To enable the model to consider both the global and local preferences of users, we design an adaptive orthogonal fusion module, which effectively fuses the two preferences and enables the two feature types to complement and enhance each other. We integrate the fused user preferences with a knowledge distillation method that further improves the model’s expressive ability. We conduct extensive experiments on three widely used datasets, and the results show that our model outperforms current state-of-the-art models.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":"5 1","pages":""},"PeriodicalIF":5.0000,"publicationDate":"2024-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DualCFGL: dual-channel fusion global and local features for sequential recommendation\",\"authors\":\"Shuxu Chen, Yuanyuan Liu, Chao Che, Ziqi Wei, Zhaoqian Zhong\",\"doi\":\"10.1007/s40747-024-01734-3\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Sequential recommendation systems capture the dynamic interests of users and predict their future preferences. A noteworthy problem in sequential recommendation is coping with the intrinsic changes of user interests. The sequence of user interactions is generated by more than a single and stable global preference, users may have interest drift that occur in a short period of time. We call this short-term interest drift as the local preference of users, which is often a key factor affecting the final choice of users. However, existing methods have limitations in observing local preferences, which leads to an incomplete consideration of the local preferences. Moreover, using a single model to represent global–local preferences obscure the distinct features of each, limiting the potential synergistic benefits. To alleviate the above limitations, we propose a novel model with a dual-channel structure to monitor both global and local preferences and ensure they complement each other. The model extracts the global preferences of users with a bidirectional Transformer using random masking and a sliding window, and extracts the local preferences with a patch-based stacked bottleneck residual convolution. To enable the model to consider both the global and local preferences of users, we design an adaptive orthogonal fusion module, which effectively fuses the two preferences and enables the two feature types to complement and enhance each other. We integrate the fused user preferences with a knowledge distillation method that further improves the model’s expressive ability. We conduct extensive experiments on three widely used datasets, and the results show that our model outperforms current state-of-the-art models.</p>\",\"PeriodicalId\":10524,\"journal\":{\"name\":\"Complex & Intelligent Systems\",\"volume\":\"5 1\",\"pages\":\"\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-12-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Complex & Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s40747-024-01734-3\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-024-01734-3","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
DualCFGL: dual-channel fusion global and local features for sequential recommendation
Sequential recommendation systems capture the dynamic interests of users and predict their future preferences. A noteworthy problem in sequential recommendation is coping with the intrinsic changes of user interests. The sequence of user interactions is generated by more than a single and stable global preference, users may have interest drift that occur in a short period of time. We call this short-term interest drift as the local preference of users, which is often a key factor affecting the final choice of users. However, existing methods have limitations in observing local preferences, which leads to an incomplete consideration of the local preferences. Moreover, using a single model to represent global–local preferences obscure the distinct features of each, limiting the potential synergistic benefits. To alleviate the above limitations, we propose a novel model with a dual-channel structure to monitor both global and local preferences and ensure they complement each other. The model extracts the global preferences of users with a bidirectional Transformer using random masking and a sliding window, and extracts the local preferences with a patch-based stacked bottleneck residual convolution. To enable the model to consider both the global and local preferences of users, we design an adaptive orthogonal fusion module, which effectively fuses the two preferences and enables the two feature types to complement and enhance each other. We integrate the fused user preferences with a knowledge distillation method that further improves the model’s expressive ability. We conduct extensive experiments on three widely used datasets, and the results show that our model outperforms current state-of-the-art models.
期刊介绍:
Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.