{"title":"A global contextual enhanced structural-aware transformer for sequential recommendation","authors":"","doi":"10.1016/j.knosys.2024.112515","DOIUrl":null,"url":null,"abstract":"<div><p>Sequential recommendation (SR) has become a research hotspot recently. In our research, we observe that most existing SR models only leverage each user’s own interaction sequence to make recommendation. We argue that leveraging global contextual information across different interaction sequences could enrich item representations and thereby improve recommendation performance. To achieve this, we formulate a global graph from different sequences, providing global contextual information for each sequence. Specifically, we propose to conduct graph contrastive learning on a subgraph sampled from the global graph and a local sequence graph built from each sequence to augment item representations within each sequence. At the same time, we observe that structural dependencies, referring to relationships between items based on the graphic structure, can be extracted from the constructed global graph. Capturing structural dependencies between items may enrich the item representations. To leverage structural dependencies, we propose a new attention mechanism referred to as the Jaccard attention. While prevalent Transformer-based SR models capture semantic dependencies, referring to relationships between items based on item embeddings, in a sequence through self-attention. Therefore, it is beneficial to capture both semantic and structural dependencies between items in a sequence to further enrich item representations. Specifically, we employ two sequence encoders based on the self-attention and the proposed Jaccard attention to capture semantic and structural dependencies between items in a sequence, respectively. Overall, we propose a Global Contextual enhanced Structural-aware Transformer (GC-ST) for SR. Extensive experiments carried out on three widely used datasets demonstrate the effectiveness of GC-ST.</p></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124011493","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Sequential recommendation (SR) has become a research hotspot recently. In our research, we observe that most existing SR models only leverage each user’s own interaction sequence to make recommendation. We argue that leveraging global contextual information across different interaction sequences could enrich item representations and thereby improve recommendation performance. To achieve this, we formulate a global graph from different sequences, providing global contextual information for each sequence. Specifically, we propose to conduct graph contrastive learning on a subgraph sampled from the global graph and a local sequence graph built from each sequence to augment item representations within each sequence. At the same time, we observe that structural dependencies, referring to relationships between items based on the graphic structure, can be extracted from the constructed global graph. Capturing structural dependencies between items may enrich the item representations. To leverage structural dependencies, we propose a new attention mechanism referred to as the Jaccard attention. While prevalent Transformer-based SR models capture semantic dependencies, referring to relationships between items based on item embeddings, in a sequence through self-attention. Therefore, it is beneficial to capture both semantic and structural dependencies between items in a sequence to further enrich item representations. Specifically, we employ two sequence encoders based on the self-attention and the proposed Jaccard attention to capture semantic and structural dependencies between items in a sequence, respectively. Overall, we propose a Global Contextual enhanced Structural-aware Transformer (GC-ST) for SR. Extensive experiments carried out on three widely used datasets demonstrate the effectiveness of GC-ST.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.