Jianfang Liu , Baolin Yi , Huanyu Zhang , Xiaoxuan Shen , Lingling Song , Yu Lei , Hao Zheng
{"title":"使用llm增强的语义表示建模,用于知识感知推荐","authors":"Jianfang Liu , Baolin Yi , Huanyu Zhang , Xiaoxuan Shen , Lingling Song , Yu Lei , Hao Zheng","doi":"10.1016/j.ipm.2025.104387","DOIUrl":null,"url":null,"abstract":"<div><div>Knowledge graph-based recommendation systems utilize structured entity and relation representations to better model user preferences. However, many traditional approaches rely primarily on ID-based data and often overlook textual information associated with items and relations, leading to limited semantic understanding. While recent approaches have begun incorporating large language models (LLMs), most focus solely on enhancing relational embeddings and fail to fully exploit the semantic extraction capabilities of LLMs. To address these limitations, we propose <em><u>LLMKnowRec</u></em>, a novel LLM-enhanced, knowledge-aware recommendation framework designed to improve the semantic modeling of knowledge graphs. Our approach integrates the powerful language understanding abilities of LLMs with traditional ID-based recommendation by introducing an LLM-based embedding generator. This generator produces semantically rich embeddings using textual descriptions of user profiles and knowledge graph relations. Building on this, we further introduce a semantic user intent modeling module, which leverages LLMs to aggregate multiple intent signals into comprehensive, semantically enriched intent embeddings. Additionally, we develop a relational intent-aware aggregation scheme that effectively combines higher-order representations, capturing both relational structures and user intent, thus enhancing the overall semantic understanding of users and items. Experimental conducted on three public benchmark datasets demonstrate that <em>LLMKnowRec</em> consistently outperforms state-of-the-art methods. Specifically, our model achieves improvements of up to 12.92%, 19.27%, and 8.23% in NDCG@10, and up to 13.41%, 15.62%, and 23.55% in Recall@10 across the three datasets, respectively. These results demonstrate the effectiveness and practical potential of our proposed method. The implementation code is publicly available at: <span><span>https://github.com/liujianfang2021/LLMKnowRec</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"63 2","pages":"Article 104387"},"PeriodicalIF":6.9000,"publicationDate":"2025-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Modeling semantic representation with LLM-enhanced for knowledge-aware recommendation\",\"authors\":\"Jianfang Liu , Baolin Yi , Huanyu Zhang , Xiaoxuan Shen , Lingling Song , Yu Lei , Hao Zheng\",\"doi\":\"10.1016/j.ipm.2025.104387\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Knowledge graph-based recommendation systems utilize structured entity and relation representations to better model user preferences. However, many traditional approaches rely primarily on ID-based data and often overlook textual information associated with items and relations, leading to limited semantic understanding. While recent approaches have begun incorporating large language models (LLMs), most focus solely on enhancing relational embeddings and fail to fully exploit the semantic extraction capabilities of LLMs. To address these limitations, we propose <em><u>LLMKnowRec</u></em>, a novel LLM-enhanced, knowledge-aware recommendation framework designed to improve the semantic modeling of knowledge graphs. Our approach integrates the powerful language understanding abilities of LLMs with traditional ID-based recommendation by introducing an LLM-based embedding generator. This generator produces semantically rich embeddings using textual descriptions of user profiles and knowledge graph relations. Building on this, we further introduce a semantic user intent modeling module, which leverages LLMs to aggregate multiple intent signals into comprehensive, semantically enriched intent embeddings. Additionally, we develop a relational intent-aware aggregation scheme that effectively combines higher-order representations, capturing both relational structures and user intent, thus enhancing the overall semantic understanding of users and items. Experimental conducted on three public benchmark datasets demonstrate that <em>LLMKnowRec</em> consistently outperforms state-of-the-art methods. Specifically, our model achieves improvements of up to 12.92%, 19.27%, and 8.23% in NDCG@10, and up to 13.41%, 15.62%, and 23.55% in Recall@10 across the three datasets, respectively. These results demonstrate the effectiveness and practical potential of our proposed method. The implementation code is publicly available at: <span><span>https://github.com/liujianfang2021/LLMKnowRec</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":50365,\"journal\":{\"name\":\"Information Processing & Management\",\"volume\":\"63 2\",\"pages\":\"Article 104387\"},\"PeriodicalIF\":6.9000,\"publicationDate\":\"2025-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Processing & Management\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0306457325003280\",\"RegionNum\":1,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457325003280","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Modeling semantic representation with LLM-enhanced for knowledge-aware recommendation
Knowledge graph-based recommendation systems utilize structured entity and relation representations to better model user preferences. However, many traditional approaches rely primarily on ID-based data and often overlook textual information associated with items and relations, leading to limited semantic understanding. While recent approaches have begun incorporating large language models (LLMs), most focus solely on enhancing relational embeddings and fail to fully exploit the semantic extraction capabilities of LLMs. To address these limitations, we propose LLMKnowRec, a novel LLM-enhanced, knowledge-aware recommendation framework designed to improve the semantic modeling of knowledge graphs. Our approach integrates the powerful language understanding abilities of LLMs with traditional ID-based recommendation by introducing an LLM-based embedding generator. This generator produces semantically rich embeddings using textual descriptions of user profiles and knowledge graph relations. Building on this, we further introduce a semantic user intent modeling module, which leverages LLMs to aggregate multiple intent signals into comprehensive, semantically enriched intent embeddings. Additionally, we develop a relational intent-aware aggregation scheme that effectively combines higher-order representations, capturing both relational structures and user intent, thus enhancing the overall semantic understanding of users and items. Experimental conducted on three public benchmark datasets demonstrate that LLMKnowRec consistently outperforms state-of-the-art methods. Specifically, our model achieves improvements of up to 12.92%, 19.27%, and 8.23% in NDCG@10, and up to 13.41%, 15.62%, and 23.55% in Recall@10 across the three datasets, respectively. These results demonstrate the effectiveness and practical potential of our proposed method. The implementation code is publicly available at: https://github.com/liujianfang2021/LLMKnowRec.
期刊介绍:
Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing.
We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.