Hairong Wang;Zhihang Yi;Zhaojing Xu;Jing Wang;Hongying Li
{"title":"偏好感知的多模态对比学习建议","authors":"Hairong Wang;Zhihang Yi;Zhaojing Xu;Jing Wang;Hongying Li","doi":"10.1109/TBDATA.2026.3668549","DOIUrl":null,"url":null,"abstract":"Multimodal recommendation systems struggle to effectively integrate heterogeneous modalities and select informative negative samples, which limits their ability to capture users’ true preferences. To address these challenges, we propose Preference-Aware Multimodal Contrastive Learning (PAMCL), a novel framework that leverages a lightweight large language model (LLM) to generate explicit user preference descriptions for guiding the recommendation process. Our approach introduces a simplified multimodal graph aggregation mechanism that unifies feature propagation and contrastive learning, enhancing semantic consistency while reducing computational complexity. Additionally, we develop a preference-guided multiple negative sampling strategy that utilizes LLM-generated preference embeddings to identify challenging negative samples while avoiding false negatives. Experimental results on three public multimodal recommendation benchmarks demonstrate that PAMCL significantly outperforms state-of-the-art methods by effectively addressing false negative issues in sampling and noise contamination in multimodal fusion.","PeriodicalId":13106,"journal":{"name":"IEEE Transactions on Big Data","volume":"12 3","pages":"1033-1044"},"PeriodicalIF":8.1000,"publicationDate":"2026-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Preference-Aware Multimodal Contrastive Learning Recommendation\",\"authors\":\"Hairong Wang;Zhihang Yi;Zhaojing Xu;Jing Wang;Hongying Li\",\"doi\":\"10.1109/TBDATA.2026.3668549\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multimodal recommendation systems struggle to effectively integrate heterogeneous modalities and select informative negative samples, which limits their ability to capture users’ true preferences. To address these challenges, we propose Preference-Aware Multimodal Contrastive Learning (PAMCL), a novel framework that leverages a lightweight large language model (LLM) to generate explicit user preference descriptions for guiding the recommendation process. Our approach introduces a simplified multimodal graph aggregation mechanism that unifies feature propagation and contrastive learning, enhancing semantic consistency while reducing computational complexity. Additionally, we develop a preference-guided multiple negative sampling strategy that utilizes LLM-generated preference embeddings to identify challenging negative samples while avoiding false negatives. Experimental results on three public multimodal recommendation benchmarks demonstrate that PAMCL significantly outperforms state-of-the-art methods by effectively addressing false negative issues in sampling and noise contamination in multimodal fusion.\",\"PeriodicalId\":13106,\"journal\":{\"name\":\"IEEE Transactions on Big Data\",\"volume\":\"12 3\",\"pages\":\"1033-1044\"},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2026-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Big Data\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11415690/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/2/27 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Big Data","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11415690/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/2/27 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Multimodal recommendation systems struggle to effectively integrate heterogeneous modalities and select informative negative samples, which limits their ability to capture users’ true preferences. To address these challenges, we propose Preference-Aware Multimodal Contrastive Learning (PAMCL), a novel framework that leverages a lightweight large language model (LLM) to generate explicit user preference descriptions for guiding the recommendation process. Our approach introduces a simplified multimodal graph aggregation mechanism that unifies feature propagation and contrastive learning, enhancing semantic consistency while reducing computational complexity. Additionally, we develop a preference-guided multiple negative sampling strategy that utilizes LLM-generated preference embeddings to identify challenging negative samples while avoiding false negatives. Experimental results on three public multimodal recommendation benchmarks demonstrate that PAMCL significantly outperforms state-of-the-art methods by effectively addressing false negative issues in sampling and noise contamination in multimodal fusion.
期刊介绍:
The IEEE Transactions on Big Data publishes peer-reviewed articles focusing on big data. These articles present innovative research ideas and application results across disciplines, including novel theories, algorithms, and applications. Research areas cover a wide range, such as big data analytics, visualization, curation, management, semantics, infrastructure, standards, performance analysis, intelligence extraction, scientific discovery, security, privacy, and legal issues specific to big data. The journal also prioritizes applications of big data in fields generating massive datasets.