{"title":"DDRec: Dual Denoising Multimodal Graph Recommendation","authors":"Yuchao Ping;Shuqin Wang;Ziyi Yang;Bugui He;Nan Zhou;Yongquan Dong","doi":"10.1109/TCSS.2024.3490801","DOIUrl":null,"url":null,"abstract":"Multimodal recommendation systems have made significant progress by leveraging graph convolutional networks to integrate user behavior with item content, including images and text. However, these systems still encounter two major challenges: noise edges in interaction graphs and noise in multimodal features of items. Existing works tend to address only one type of noise problem to enhance recommendation performance. This article proposes a new Dual Denoising Multimodal Graph Recommendation (DDRec) model, designed to enhance multimodal recommendation systems by tackling both challenges simultaneously. Specifically, we design two denoising techniques: hard denoising and soft denoising. For noise edges in interaction graphs, the hard denoising method uses preference scores of user nodes and item nodes in different modality interaction graphs as edge weights and prunes edges below a certain threshold to eliminate noise. For noise in multimodal features, the soft denoising method leverages item and item semantic graph information to denoise modal features, thus obtaining modality features related to user preferences. Finally, we employ contrastive learning to compare user and item representations derived from the denoised modality interaction graphs against those from the original graph, ensuring the consistency of nodes across various views. Our comprehensive experiments across four public datasets validate the enhanced performance and effectiveness of the DDRec model.","PeriodicalId":13044,"journal":{"name":"IEEE Transactions on Computational Social Systems","volume":"12 3","pages":"1100-1114"},"PeriodicalIF":4.5000,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Social Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10768190/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}
引用次数: 0
Abstract
Multimodal recommendation systems have made significant progress by leveraging graph convolutional networks to integrate user behavior with item content, including images and text. However, these systems still encounter two major challenges: noise edges in interaction graphs and noise in multimodal features of items. Existing works tend to address only one type of noise problem to enhance recommendation performance. This article proposes a new Dual Denoising Multimodal Graph Recommendation (DDRec) model, designed to enhance multimodal recommendation systems by tackling both challenges simultaneously. Specifically, we design two denoising techniques: hard denoising and soft denoising. For noise edges in interaction graphs, the hard denoising method uses preference scores of user nodes and item nodes in different modality interaction graphs as edge weights and prunes edges below a certain threshold to eliminate noise. For noise in multimodal features, the soft denoising method leverages item and item semantic graph information to denoise modal features, thus obtaining modality features related to user preferences. Finally, we employ contrastive learning to compare user and item representations derived from the denoised modality interaction graphs against those from the original graph, ensuring the consistency of nodes across various views. Our comprehensive experiments across four public datasets validate the enhanced performance and effectiveness of the DDRec model.
期刊介绍:
IEEE Transactions on Computational Social Systems focuses on such topics as modeling, simulation, analysis and understanding of social systems from the quantitative and/or computational perspective. "Systems" include man-man, man-machine and machine-machine organizations and adversarial situations as well as social media structures and their dynamics. More specifically, the proposed transactions publishes articles on modeling the dynamics of social systems, methodologies for incorporating and representing socio-cultural and behavioral aspects in computational modeling, analysis of social system behavior and structure, and paradigms for social systems modeling and simulation. The journal also features articles on social network dynamics, social intelligence and cognition, social systems design and architectures, socio-cultural modeling and representation, and computational behavior modeling, and their applications.