{"title":"Negative sampling strategy based on multi-hop neighbors for graph representation learning","authors":"Kaiyu Zhang, Guoming Sang, Junkai Cheng, Zhi Liu, Yijia Zhang","doi":"10.1016/j.eswa.2024.125688","DOIUrl":null,"url":null,"abstract":"<div><div>Contrastive learning (CL) has recently achieved significant success in the field of recommendation system. However, current studies mainly focus on obtaining high-quality positive samples and focus less on selecting negative samples. In existing recommendation system based on graph contrastive learning, most methods select negative samples by randomly selecting samples that have not interacted with the target node. Although random negative sampling is easy to implement and has wide applicability, it may lead to problems such as unbalanced data distribution and selection of false negative samples, which can degrade model performance. To address the above issues, we propose a novel negative sampling strategy called the Multi-hop Neighbors Negative Sampling method, named NSHN. Specifically, we select the information of 3-hop neighbors of each node as candidate negative samples. In addition, to reduce the impact of false negative noise on negative samples, we propose an adaptive denoising training strategy that adaptively prunes noise interactions during training. Experimental results demonstrate that our method performs well on four datasets and outperforms graph contrastive learning methods that use random negative sampling. The source code is available at: <span><span>https://github.com/zhangkaiyu-zky/NSHN</span><svg><path></path></svg></span></div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"263 ","pages":"Article 125688"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417424025557","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Contrastive learning (CL) has recently achieved significant success in the field of recommendation system. However, current studies mainly focus on obtaining high-quality positive samples and focus less on selecting negative samples. In existing recommendation system based on graph contrastive learning, most methods select negative samples by randomly selecting samples that have not interacted with the target node. Although random negative sampling is easy to implement and has wide applicability, it may lead to problems such as unbalanced data distribution and selection of false negative samples, which can degrade model performance. To address the above issues, we propose a novel negative sampling strategy called the Multi-hop Neighbors Negative Sampling method, named NSHN. Specifically, we select the information of 3-hop neighbors of each node as candidate negative samples. In addition, to reduce the impact of false negative noise on negative samples, we propose an adaptive denoising training strategy that adaptively prunes noise interactions during training. Experimental results demonstrate that our method performs well on four datasets and outperforms graph contrastive learning methods that use random negative sampling. The source code is available at: https://github.com/zhangkaiyu-zky/NSHN
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.