Han Chen , Yuhua Li , Philip S. Yu , Yixiong Zou , Ruixuan Li
{"title":"DCMSL:双重影响社区强度增强多尺度图对比学习","authors":"Han Chen , Yuhua Li , Philip S. Yu , Yixiong Zou , Ruixuan Li","doi":"10.1016/j.knosys.2024.112472","DOIUrl":null,"url":null,"abstract":"<div><p>Graph Contrastive Learning (GCL) effectively mitigates label dependency, defining positive and negative pairs for node embeddings. Nevertheless, most GCL methods, including those considering communities, overlooking the simultaneous influence of community and node—a crucial factor for accurate embeddings. In this paper, we propose <strong>D</strong>ual influenced <strong>C</strong>ommunity Strength-boosted <strong>M</strong>ulti-<strong>S</strong>cale Graph Contrastive <strong>L</strong>earning (DCMSL), concurrently considering community and node influence for comprehensive contrastive learning. Firstly, we define dual influenced community strength which can be adaptable to diverse datasets. Based on it, we define node cruciality to differentiate node importance. Secondly, two graph data augmentation methods, NCNAM and NCED, respectively, are put forward based on node cruciality, guiding graph augmentation to preserve more influential semantic information. Thirdly, a joint multi-scale graph contrastive scheme is raised to guide the graph encoder to learn data semantic information at two scales: (1) Propulsive force node-level graph contrastive learning—a node-level graph contrastive loss defining the force to push negative pairs in GCL farther away. (2) Community-level graph contrastive learning—enabling the graph encoder to learn from data on the community level, improving model performance. DCMSL achieves state-of-the-art results, demonstrating its effectiveness and versatility in two node-level tasks: node classification and node clustering and one edge-level task: link prediction. Our code is available at: <span><span>https://github.com/HanChen-HUST/DCMSL</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DCMSL: Dual influenced community strength-boosted multi-scale graph contrastive learning\",\"authors\":\"Han Chen , Yuhua Li , Philip S. Yu , Yixiong Zou , Ruixuan Li\",\"doi\":\"10.1016/j.knosys.2024.112472\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Graph Contrastive Learning (GCL) effectively mitigates label dependency, defining positive and negative pairs for node embeddings. Nevertheless, most GCL methods, including those considering communities, overlooking the simultaneous influence of community and node—a crucial factor for accurate embeddings. In this paper, we propose <strong>D</strong>ual influenced <strong>C</strong>ommunity Strength-boosted <strong>M</strong>ulti-<strong>S</strong>cale Graph Contrastive <strong>L</strong>earning (DCMSL), concurrently considering community and node influence for comprehensive contrastive learning. Firstly, we define dual influenced community strength which can be adaptable to diverse datasets. Based on it, we define node cruciality to differentiate node importance. Secondly, two graph data augmentation methods, NCNAM and NCED, respectively, are put forward based on node cruciality, guiding graph augmentation to preserve more influential semantic information. Thirdly, a joint multi-scale graph contrastive scheme is raised to guide the graph encoder to learn data semantic information at two scales: (1) Propulsive force node-level graph contrastive learning—a node-level graph contrastive loss defining the force to push negative pairs in GCL farther away. (2) Community-level graph contrastive learning—enabling the graph encoder to learn from data on the community level, improving model performance. DCMSL achieves state-of-the-art results, demonstrating its effectiveness and versatility in two node-level tasks: node classification and node clustering and one edge-level task: link prediction. Our code is available at: <span><span>https://github.com/HanChen-HUST/DCMSL</span><svg><path></path></svg></span>.</p></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-09-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705124011067\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124011067","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
DCMSL: Dual influenced community strength-boosted multi-scale graph contrastive learning
Graph Contrastive Learning (GCL) effectively mitigates label dependency, defining positive and negative pairs for node embeddings. Nevertheless, most GCL methods, including those considering communities, overlooking the simultaneous influence of community and node—a crucial factor for accurate embeddings. In this paper, we propose Dual influenced Community Strength-boosted Multi-Scale Graph Contrastive Learning (DCMSL), concurrently considering community and node influence for comprehensive contrastive learning. Firstly, we define dual influenced community strength which can be adaptable to diverse datasets. Based on it, we define node cruciality to differentiate node importance. Secondly, two graph data augmentation methods, NCNAM and NCED, respectively, are put forward based on node cruciality, guiding graph augmentation to preserve more influential semantic information. Thirdly, a joint multi-scale graph contrastive scheme is raised to guide the graph encoder to learn data semantic information at two scales: (1) Propulsive force node-level graph contrastive learning—a node-level graph contrastive loss defining the force to push negative pairs in GCL farther away. (2) Community-level graph contrastive learning—enabling the graph encoder to learn from data on the community level, improving model performance. DCMSL achieves state-of-the-art results, demonstrating its effectiveness and versatility in two node-level tasks: node classification and node clustering and one edge-level task: link prediction. Our code is available at: https://github.com/HanChen-HUST/DCMSL.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.