{"title":"图神经网络的动态模糊采样器","authors":"Jia Wei;Xingjun Zhang;Witold Pedrycz;Weiping Ding","doi":"10.1109/TFUZZ.2024.3509018","DOIUrl":null,"url":null,"abstract":"Graph Neural Networks (GNNs) are widely used across fields, with inductive learning replacing transductive learning as the mainstream training paradigm due to its superior memory efficiency, computation speed, and generalization. Neighbor node sampling, a key step in inductive learning, is critical to model performance. However, existing samplers focus only on adjacency matrix-based sampling, neglecting the varying impacts of different neighbors on target nodes over time. They usually aggregate the neighbor information in a simple way such as averaging or summing, which limits the information representation, robustness, and generalization. To address these limitations, we propose a Dynamic Fuzzy Sampler (DFS) based on a Gaussian fuzzy system. DFS accounts for node diversity and models the uncertainties and fuzziness in neighbor-target mutual information dynamically. Specifically, DFS first innovatively constructs a learnable Gaussian fuzzy set system for determining the membership degree of different neighbors to the target node at different moments. Subsequently, DFS aggregates the target node embeddings and membership-weighted neighbor embeddings to update the target node's features, which makes the target node utilize the sampling information more effectively. The aggregated target node effectively captures the graph structure information and neighbor node information, which can facilitate the subsequent graph neural network-based graph representation model with stronger representation and generalization capabilities. Experimental results on supervised and self-supervised graph datasets demonstrate that DFS consistently outperforms state-of-the-art sampling schemes. DFS achieves up to 1.90% and 9.52% F1-score improvement compared to the state-of-the-art schemes on small- and large-scale graphs, respectively.","PeriodicalId":13212,"journal":{"name":"IEEE Transactions on Fuzzy Systems","volume":"33 4","pages":"1357-1368"},"PeriodicalIF":10.7000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dynamic Fuzzy Sampler for Graph Neural Networks\",\"authors\":\"Jia Wei;Xingjun Zhang;Witold Pedrycz;Weiping Ding\",\"doi\":\"10.1109/TFUZZ.2024.3509018\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Graph Neural Networks (GNNs) are widely used across fields, with inductive learning replacing transductive learning as the mainstream training paradigm due to its superior memory efficiency, computation speed, and generalization. Neighbor node sampling, a key step in inductive learning, is critical to model performance. However, existing samplers focus only on adjacency matrix-based sampling, neglecting the varying impacts of different neighbors on target nodes over time. They usually aggregate the neighbor information in a simple way such as averaging or summing, which limits the information representation, robustness, and generalization. To address these limitations, we propose a Dynamic Fuzzy Sampler (DFS) based on a Gaussian fuzzy system. DFS accounts for node diversity and models the uncertainties and fuzziness in neighbor-target mutual information dynamically. Specifically, DFS first innovatively constructs a learnable Gaussian fuzzy set system for determining the membership degree of different neighbors to the target node at different moments. Subsequently, DFS aggregates the target node embeddings and membership-weighted neighbor embeddings to update the target node's features, which makes the target node utilize the sampling information more effectively. The aggregated target node effectively captures the graph structure information and neighbor node information, which can facilitate the subsequent graph neural network-based graph representation model with stronger representation and generalization capabilities. Experimental results on supervised and self-supervised graph datasets demonstrate that DFS consistently outperforms state-of-the-art sampling schemes. DFS achieves up to 1.90% and 9.52% F1-score improvement compared to the state-of-the-art schemes on small- and large-scale graphs, respectively.\",\"PeriodicalId\":13212,\"journal\":{\"name\":\"IEEE Transactions on Fuzzy Systems\",\"volume\":\"33 4\",\"pages\":\"1357-1368\"},\"PeriodicalIF\":10.7000,\"publicationDate\":\"2025-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Fuzzy Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10827821/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Fuzzy Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10827821/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Graph Neural Networks (GNNs) are widely used across fields, with inductive learning replacing transductive learning as the mainstream training paradigm due to its superior memory efficiency, computation speed, and generalization. Neighbor node sampling, a key step in inductive learning, is critical to model performance. However, existing samplers focus only on adjacency matrix-based sampling, neglecting the varying impacts of different neighbors on target nodes over time. They usually aggregate the neighbor information in a simple way such as averaging or summing, which limits the information representation, robustness, and generalization. To address these limitations, we propose a Dynamic Fuzzy Sampler (DFS) based on a Gaussian fuzzy system. DFS accounts for node diversity and models the uncertainties and fuzziness in neighbor-target mutual information dynamically. Specifically, DFS first innovatively constructs a learnable Gaussian fuzzy set system for determining the membership degree of different neighbors to the target node at different moments. Subsequently, DFS aggregates the target node embeddings and membership-weighted neighbor embeddings to update the target node's features, which makes the target node utilize the sampling information more effectively. The aggregated target node effectively captures the graph structure information and neighbor node information, which can facilitate the subsequent graph neural network-based graph representation model with stronger representation and generalization capabilities. Experimental results on supervised and self-supervised graph datasets demonstrate that DFS consistently outperforms state-of-the-art sampling schemes. DFS achieves up to 1.90% and 9.52% F1-score improvement compared to the state-of-the-art schemes on small- and large-scale graphs, respectively.
期刊介绍:
The IEEE Transactions on Fuzzy Systems is a scholarly journal that focuses on the theory, design, and application of fuzzy systems. It aims to publish high-quality technical papers that contribute significant technical knowledge and exploratory developments in the field of fuzzy systems. The journal particularly emphasizes engineering systems and scientific applications. In addition to research articles, the Transactions also includes a letters section featuring current information, comments, and rebuttals related to published papers.