{"title":"Inductive relation prediction with information bottleneck","authors":"","doi":"10.1016/j.neucom.2024.128503","DOIUrl":null,"url":null,"abstract":"<div><p>Inductive relation prediction is an important learning task for knowledge graph completion that aims to infer new facts from existing ones. Previous works that focus on path-based are naturally limited in expressive. The methods based on graph neural network framework consider all paths thus improving the performance. However, fusing all paths information may extract features that are spuriously correlated with the prediction. By analogy to the human reasoning process, we observe that only a small subset of the critical paths determine the prediction. In this work, we propose a novel framework that extracts such critical paths to make inductive relation prediction on <strong>K</strong>nowledge <strong>G</strong>raph with <strong>G</strong>raph <strong>I</strong>nformation <strong>B</strong>ottleneck (<strong>KG-GIB</strong>). KG-GIB is the first attempt to advance the Graph Information Bottleneck (GIB) for inductive relation prediction. Derived from the GIB principle, KG-GIB extracts critical paths which preserves task-relevant paths and blocks information from task-irrelevant paths. The extracted critical paths are expected to be more generalizable and interpretable. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of KG-GIB.</p></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":null,"pages":null},"PeriodicalIF":5.5000,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224012748","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Inductive relation prediction is an important learning task for knowledge graph completion that aims to infer new facts from existing ones. Previous works that focus on path-based are naturally limited in expressive. The methods based on graph neural network framework consider all paths thus improving the performance. However, fusing all paths information may extract features that are spuriously correlated with the prediction. By analogy to the human reasoning process, we observe that only a small subset of the critical paths determine the prediction. In this work, we propose a novel framework that extracts such critical paths to make inductive relation prediction on Knowledge Graph with Graph Information Bottleneck (KG-GIB). KG-GIB is the first attempt to advance the Graph Information Bottleneck (GIB) for inductive relation prediction. Derived from the GIB principle, KG-GIB extracts critical paths which preserves task-relevant paths and blocks information from task-irrelevant paths. The extracted critical paths are expected to be more generalizable and interpretable. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of KG-GIB.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.