Normalizing flow-enhanced Gaussian embedding for few-shot knowledge graph completion

IF 7.2 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Xu Yuan , Long Chen , Jiaqiang Wang , Yi Guo , Zhengnan Gao , Liang Zhao
{"title":"Normalizing flow-enhanced Gaussian embedding for few-shot knowledge graph completion","authors":"Xu Yuan ,&nbsp;Long Chen ,&nbsp;Jiaqiang Wang ,&nbsp;Yi Guo ,&nbsp;Zhengnan Gao ,&nbsp;Liang Zhao","doi":"10.1016/j.knosys.2025.113874","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives:</h3><div>Few-shot knowledge graph completion (FKGC) aims to infer missing facts of the query triples based on few-shot reference entity pairs. However, existing FKGC approaches often overlook the inherent uncertainty of relations in KGs, as deterministic semantic representations derived from sparse samples may be unreliable. Meanwhile, they neglect both noisy neighbor aggregation and inter-neighbor interactions, as well as the handling of complex relations, which largely limits model performance. This paper aims to overcome these limitations and enhance FKGC performance.</div></div><div><h3>Methods:</h3><div>This paper proposes a method incorporated normalizing flow with Gaussian Network for FKGC, namely NFGN. Specifically, we combine normalizing flow-enhanced Gaussian distribution to model the few-shot settings and multi-semantics uncertainty of relations, which learns the uncertain semantics of entity features based on limited data. Then, we introduce the GD-TransE decoder, which incorporates relation uncertainty to handle complex relations. To improve the model’s effectiveness, a gated neighbor encoder is designed to model semantic interactions among neighbors, and control the activation of noisy neighbors through gating thresholds.</div></div><div><h3>Novelty:</h3><div>This paper presents the first study that integrates normalizing flows with Gaussian embeddings for FKGC, offering a more robust representation of uncertainty in relations. The proposed method further introduces the gated neighbor encoder and GD-TransE decoder to handle neighborhood noise and complex relationships, thereby overcoming the limitations of existing FKGC methods.</div></div><div><h3>Findings:</h3><div>Extensive experiments conducted on three diverse benchmark datasets demonstrate that our method significantly outperforms state-of-the-art performance, achieving improvements of 5.7%, 2.4%, 10.6%, and 6.7% in MRR, Hits@1, Hits@5, and Hits@10, respectively.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"324 ","pages":"Article 113874"},"PeriodicalIF":7.2000,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125009207","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives:

Few-shot knowledge graph completion (FKGC) aims to infer missing facts of the query triples based on few-shot reference entity pairs. However, existing FKGC approaches often overlook the inherent uncertainty of relations in KGs, as deterministic semantic representations derived from sparse samples may be unreliable. Meanwhile, they neglect both noisy neighbor aggregation and inter-neighbor interactions, as well as the handling of complex relations, which largely limits model performance. This paper aims to overcome these limitations and enhance FKGC performance.

Methods:

This paper proposes a method incorporated normalizing flow with Gaussian Network for FKGC, namely NFGN. Specifically, we combine normalizing flow-enhanced Gaussian distribution to model the few-shot settings and multi-semantics uncertainty of relations, which learns the uncertain semantics of entity features based on limited data. Then, we introduce the GD-TransE decoder, which incorporates relation uncertainty to handle complex relations. To improve the model’s effectiveness, a gated neighbor encoder is designed to model semantic interactions among neighbors, and control the activation of noisy neighbors through gating thresholds.

Novelty:

This paper presents the first study that integrates normalizing flows with Gaussian embeddings for FKGC, offering a more robust representation of uncertainty in relations. The proposed method further introduces the gated neighbor encoder and GD-TransE decoder to handle neighborhood noise and complex relationships, thereby overcoming the limitations of existing FKGC methods.

Findings:

Extensive experiments conducted on three diverse benchmark datasets demonstrate that our method significantly outperforms state-of-the-art performance, achieving improvements of 5.7%, 2.4%, 10.6%, and 6.7% in MRR, Hits@1, Hits@5, and Hits@10, respectively.
归一化流增强高斯嵌入的少镜头知识图补全
目的:基于少量参考实体对的知识图谱补全技术(FKGC)旨在推断查询三元组中缺失的事实。然而,现有的FKGC方法往往忽略了KGs中关系的固有不确定性,因为从稀疏样本中获得的确定性语义表示可能是不可靠的。同时,它们忽略了噪声邻居聚集和邻居之间的相互作用,以及复杂关系的处理,这在很大程度上限制了模型的性能。本文旨在克服这些限制,提高FKGC的性能。方法:本文提出了一种结合高斯网络归一化流程的FKGC (NFGN)方法。具体来说,我们结合归一化流增强高斯分布对关系的少镜头设置和多语义不确定性进行建模,在有限的数据基础上学习实体特征的不确定性语义。然后,我们引入了结合关系不确定性来处理复杂关系的GD-TransE解码器。为了提高模型的有效性,设计了一个门控邻居编码器来模拟邻居之间的语义交互,并通过门控阈值控制噪声邻居的激活。新颖性:本文提出了第一个将FKGC的归一化流与高斯嵌入相结合的研究,为关系中的不确定性提供了更强大的表示。该方法进一步引入门控邻居编码器和GD-TransE解码器来处理邻居噪声和复杂关系,从而克服了现有FKGC方法的局限性。研究结果:在三个不同的基准数据集上进行的大量实验表明,我们的方法显著优于最先进的性能,在MRR, Hits@1, Hits@5和Hits@10分别实现了5.7%,2.4%,10.6%和6.7%的改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Knowledge-Based Systems
Knowledge-Based Systems 工程技术-计算机:人工智能
CiteScore
14.80
自引率
12.50%
发文量
1245
审稿时长
7.8 months
期刊介绍: Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信