EHPR: Learning evolutionary hierarchy perception representation based on quaternion for temporal knowledge graph completion

IF 8.1 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS
{"title":"EHPR: Learning evolutionary hierarchy perception representation based on quaternion for temporal knowledge graph completion","authors":"","doi":"10.1016/j.ins.2024.121409","DOIUrl":null,"url":null,"abstract":"<div><p>Research on temporal knowledge graphs garners attention due to the intricate connection between facts and dynamic temporal factors. However, existing research uses timestamp as auxiliary data for representation learning and directly integrate it into facts, resulting in the inability to capture the intrinsic connections between relations under time evolution. To handle these challenges, we propose the <strong>E</strong>volutionary <strong>H</strong>ierarchy <strong>P</strong>erception <strong>R</strong>epresentation (EHPR), which first leverages the Hamilton product to perform rotational transformations on relation and entity over time, aiming to learn temporal relation and temporal entity with close interactions with time information. Later, EHPR is divided into two modules: (a) Rotating the head entity towards the tail entity using temporal relation through Hamilton product to model complex patterns with quaternion rotation capabilities. (b) Adopting an evolutionary hierarchical factor to capture the differences in modulus distribution between the temporal head entity and the temporal tail entity, aiming to manage the evolutionary hierarchical information between different temporal entities. In this way, EHPR not only utilizes the rich quaternion rotation capabilities to model various relation patterns but also further enables modeling of evolutionary hierarchical patterns through evolutionary hierarchy factors. Experiments show that EHPR achieves remarkable performance on six mature benchmarks compared to state-of-the-art models. Furthermore, we successfully transferred the core idea of EHPR into complex embeddings, showcasing the framework's adaptability. Compared to complex embedding models, EHPR also demonstrates stronger expressive abilities with the Hamilton operator, surpassing the performance of complex Hermitian operator.</p></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":null,"pages":null},"PeriodicalIF":8.1000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025524013239","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Research on temporal knowledge graphs garners attention due to the intricate connection between facts and dynamic temporal factors. However, existing research uses timestamp as auxiliary data for representation learning and directly integrate it into facts, resulting in the inability to capture the intrinsic connections between relations under time evolution. To handle these challenges, we propose the Evolutionary Hierarchy Perception Representation (EHPR), which first leverages the Hamilton product to perform rotational transformations on relation and entity over time, aiming to learn temporal relation and temporal entity with close interactions with time information. Later, EHPR is divided into two modules: (a) Rotating the head entity towards the tail entity using temporal relation through Hamilton product to model complex patterns with quaternion rotation capabilities. (b) Adopting an evolutionary hierarchical factor to capture the differences in modulus distribution between the temporal head entity and the temporal tail entity, aiming to manage the evolutionary hierarchical information between different temporal entities. In this way, EHPR not only utilizes the rich quaternion rotation capabilities to model various relation patterns but also further enables modeling of evolutionary hierarchical patterns through evolutionary hierarchy factors. Experiments show that EHPR achieves remarkable performance on six mature benchmarks compared to state-of-the-art models. Furthermore, we successfully transferred the core idea of EHPR into complex embeddings, showcasing the framework's adaptability. Compared to complex embedding models, EHPR also demonstrates stronger expressive abilities with the Hamilton operator, surpassing the performance of complex Hermitian operator.

EHPR:基于四元数的学习进化层次感知表示法,用于完成时态知识图谱
时态知识图谱研究因事实与动态时态因素之间错综复杂的联系而备受关注。然而,现有研究将时间戳作为表征学习的辅助数据,并直接将其整合到事实中,导致无法捕捉时间演化下关系之间的内在联系。为了应对这些挑战,我们提出了进化层次感知表征(EHPR),它首先利用汉密尔顿积对关系和实体随时间进行旋转变换,旨在学习与时间信息交互密切的时间关系和时间实体。之后,EHPR 又分为两个模块:(a) 通过汉密尔顿乘积,利用时间关系将头部实体向尾部实体旋转,从而利用四元数旋转能力为复杂模式建模。(b) 采用进化层次因子捕捉时空头部实体和时空尾部实体之间模量分布的差异,旨在管理不同时空实体之间的进化层次信息。这样,EHPR 不仅能利用丰富的四元数旋转功能对各种关系模式进行建模,还能通过进化层次因子进一步对进化层次模式进行建模。实验表明,与最先进的模型相比,EHPR 在六个成熟基准上取得了显著的性能。此外,我们还成功地将 EHPR 的核心思想移植到了复杂嵌入中,从而展示了该框架的适应性。与复杂嵌入模型相比,EHPR 在汉密尔顿算子方面也表现出了更强的表达能力,超越了复杂赫尔墨斯算子。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信