TELS: Learning time-evolving information and latent semantics using dual quaternion for temporal knowledge graph completion

Abstract

In temporal knowledge graphs (TKGs), the status of facts is intricately tied to the dynamic and precise nature of temporal factors. Existing research merely treats time as supplementary information, without considering the latent semantic changes caused by the positional changes of entities within specific relations in a temporal context. Furthermore, due to the coarse granularity of timestamps in existing TKGs, the number of multiple relations pattern among entities significantly increases, limiting model performance. This paper proposes a Time-Evolving Information and Latent Semantics model (TELS), which represents facts as dual quaternion embeddings to provide a compact and elegant representation. Specifically, we use timestamp dual quaternions, transforming the entity and relation into temporal entity and temporal relation through dual quaternion multiplication. Besides, we introduce semantic-aware dual quaternion to capture the latent semantics arising from the positional changes of entities within specific relations. Next, TELS consists of two parts: (a) We use semantic-aware dual quaternions to perform transformations on head entity and tail entity respectively through dual quaternion multiplication. Next, we utilize temporal relation to transform head entity to tail entity through dual quaternion multiplication. (b) We adopt an evolutionary hierarchical factor to encapsulate the differences in modulus distribution between the temporal head entity and temporal tail entity. In this way, TELS not only uses dual quaternions to handle key patterns and multiple relations pattern, but also handles evolutionary hierarchical patterns by capturing the modulus distribution differences between temporal entities. Meanwhile, TELS learns semantic-aware dual quaternion embeddings to capture the latent semantics endowed by relations to entities. Empirically, TELS can boost the performance over seven temporal knowledge graph benchmarks.