Connected multi-hierarchies lightweight global hierarchical model in hyper-relational knowledge graphs

Abstract

Hyper-relational knowledge graphs enriched by qualifiers have wide applications across diverse fields, and knowledge representation learning is emerging as a prominent research focus. Existing representation methods primarily concentrate on the local hierarchies of each element, overlooking the global hierarchies and their complex dependencies which can result in substantial semantic incompleteness and degraded model generalization. While modeling global hierarchical semantics presents a challenge, integrating local and global hierarchies further increases computational complexity. To tackle these challenges, we propose CMLG, a lightweight global hierarchical representation learning method that connects multiple hierarchies and leverages varied hierarchical details to improve learning effectiveness. Specifically, interactions within local hierarchies are utilized to update the local vectors of triples and qualifiers, thereby capturing essential semantic aggregations at the local hierarchies to construct global hierarchical expressions of entities and relations. These global representations encompass the essential features of hyper-relational facts and are utilized for computational tasks across various domains. To enhance the quality of embeddings, contrastive methods that connect multi-hierarchies are utilized within and across these hierarchies to boost the model’s learning capabilities. Considering the computational resources required for learning at both local and global hierarchies, CMLG adopts the lightweight design to reduce the parameters and computational demands of training, thereby enhancing its suitability for large-scale datasets. Comprehensive experiments on various datasets reveal that our approach outperforms advanced models, achieving up to a 12 % improvement in MRR over the runner-ups.