Hong Yang, Xiaokai Meng, Hua Yu, Yang Bai, Yu Han, Yongxin Liu
{"title":"Structure Prompt Augmented Language Model Embedding on Electrical Equipment Defect Knowledge Graph","authors":"Hong Yang, Xiaokai Meng, Hua Yu, Yang Bai, Yu Han, Yongxin Liu","doi":"10.1142/s0129156424400512","DOIUrl":null,"url":null,"abstract":"Knowledge graphs have demonstrated significant impact in the power grid domain, facilitating various applications such as defect diagnosis and grid management. However, their reasoning capabilities have not been fully exploited. In this paper, we explore the utilization of knowledge graphs for power grid defect diagnosis. We construct an electrical equipment defect knowledge graph and predict missing links, which is also known as Knowledge Graph Completion (KGC). However, we notice the long-tail problem in electrical equipment knowledge graph. To tackle this challenge, we propose a novel text-based model named SPALME (Structure Prompt Augmented Language Model Embedding) that incorporates structural information as prompts. Our model leverages the power of pre-trained language models, allowing it to comprehend the semantic information of entities and relationships in the knowledge graph. Additionally, by integrating structural information as prompts during the learning process, our model gains a deeper understanding of the graph’s topological structure efficiently, effectively capturing intricate dependencies between grid equipments. We evaluate our approach on various datasets. The results demonstrate that our model consistently outperforms baseline methods on the majority of the datasets.","PeriodicalId":35778,"journal":{"name":"International Journal of High Speed Electronics and Systems","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of High Speed Electronics and Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1142/s0129156424400512","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
Abstract
Knowledge graphs have demonstrated significant impact in the power grid domain, facilitating various applications such as defect diagnosis and grid management. However, their reasoning capabilities have not been fully exploited. In this paper, we explore the utilization of knowledge graphs for power grid defect diagnosis. We construct an electrical equipment defect knowledge graph and predict missing links, which is also known as Knowledge Graph Completion (KGC). However, we notice the long-tail problem in electrical equipment knowledge graph. To tackle this challenge, we propose a novel text-based model named SPALME (Structure Prompt Augmented Language Model Embedding) that incorporates structural information as prompts. Our model leverages the power of pre-trained language models, allowing it to comprehend the semantic information of entities and relationships in the knowledge graph. Additionally, by integrating structural information as prompts during the learning process, our model gains a deeper understanding of the graph’s topological structure efficiently, effectively capturing intricate dependencies between grid equipments. We evaluate our approach on various datasets. The results demonstrate that our model consistently outperforms baseline methods on the majority of the datasets.
期刊介绍:
Launched in 1990, the International Journal of High Speed Electronics and Systems (IJHSES) has served graduate students and those in R&D, managerial and marketing positions by giving state-of-the-art data, and the latest research trends. Its main charter is to promote engineering education by advancing interdisciplinary science between electronics and systems and to explore high speed technology in photonics and electronics. IJHSES, a quarterly journal, continues to feature a broad coverage of topics relating to high speed or high performance devices, circuits and systems.