Xiangzhen Meng , Xiaoxuan Jiao , Jiahui Li , Shenglong Wang , Jinxin Pan , Bo Jing , Xilang Tang
{"title":"CELLMEA:一种协同增强的基于大语言模型的飞机故障维修实体对齐方法","authors":"Xiangzhen Meng , Xiaoxuan Jiao , Jiahui Li , Shenglong Wang , Jinxin Pan , Bo Jing , Xilang Tang","doi":"10.1016/j.eswa.2025.127630","DOIUrl":null,"url":null,"abstract":"<div><div>Aircraft fault knowledge graphs serve as a critical knowledge base for the intelligent maintenance and operations of aviation equipment. However, the entity alignment tasks in their construction remain overly dependent on manual annotation, leading to issues such as inconsistent annotation quality and low annotation efficiency. Unsupervised methods provide a promising solution and have garnered significant research interest. However, existing unsupervised entity alignment approaches often overlook the impact of noisy entities, presenting a significant challenge for aligning entities in aviation fault data. This paper proposes a solution by incorporating a large language model (LLM) into the entity alignment process for aircraft fault knowledge graphs. By leveraging the world knowledge encoded in the LLM, the approach enhances the performance of unsupervised entity alignment models. Specifically, we introduce the Collaboratively Enhanced-based Large Language Model Entity Alignment (CELLMEA), which utilizes data from the aircraft flight control system manual, fault analysis manual, and typical fault cases. The model’s architecture includes a multi-view semantic information embedding that integrates structural, relational, and semantic data. Additionally, we propose an adaptive method for mixing hard negative samples, which generates higher-quality negative entities by combining noisy negative samples with reliable ones. Furthermore, an incremental consistency regularization technique is introduced to progressively refine the robustness of pseudo-labeling within the CELLMEA model. Finally, experimental results on a flight control system entity alignment dataset demonstrate that CELLMEA outperforms all baseline models, achieving an MRR (Mean Reciprocal Rank) value of 0.917 ± 0.011. These results validate the model’s effectiveness in handling unlabeled data and lay the groundwork for the engineering of aircraft fault knowledge graphs.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"282 ","pages":"Article 127630"},"PeriodicalIF":7.5000,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"CELLMEA:A Collaboratively Enhanced Large Language Model-based Entity Alignment for aircraft fault maintenance\",\"authors\":\"Xiangzhen Meng , Xiaoxuan Jiao , Jiahui Li , Shenglong Wang , Jinxin Pan , Bo Jing , Xilang Tang\",\"doi\":\"10.1016/j.eswa.2025.127630\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Aircraft fault knowledge graphs serve as a critical knowledge base for the intelligent maintenance and operations of aviation equipment. However, the entity alignment tasks in their construction remain overly dependent on manual annotation, leading to issues such as inconsistent annotation quality and low annotation efficiency. Unsupervised methods provide a promising solution and have garnered significant research interest. However, existing unsupervised entity alignment approaches often overlook the impact of noisy entities, presenting a significant challenge for aligning entities in aviation fault data. This paper proposes a solution by incorporating a large language model (LLM) into the entity alignment process for aircraft fault knowledge graphs. By leveraging the world knowledge encoded in the LLM, the approach enhances the performance of unsupervised entity alignment models. Specifically, we introduce the Collaboratively Enhanced-based Large Language Model Entity Alignment (CELLMEA), which utilizes data from the aircraft flight control system manual, fault analysis manual, and typical fault cases. The model’s architecture includes a multi-view semantic information embedding that integrates structural, relational, and semantic data. Additionally, we propose an adaptive method for mixing hard negative samples, which generates higher-quality negative entities by combining noisy negative samples with reliable ones. Furthermore, an incremental consistency regularization technique is introduced to progressively refine the robustness of pseudo-labeling within the CELLMEA model. Finally, experimental results on a flight control system entity alignment dataset demonstrate that CELLMEA outperforms all baseline models, achieving an MRR (Mean Reciprocal Rank) value of 0.917 ± 0.011. These results validate the model’s effectiveness in handling unlabeled data and lay the groundwork for the engineering of aircraft fault knowledge graphs.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"282 \",\"pages\":\"Article 127630\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-04-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425012527\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425012527","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
CELLMEA:A Collaboratively Enhanced Large Language Model-based Entity Alignment for aircraft fault maintenance
Aircraft fault knowledge graphs serve as a critical knowledge base for the intelligent maintenance and operations of aviation equipment. However, the entity alignment tasks in their construction remain overly dependent on manual annotation, leading to issues such as inconsistent annotation quality and low annotation efficiency. Unsupervised methods provide a promising solution and have garnered significant research interest. However, existing unsupervised entity alignment approaches often overlook the impact of noisy entities, presenting a significant challenge for aligning entities in aviation fault data. This paper proposes a solution by incorporating a large language model (LLM) into the entity alignment process for aircraft fault knowledge graphs. By leveraging the world knowledge encoded in the LLM, the approach enhances the performance of unsupervised entity alignment models. Specifically, we introduce the Collaboratively Enhanced-based Large Language Model Entity Alignment (CELLMEA), which utilizes data from the aircraft flight control system manual, fault analysis manual, and typical fault cases. The model’s architecture includes a multi-view semantic information embedding that integrates structural, relational, and semantic data. Additionally, we propose an adaptive method for mixing hard negative samples, which generates higher-quality negative entities by combining noisy negative samples with reliable ones. Furthermore, an incremental consistency regularization technique is introduced to progressively refine the robustness of pseudo-labeling within the CELLMEA model. Finally, experimental results on a flight control system entity alignment dataset demonstrate that CELLMEA outperforms all baseline models, achieving an MRR (Mean Reciprocal Rank) value of 0.917 ± 0.011. These results validate the model’s effectiveness in handling unlabeled data and lay the groundwork for the engineering of aircraft fault knowledge graphs.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.