{"title":"基于大语言模型和知识图谱相结合的问答系统","authors":"Jihong Wang, Yichen Zhang, Wei Liu","doi":"10.1007/s10489-025-06828-0","DOIUrl":null,"url":null,"abstract":"<div><p>In recent years, large language models (LLMs) have achieved remarkable progress in natural language processing. However, their application in question-answering systems continues to face challenges such as insufficient credibility and interpretability of responses, as well as high computational resource demands. To address these issues, this paper proposes a question-answering system that integrates knowledge graphs with lightweight LLMs. Specifically, a lightweight front-end model based on BERT and T5 is employed to extract and transform logical forms from natural language queries, which are then executed on a knowledge graph. Subsequently, a smaller-scale LLM generates credible and interpretable answers based on these query results. Experimental results show that the proposed method achieves F1 scores of 75.6% and 76.8% on the WebQSP and GRAILQA datasets, respectively, surpassing other representative approaches. Furthermore, integrating the extracted knowledge with the ChatGLM-6B model significantly improves answer quality, increasing ratings by 112.8% for simple questions and 77.4% for complex questions, thus validating the effectiveness of our approach.</p></div>","PeriodicalId":8041,"journal":{"name":"Applied Intelligence","volume":"55 15","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2025-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Question answering system based on the combination of large language model and knowledge graph\",\"authors\":\"Jihong Wang, Yichen Zhang, Wei Liu\",\"doi\":\"10.1007/s10489-025-06828-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In recent years, large language models (LLMs) have achieved remarkable progress in natural language processing. However, their application in question-answering systems continues to face challenges such as insufficient credibility and interpretability of responses, as well as high computational resource demands. To address these issues, this paper proposes a question-answering system that integrates knowledge graphs with lightweight LLMs. Specifically, a lightweight front-end model based on BERT and T5 is employed to extract and transform logical forms from natural language queries, which are then executed on a knowledge graph. Subsequently, a smaller-scale LLM generates credible and interpretable answers based on these query results. Experimental results show that the proposed method achieves F1 scores of 75.6% and 76.8% on the WebQSP and GRAILQA datasets, respectively, surpassing other representative approaches. Furthermore, integrating the extracted knowledge with the ChatGLM-6B model significantly improves answer quality, increasing ratings by 112.8% for simple questions and 77.4% for complex questions, thus validating the effectiveness of our approach.</p></div>\",\"PeriodicalId\":8041,\"journal\":{\"name\":\"Applied Intelligence\",\"volume\":\"55 15\",\"pages\":\"\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-10-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10489-025-06828-0\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Intelligence","FirstCategoryId":"94","ListUrlMain":"https://link.springer.com/article/10.1007/s10489-025-06828-0","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
近年来,大型语言模型(large language models, llm)在自然语言处理方面取得了显著进展。然而,它们在问答系统中的应用仍然面临着诸如响应的可信度和可解释性不足以及对计算资源的高需求等挑战。为了解决这些问题,本文提出了一个集成了知识图和轻量级llm的问答系统。具体来说,使用基于BERT和T5的轻量级前端模型从自然语言查询中提取和转换逻辑形式,然后在知识图上执行。随后,一个较小规模的LLM根据这些查询结果生成可信且可解释的答案。实验结果表明,该方法在WebQSP和GRAILQA数据集上分别获得了75.6%和76.8%的F1分数,优于其他代表性方法。简单问题占8%,复杂问题占77.4%,验证了我们方法的有效性。
Question answering system based on the combination of large language model and knowledge graph
In recent years, large language models (LLMs) have achieved remarkable progress in natural language processing. However, their application in question-answering systems continues to face challenges such as insufficient credibility and interpretability of responses, as well as high computational resource demands. To address these issues, this paper proposes a question-answering system that integrates knowledge graphs with lightweight LLMs. Specifically, a lightweight front-end model based on BERT and T5 is employed to extract and transform logical forms from natural language queries, which are then executed on a knowledge graph. Subsequently, a smaller-scale LLM generates credible and interpretable answers based on these query results. Experimental results show that the proposed method achieves F1 scores of 75.6% and 76.8% on the WebQSP and GRAILQA datasets, respectively, surpassing other representative approaches. Furthermore, integrating the extracted knowledge with the ChatGLM-6B model significantly improves answer quality, increasing ratings by 112.8% for simple questions and 77.4% for complex questions, thus validating the effectiveness of our approach.
期刊介绍:
With a focus on research in artificial intelligence and neural networks, this journal addresses issues involving solutions of real-life manufacturing, defense, management, government and industrial problems which are too complex to be solved through conventional approaches and require the simulation of intelligent thought processes, heuristics, applications of knowledge, and distributed and parallel processing. The integration of these multiple approaches in solving complex problems is of particular importance.
The journal presents new and original research and technological developments, addressing real and complex issues applicable to difficult problems. It provides a medium for exchanging scientific research and technological achievements accomplished by the international community.