Kai Wang , Yanping Chen , Weizhe Yang , Ruizhang Huang , Yongbin Qin
{"title":"一种用于关系提取的神经核框架","authors":"Kai Wang , Yanping Chen , Weizhe Yang , Ruizhang Huang , Yongbin Qin","doi":"10.1016/j.eswa.2025.128049","DOIUrl":null,"url":null,"abstract":"<div><div>Relation extraction (RE) poses significant challenges due to the complexity of identifying semantic relationships between overlapping entity pairs within sentences. Traditional kernel-based methods effectively leverage instance-level similarities but heavily depend on manually designed kernel functions, requiring substantial domain expertise and limiting their flexibility. On the other hand, neural network approaches excel at automatically learning abstract feature representations but typically neglect critical instance-specific information, potentially missing valuable relational details during inference. These limitations motivate the exploration of a hybrid approach that effectively integrates the strengths of traditional kernels with the representational power of neural networks. In this paper, we propose a neural kernel framework designed to bridge this critical gap. The proposed framework employs neural kernels, whose parameters are initialized based on task-specific objectives and optimized through neural training procedures, enabling adaptive learning of similarity measures without relying on handcrafted kernel functions. By maintaining instance-level details through annotated training examples, neural kernels create discriminative, flexible decision boundaries tailored specifically to the relation extraction task. We further develop three complementary neural kernel components, instance kernel, description kernel, and cluster kernel, to show the advantages of kernel substitution. Extensive experiments on the ACE 2005, SemEval 2010, and CoNLL 2004 datasets demonstrate that our neural kernel framework significantly outperforms existing state-of-the-art methods, achieving F1-scores of 88.11 %, 91.08 %, and 98.63 %, respectively.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"286 ","pages":"Article 128049"},"PeriodicalIF":7.5000,"publicationDate":"2025-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A neural kernel framework for relation extraction\",\"authors\":\"Kai Wang , Yanping Chen , Weizhe Yang , Ruizhang Huang , Yongbin Qin\",\"doi\":\"10.1016/j.eswa.2025.128049\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Relation extraction (RE) poses significant challenges due to the complexity of identifying semantic relationships between overlapping entity pairs within sentences. Traditional kernel-based methods effectively leverage instance-level similarities but heavily depend on manually designed kernel functions, requiring substantial domain expertise and limiting their flexibility. On the other hand, neural network approaches excel at automatically learning abstract feature representations but typically neglect critical instance-specific information, potentially missing valuable relational details during inference. These limitations motivate the exploration of a hybrid approach that effectively integrates the strengths of traditional kernels with the representational power of neural networks. In this paper, we propose a neural kernel framework designed to bridge this critical gap. The proposed framework employs neural kernels, whose parameters are initialized based on task-specific objectives and optimized through neural training procedures, enabling adaptive learning of similarity measures without relying on handcrafted kernel functions. By maintaining instance-level details through annotated training examples, neural kernels create discriminative, flexible decision boundaries tailored specifically to the relation extraction task. We further develop three complementary neural kernel components, instance kernel, description kernel, and cluster kernel, to show the advantages of kernel substitution. Extensive experiments on the ACE 2005, SemEval 2010, and CoNLL 2004 datasets demonstrate that our neural kernel framework significantly outperforms existing state-of-the-art methods, achieving F1-scores of 88.11 %, 91.08 %, and 98.63 %, respectively.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"286 \",\"pages\":\"Article 128049\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2025-05-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417425016707\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425016707","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Relation extraction (RE) poses significant challenges due to the complexity of identifying semantic relationships between overlapping entity pairs within sentences. Traditional kernel-based methods effectively leverage instance-level similarities but heavily depend on manually designed kernel functions, requiring substantial domain expertise and limiting their flexibility. On the other hand, neural network approaches excel at automatically learning abstract feature representations but typically neglect critical instance-specific information, potentially missing valuable relational details during inference. These limitations motivate the exploration of a hybrid approach that effectively integrates the strengths of traditional kernels with the representational power of neural networks. In this paper, we propose a neural kernel framework designed to bridge this critical gap. The proposed framework employs neural kernels, whose parameters are initialized based on task-specific objectives and optimized through neural training procedures, enabling adaptive learning of similarity measures without relying on handcrafted kernel functions. By maintaining instance-level details through annotated training examples, neural kernels create discriminative, flexible decision boundaries tailored specifically to the relation extraction task. We further develop three complementary neural kernel components, instance kernel, description kernel, and cluster kernel, to show the advantages of kernel substitution. Extensive experiments on the ACE 2005, SemEval 2010, and CoNLL 2004 datasets demonstrate that our neural kernel framework significantly outperforms existing state-of-the-art methods, achieving F1-scores of 88.11 %, 91.08 %, and 98.63 %, respectively.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.