Similarity-Based Retrieval in Process-Oriented Case-Based Reasoning Using Graph Neural Networks and Transfer Learning

Johannes Pauli, Maximilian Hoffmann, R. Bergmann
{"title":"Similarity-Based Retrieval in Process-Oriented Case-Based Reasoning Using Graph Neural Networks and Transfer Learning","authors":"Johannes Pauli, Maximilian Hoffmann, R. Bergmann","doi":"10.32473/flairs.36.133040","DOIUrl":null,"url":null,"abstract":"Similarity-based retrieval of semantic graphs is a crucial task of Process-Oriented Case-Based Reasoning (POCBR) that is usually complex and time-consuming, as it requires some kind of inexact graph matching. Previous work tackles this problem by using Graph Neural Networks (GNNs) to learn pairwise graph similarities. In this paper, we present a novel approach that improves on the GNN-based case retrieval with a Transfer Learning (TL) setup, composed of two phases: First, the pretraining phase trains a model for assessing the similarities between graph nodes and edges and their semantic annotations. Second, the pretrained model is then integrated into the GNN model by either using fine-tuning, i.e., the parameters of the pretrained model are further trained, or feature extraction, i.e., the parameters of the pretrained model are converted to constants. The experimental evaluation examines the quality and performance of the models based on TL compared to the GNN models from previous work for three semantic graph domains with various properties. The results show the great potential of the proposed approach for reducing the similarity prediction error and the training time.","PeriodicalId":302103,"journal":{"name":"The International FLAIRS Conference Proceedings","volume":"168 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The International FLAIRS Conference Proceedings","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.32473/flairs.36.133040","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Similarity-based retrieval of semantic graphs is a crucial task of Process-Oriented Case-Based Reasoning (POCBR) that is usually complex and time-consuming, as it requires some kind of inexact graph matching. Previous work tackles this problem by using Graph Neural Networks (GNNs) to learn pairwise graph similarities. In this paper, we present a novel approach that improves on the GNN-based case retrieval with a Transfer Learning (TL) setup, composed of two phases: First, the pretraining phase trains a model for assessing the similarities between graph nodes and edges and their semantic annotations. Second, the pretrained model is then integrated into the GNN model by either using fine-tuning, i.e., the parameters of the pretrained model are further trained, or feature extraction, i.e., the parameters of the pretrained model are converted to constants. The experimental evaluation examines the quality and performance of the models based on TL compared to the GNN models from previous work for three semantic graph domains with various properties. The results show the great potential of the proposed approach for reducing the similarity prediction error and the training time.
基于图神经网络和迁移学习的面向过程案例推理中基于相似度的检索
基于相似度的语义图检索是面向过程的基于案例推理(Process-Oriented Case-Based Reasoning, POCBR)的一项关键任务,由于它需要某种不精确的图匹配,通常是复杂且耗时的。以前的工作通过使用图神经网络(gnn)来学习成对图相似度来解决这个问题。在本文中,我们提出了一种新的方法,通过迁移学习(TL)设置来改进基于gnn的案例检索,该方法由两个阶段组成:首先,预训练阶段训练一个模型,用于评估图节点和边及其语义注释之间的相似性。其次,将预训练好的模型整合到GNN模型中,要么采用微调,即对预训练模型的参数进行进一步训练,要么采用特征提取,即将预训练模型的参数转换为常量。实验评估了基于TL的模型的质量和性能,并将其与先前工作中具有不同属性的三个语义图域的GNN模型进行了比较。结果表明,该方法在减少相似性预测误差和训练时间方面具有很大的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信