Answer Selection Using Interactive Attention Mechanism

V. Venkataraman, S. Nirmala
{"title":"Answer Selection Using Interactive Attention Mechanism","authors":"V. Venkataraman, S. Nirmala","doi":"10.1109/ISACC56298.2023.10084083","DOIUrl":null,"url":null,"abstract":"Answer selection is a crucial subtask of a question answering system that focuses on ranking candidate answer sentences from an answer pool based on how relevant and useful it is to answer the question. Conventional deep learning methods like RNNs and CNNs suffer from obtaining local and global context information from the sentence representation. Also, utilizing question context information to generate better answer sentence representation will also contribute to better learning. Thus, our proposed approach uses an interactive attention mechanism using both co-attention for learning question context and self-attention for learning global context. We also adopt the attentive pooling network for compressing features where each element in a question-answer sentence pair can influence the representation of the other. We evaluate our proposals on the TREC-QA dataset and compare using the metrics of MRR and MAP. Our proposed model shows better performance on these evaluation metrics compared to existing baseline models.","PeriodicalId":211409,"journal":{"name":"2023 International Conference on Intelligent Systems, Advanced Computing and Communication (ISACC)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Intelligent Systems, Advanced Computing and Communication (ISACC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISACC56298.2023.10084083","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Answer selection is a crucial subtask of a question answering system that focuses on ranking candidate answer sentences from an answer pool based on how relevant and useful it is to answer the question. Conventional deep learning methods like RNNs and CNNs suffer from obtaining local and global context information from the sentence representation. Also, utilizing question context information to generate better answer sentence representation will also contribute to better learning. Thus, our proposed approach uses an interactive attention mechanism using both co-attention for learning question context and self-attention for learning global context. We also adopt the attentive pooling network for compressing features where each element in a question-answer sentence pair can influence the representation of the other. We evaluate our proposals on the TREC-QA dataset and compare using the metrics of MRR and MAP. Our proposed model shows better performance on these evaluation metrics compared to existing baseline models.
使用互动注意机制的答案选择
答案选择是问答系统的一个关键子任务,它侧重于根据回答问题的相关性和有用程度从答案池中对候选答案句子进行排名。传统的深度学习方法,如rnn和cnn,都存在从句子表示中获取局部和全局上下文信息的问题。此外,利用问题上下文信息生成更好的答案句子表示也有助于更好的学习。因此,我们提出的方法使用了一种交互式注意机制,使用共同注意来学习问题上下文,使用自我注意来学习全局上下文。我们还采用细心池化网络来压缩特征,其中问答句对中的每个元素都会影响另一个元素的表示。我们在TREC-QA数据集上评估我们的建议,并使用MRR和MAP的指标进行比较。与现有的基线模型相比,我们提出的模型在这些评估指标上显示出更好的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书