{"title":"Arguments to Key Points Mapping with Prompt-based Learning","authors":"Ahnaf Mozib Samin, Behrooz Nikandish, Jingyan Chen","doi":"10.48550/arXiv.2211.14995","DOIUrl":null,"url":null,"abstract":"Handling and digesting a huge amount of information in an efficient manner has been a long-term demand in modern society. Some solutions to map key points (short textual summaries capturing essential information and filtering redundancies) to a large number of arguments/opinions have been provided recently (Bar-Haim et al., 2020). To complement the full picture of the argument-to-keypoint mapping task, we mainly propose two approaches in this paper. The first approach is to incorporate prompt engineering for fine-tuning the pre-trained language models (PLMs). The second approach utilizes prompt-based learning in PLMs to generate intermediary texts, which are then combined with the original argument-keypoint pairs and fed as inputs to a classifier, thereby mapping them. Furthermore, we extend the experiments to cross/in-domain to conduct an in-depth analysis. In our evaluation, we find that i) using prompt engineering in a more direct way (Approach 1) can yield promising results and improve the performance; ii) Approach 2 performs considerably worse than Approach 1 due to the negation issue of the PLM.","PeriodicalId":405017,"journal":{"name":"International Conference on Natural Language and Speech Processing","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Natural Language and Speech Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2211.14995","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Handling and digesting a huge amount of information in an efficient manner has been a long-term demand in modern society. Some solutions to map key points (short textual summaries capturing essential information and filtering redundancies) to a large number of arguments/opinions have been provided recently (Bar-Haim et al., 2020). To complement the full picture of the argument-to-keypoint mapping task, we mainly propose two approaches in this paper. The first approach is to incorporate prompt engineering for fine-tuning the pre-trained language models (PLMs). The second approach utilizes prompt-based learning in PLMs to generate intermediary texts, which are then combined with the original argument-keypoint pairs and fed as inputs to a classifier, thereby mapping them. Furthermore, we extend the experiments to cross/in-domain to conduct an in-depth analysis. In our evaluation, we find that i) using prompt engineering in a more direct way (Approach 1) can yield promising results and improve the performance; ii) Approach 2 performs considerably worse than Approach 1 due to the negation issue of the PLM.
高效地处理和消化海量信息是现代社会的长期需求。最近已经提供了一些将关键点(捕获基本信息和过滤冗余的简短文本摘要)映射到大量论点/意见的解决方案(Bar-Haim et al., 2020)。为了补充论证到关键点映射任务的全貌,我们在本文中主要提出了两种方法。第一种方法是结合即时工程来微调预训练语言模型(plm)。第二种方法利用plm中基于提示的学习来生成中间文本,然后将其与原始参数-关键点对组合并作为输入馈送到分类器,从而对它们进行映射。此外,我们将实验扩展到跨/域内进行深入分析。在我们的评估中,我们发现i)以更直接的方式使用提示工程(方法1)可以产生有希望的结果并提高性能;ii)由于PLM的否定问题,方法2的性能比方法1差得多。