归因与对齐:局部语境重复对对话中的语句生成和理解的影响

Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella J. Sinclair
{"title":"归因与对齐:局部语境重复对对话中的语句生成和理解的影响","authors":"Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella J. Sinclair","doi":"10.48550/arXiv.2311.13061","DOIUrl":null,"url":null,"abstract":"Language models are often used as the backbone of modern dialogue systems. These models are pre-trained on large amounts of written fluent language. Repetition is typically penalised when evaluating language model generations. However, it is a key component of dialogue. Humans use local and partner specific repetitions; these are preferred by human users and lead to more successful communication in dialogue. In this study, we evaluate (a) whether language models produce human-like levels of repetition in dialogue, and (b) what are the processing mechanisms related to lexical re-use they use during comprehension. We believe that such joint analysis of model production and comprehension behaviour can inform the development of cognitively inspired dialogue generation systems.","PeriodicalId":502635,"journal":{"name":"Conference on Computational Natural Language Learning","volume":"84 4","pages":"254-273"},"PeriodicalIF":0.0000,"publicationDate":"2023-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue\",\"authors\":\"Aron Molnar, Jaap Jumelet, Mario Giulianelli, Arabella J. Sinclair\",\"doi\":\"10.48550/arXiv.2311.13061\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Language models are often used as the backbone of modern dialogue systems. These models are pre-trained on large amounts of written fluent language. Repetition is typically penalised when evaluating language model generations. However, it is a key component of dialogue. Humans use local and partner specific repetitions; these are preferred by human users and lead to more successful communication in dialogue. In this study, we evaluate (a) whether language models produce human-like levels of repetition in dialogue, and (b) what are the processing mechanisms related to lexical re-use they use during comprehension. We believe that such joint analysis of model production and comprehension behaviour can inform the development of cognitively inspired dialogue generation systems.\",\"PeriodicalId\":502635,\"journal\":{\"name\":\"Conference on Computational Natural Language Learning\",\"volume\":\"84 4\",\"pages\":\"254-273\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-11-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Conference on Computational Natural Language Learning\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2311.13061\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Conference on Computational Natural Language Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2311.13061","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

语言模型通常被用作现代对话系统的支柱。这些模型在大量书面流畅语言的基础上进行预训练。在评估语言模型生成时,重复通常会受到惩罚。然而,重复却是对话的关键组成部分。人类使用本地重复和伙伴特定重复;这些重复受到人类用户的青睐,并能在对话中实现更成功的交流。在这项研究中,我们将评估(a)语言模型在对话中是否会产生与人类相似的重复水平,以及(b)在理解过程中,它们使用了哪些与词汇重复使用相关的处理机制。我们相信,这种对模型生成和理解行为的联合分析可以为开发受认知启发的对话生成系统提供信息。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue
Language models are often used as the backbone of modern dialogue systems. These models are pre-trained on large amounts of written fluent language. Repetition is typically penalised when evaluating language model generations. However, it is a key component of dialogue. Humans use local and partner specific repetitions; these are preferred by human users and lead to more successful communication in dialogue. In this study, we evaluate (a) whether language models produce human-like levels of repetition in dialogue, and (b) what are the processing mechanisms related to lexical re-use they use during comprehension. We believe that such joint analysis of model production and comprehension behaviour can inform the development of cognitively inspired dialogue generation systems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信