Research On Human-computer Dialogue Based On Improved Seq2seq Model

Wenqian Shang, Sunyu Zhu, Dong Xiao
{"title":"Research On Human-computer Dialogue Based On Improved Seq2seq Model","authors":"Wenqian Shang, Sunyu Zhu, Dong Xiao","doi":"10.1109/icisfall51598.2021.9627419","DOIUrl":null,"url":null,"abstract":"With the constant maturity of deep learning technology, human-computer dialogue has become a research hotspot in natural language processing. People in academia and industry are very concerned about it. The extensive use of artificial intelligence and deep learning technology in the human-machine dialogue system and the deep neural network modeling for text semantics are of great significance in promoting human-computer dialogue technologies and the application of human-computer dialogue to serve humanity better. Based on the above background, this paper focuses on the research of the human-computer dialogue system based on the improved seq2seq model, using the pre-trained Bert improved model as the codec modeling, and addressing the lack of Q&A data sets, the imbalance of category distribution, and the robustness of the model. These problems can be solved by adding disturbance structure adversarial sample training.","PeriodicalId":240142,"journal":{"name":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","volume":"68 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACIS 20th International Fall Conference on Computer and Information Science (ICIS Fall)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icisfall51598.2021.9627419","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

With the constant maturity of deep learning technology, human-computer dialogue has become a research hotspot in natural language processing. People in academia and industry are very concerned about it. The extensive use of artificial intelligence and deep learning technology in the human-machine dialogue system and the deep neural network modeling for text semantics are of great significance in promoting human-computer dialogue technologies and the application of human-computer dialogue to serve humanity better. Based on the above background, this paper focuses on the research of the human-computer dialogue system based on the improved seq2seq model, using the pre-trained Bert improved model as the codec modeling, and addressing the lack of Q&A data sets, the imbalance of category distribution, and the robustness of the model. These problems can be solved by adding disturbance structure adversarial sample training.
基于改进Seq2seq模型的人机对话研究
随着深度学习技术的不断成熟,人机对话已成为自然语言处理领域的研究热点。学术界和工业界的人对此非常关注。人工智能和深度学习技术在人机对话系统中的广泛应用,以及文本语义的深度神经网络建模,对于推动人机对话技术和人机对话的应用更好地为人类服务具有重要意义。基于上述背景,本文重点研究了基于改进seq2seq模型的人机对话系统,采用预训练的Bert改进模型作为编解码器建模,解决了问答数据集缺乏、品类分布不平衡、模型鲁棒性差等问题。这些问题可以通过加入扰动结构对抗样本训练来解决。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信