Research on Multi-Domain Intelligent Customer Service Dialog Modeling with Integrated Transfer Learning Strategies

IF 3.1 Q1 Mathematics
Xiaopan Cao, Xueting Dong, Chuang Li, Baoliang Zhang, Fan Liu
{"title":"Research on Multi-Domain Intelligent Customer Service Dialog Modeling with Integrated Transfer Learning Strategies","authors":"Xiaopan Cao, Xueting Dong, Chuang Li, Baoliang Zhang, Fan Liu","doi":"10.2478/amns.2023.2.01412","DOIUrl":null,"url":null,"abstract":"Abstract The intelligent customer service dialog model is centered on human-machine dialog, which has good prospects for commercial applications in multiple domains. In this paper, we use the Siamese-LSTM model to do vectorization of questions in the FAQ question and answer database to get the semantic representation vector of sentences, and then use the approximate retrieval algorithm to index the question and answer database and perform approximate nearest-neighbor retrieval of the query. After completing the question query, migration learning is employed to create a mapping between input questions and human responses, enabling the model to produce sentences that are similar to human responses. Tests show that the task success rate gradually stabilizes around 0.80 at about the 100th round and fluctuates up to around 0.986 after that. For the average number of conversation rounds, migration learning improves the conversation efficiency of intelligent customer service, and the average number of conversation rounds gradually stabilizes at about 150 rounds and eventually stabilizes at about 4.2 rounds as the number of training rounds increases. The transfer learning strategy helps machine responses to be as close to human responses as possible.","PeriodicalId":52342,"journal":{"name":"Applied Mathematics and Nonlinear Sciences","volume":"28 11","pages":""},"PeriodicalIF":3.1000,"publicationDate":"2023-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Mathematics and Nonlinear Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2478/amns.2023.2.01412","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Mathematics","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract The intelligent customer service dialog model is centered on human-machine dialog, which has good prospects for commercial applications in multiple domains. In this paper, we use the Siamese-LSTM model to do vectorization of questions in the FAQ question and answer database to get the semantic representation vector of sentences, and then use the approximate retrieval algorithm to index the question and answer database and perform approximate nearest-neighbor retrieval of the query. After completing the question query, migration learning is employed to create a mapping between input questions and human responses, enabling the model to produce sentences that are similar to human responses. Tests show that the task success rate gradually stabilizes around 0.80 at about the 100th round and fluctuates up to around 0.986 after that. For the average number of conversation rounds, migration learning improves the conversation efficiency of intelligent customer service, and the average number of conversation rounds gradually stabilizes at about 150 rounds and eventually stabilizes at about 4.2 rounds as the number of training rounds increases. The transfer learning strategy helps machine responses to be as close to human responses as possible.
综合迁移学习策略的多领域智能客户服务对话建模研究
摘要智能客服对话模型以人机对话为核心,在多个领域具有良好的商业应用前景。本文利用Siamese-LSTM模型对FAQ问答数据库中的问题进行矢量化,得到句子的语义表示向量,然后利用近似检索算法对问答数据库进行索引,并对查询进行近似近邻检索。在完成问题查询后,使用迁移学习来创建输入问题和人类响应之间的映射,使模型能够生成与人类响应相似的句子。测试表明,任务成功率在第100轮左右逐渐稳定在0.80左右,之后波动到0.986左右。在平均会话轮数上,迁移学习提高了智能客服的会话效率,随着训练轮数的增加,平均会话轮数逐渐稳定在150轮左右,最终稳定在4.2轮左右。迁移学习策略帮助机器的反应尽可能接近人类的反应。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Applied Mathematics and Nonlinear Sciences
Applied Mathematics and Nonlinear Sciences Engineering-Engineering (miscellaneous)
CiteScore
2.90
自引率
25.80%
发文量
203
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信