{"title":"基于强化学习的任务导向对话系统","authors":"Meina Song, Zhongfu Chen, Peiqing Niu, E. Haihong","doi":"10.1109/ICSESS47205.2019.9040789","DOIUrl":null,"url":null,"abstract":"In this paper, we propose a task-oriented dialogue system based on reinforcement learning. The overall system is composed of three parts: natural language understanding (NLU), dialogue management (DM) and natural language generation (NLG). And our model can interact with the database in real time and acquire effective information from it. For the DM part, reinforcement learning is applied. Specially, we adopt an improved double deep Q-learning (DQN) strategy. In that case, the DM agent can resist the environmental noise considerably. Besides, we put forward a joint model for NLU module, and the experiments on ATIS and Snips datasets have proved the effectiveness of the joint model. For the overall system, the experiments are conducted on a public movie-ticket booking dataset. The experimental results indicate that the proposed model has outperformed the traditional rule-based multi-turn dialogue system both on simulated and real users. Besides, the double-DQN agent has better performance for both objective and subject evaluation, which demonstrates the effectiveness and superiority of our proposed model.","PeriodicalId":203944,"journal":{"name":"2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Task-oriented Dialogue System Based on Reinforcement Learning\",\"authors\":\"Meina Song, Zhongfu Chen, Peiqing Niu, E. Haihong\",\"doi\":\"10.1109/ICSESS47205.2019.9040789\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we propose a task-oriented dialogue system based on reinforcement learning. The overall system is composed of three parts: natural language understanding (NLU), dialogue management (DM) and natural language generation (NLG). And our model can interact with the database in real time and acquire effective information from it. For the DM part, reinforcement learning is applied. Specially, we adopt an improved double deep Q-learning (DQN) strategy. In that case, the DM agent can resist the environmental noise considerably. Besides, we put forward a joint model for NLU module, and the experiments on ATIS and Snips datasets have proved the effectiveness of the joint model. For the overall system, the experiments are conducted on a public movie-ticket booking dataset. The experimental results indicate that the proposed model has outperformed the traditional rule-based multi-turn dialogue system both on simulated and real users. Besides, the double-DQN agent has better performance for both objective and subject evaluation, which demonstrates the effectiveness and superiority of our proposed model.\",\"PeriodicalId\":203944,\"journal\":{\"name\":\"2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS)\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSESS47205.2019.9040789\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSESS47205.2019.9040789","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Task-oriented Dialogue System Based on Reinforcement Learning
In this paper, we propose a task-oriented dialogue system based on reinforcement learning. The overall system is composed of three parts: natural language understanding (NLU), dialogue management (DM) and natural language generation (NLG). And our model can interact with the database in real time and acquire effective information from it. For the DM part, reinforcement learning is applied. Specially, we adopt an improved double deep Q-learning (DQN) strategy. In that case, the DM agent can resist the environmental noise considerably. Besides, we put forward a joint model for NLU module, and the experiments on ATIS and Snips datasets have proved the effectiveness of the joint model. For the overall system, the experiments are conducted on a public movie-ticket booking dataset. The experimental results indicate that the proposed model has outperformed the traditional rule-based multi-turn dialogue system both on simulated and real users. Besides, the double-DQN agent has better performance for both objective and subject evaluation, which demonstrates the effectiveness and superiority of our proposed model.