Moath Al Ali, Bassel Zaity, P. Drobintsev, H. Wannous, Igor Chernoruckiy, A. Filchenkov
{"title":"基于CNN-LSTM混合模型的口语理解联合槽填充和意图检测","authors":"Moath Al Ali, Bassel Zaity, P. Drobintsev, H. Wannous, Igor Chernoruckiy, A. Filchenkov","doi":"10.1145/3437802.3437822","DOIUrl":null,"url":null,"abstract":"We investigate the usage of hybrid convolutional and long- short-term memory neural networks for joint slot filling and intent detection in spoken language understanding. We propose a novel model that combines between convolutional neural networks, for their ability to detect complex features in the input sequences by applying filters to frames of these inputs, and recurrent neural networks taking in account the fact, that they can keep track of the long- and short- term dependencies in the input sequences. We choose to build a model for joint slot filling and intent detection, because we believe, that there is a strong relation between the intent and the semantic slots. A joint model can reflect this relation, figure it out and make use of it to enhance the prediction results. We use the Airline Travel Information System (ATIS) dataset to measure the performance of our model and compare it with the results of other models, as this dataset has become one of the most popular datasets for spoken language understanding problem.","PeriodicalId":429866,"journal":{"name":"Proceedings of the 2020 1st International Conference on Control, Robotics and Intelligent System","volume":"16 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Joint Slot Filling and Intent Detection in Spoken Language Understanding by Hybrid CNN-LSTM Model\",\"authors\":\"Moath Al Ali, Bassel Zaity, P. Drobintsev, H. Wannous, Igor Chernoruckiy, A. Filchenkov\",\"doi\":\"10.1145/3437802.3437822\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We investigate the usage of hybrid convolutional and long- short-term memory neural networks for joint slot filling and intent detection in spoken language understanding. We propose a novel model that combines between convolutional neural networks, for their ability to detect complex features in the input sequences by applying filters to frames of these inputs, and recurrent neural networks taking in account the fact, that they can keep track of the long- and short- term dependencies in the input sequences. We choose to build a model for joint slot filling and intent detection, because we believe, that there is a strong relation between the intent and the semantic slots. A joint model can reflect this relation, figure it out and make use of it to enhance the prediction results. We use the Airline Travel Information System (ATIS) dataset to measure the performance of our model and compare it with the results of other models, as this dataset has become one of the most popular datasets for spoken language understanding problem.\",\"PeriodicalId\":429866,\"journal\":{\"name\":\"Proceedings of the 2020 1st International Conference on Control, Robotics and Intelligent System\",\"volume\":\"16 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-10-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2020 1st International Conference on Control, Robotics and Intelligent System\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3437802.3437822\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2020 1st International Conference on Control, Robotics and Intelligent System","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3437802.3437822","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Joint Slot Filling and Intent Detection in Spoken Language Understanding by Hybrid CNN-LSTM Model
We investigate the usage of hybrid convolutional and long- short-term memory neural networks for joint slot filling and intent detection in spoken language understanding. We propose a novel model that combines between convolutional neural networks, for their ability to detect complex features in the input sequences by applying filters to frames of these inputs, and recurrent neural networks taking in account the fact, that they can keep track of the long- and short- term dependencies in the input sequences. We choose to build a model for joint slot filling and intent detection, because we believe, that there is a strong relation between the intent and the semantic slots. A joint model can reflect this relation, figure it out and make use of it to enhance the prediction results. We use the Airline Travel Information System (ATIS) dataset to measure the performance of our model and compare it with the results of other models, as this dataset has become one of the most popular datasets for spoken language understanding problem.