Tianwei Zheng, C. Liu, Beizhan Liu, Mei Wang, Yuancheng Li, Pai Wang, Xuebin Qin, Yuan Guo
{"title":"基于CNN-LSTM和时空注意机制的地下矿山场景识别模型","authors":"Tianwei Zheng, C. Liu, Beizhan Liu, Mei Wang, Yuancheng Li, Pai Wang, Xuebin Qin, Yuan Guo","doi":"10.1109/IS3C50286.2020.00139","DOIUrl":null,"url":null,"abstract":"Based on the convolutional neural network (CNN) and long short-term memory neural network (LSTM), combined with data enhancement technology and spatial-temporal attention mechanism, a scene recognition model is established. In order to balance the difference in the amount of data between different samples, data enhancement technology based on video data samples is introduced. Aiming at improving the performance of the model, a spatial-temporal attention mechanism is used to improve the accuracy of scene recognition. The model sample scenes used in this paper include three types: fully mechanized coal face, coal mine roadway and mining machinery. The experimental verification shows that: compared with the traditional convolutional neural network, the accuracy of the CNN-LSTM model is improved by 2.136%, and the CNN-LSTM model with spatial-temporal attention mechanism is improved by 2.9210/0. The accuracy of the deep CNN-LSTM model with spatial-temporal attention mechanism is about 93.0630/0.","PeriodicalId":143430,"journal":{"name":"2020 International Symposium on Computer, Consumer and Control (IS3C)","volume":"03 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Scene Recognition Model in Underground Mines Based on CNN-LSTM and Spatial-Temporal Attention Mechanism\",\"authors\":\"Tianwei Zheng, C. Liu, Beizhan Liu, Mei Wang, Yuancheng Li, Pai Wang, Xuebin Qin, Yuan Guo\",\"doi\":\"10.1109/IS3C50286.2020.00139\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Based on the convolutional neural network (CNN) and long short-term memory neural network (LSTM), combined with data enhancement technology and spatial-temporal attention mechanism, a scene recognition model is established. In order to balance the difference in the amount of data between different samples, data enhancement technology based on video data samples is introduced. Aiming at improving the performance of the model, a spatial-temporal attention mechanism is used to improve the accuracy of scene recognition. The model sample scenes used in this paper include three types: fully mechanized coal face, coal mine roadway and mining machinery. The experimental verification shows that: compared with the traditional convolutional neural network, the accuracy of the CNN-LSTM model is improved by 2.136%, and the CNN-LSTM model with spatial-temporal attention mechanism is improved by 2.9210/0. The accuracy of the deep CNN-LSTM model with spatial-temporal attention mechanism is about 93.0630/0.\",\"PeriodicalId\":143430,\"journal\":{\"name\":\"2020 International Symposium on Computer, Consumer and Control (IS3C)\",\"volume\":\"03 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Symposium on Computer, Consumer and Control (IS3C)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IS3C50286.2020.00139\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Symposium on Computer, Consumer and Control (IS3C)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IS3C50286.2020.00139","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Scene Recognition Model in Underground Mines Based on CNN-LSTM and Spatial-Temporal Attention Mechanism
Based on the convolutional neural network (CNN) and long short-term memory neural network (LSTM), combined with data enhancement technology and spatial-temporal attention mechanism, a scene recognition model is established. In order to balance the difference in the amount of data between different samples, data enhancement technology based on video data samples is introduced. Aiming at improving the performance of the model, a spatial-temporal attention mechanism is used to improve the accuracy of scene recognition. The model sample scenes used in this paper include three types: fully mechanized coal face, coal mine roadway and mining machinery. The experimental verification shows that: compared with the traditional convolutional neural network, the accuracy of the CNN-LSTM model is improved by 2.136%, and the CNN-LSTM model with spatial-temporal attention mechanism is improved by 2.9210/0. The accuracy of the deep CNN-LSTM model with spatial-temporal attention mechanism is about 93.0630/0.