{"title":"A real-time smoke early warning method based on spark and improved random forest","authors":"Bowen Wang, Jan Zheng","doi":"10.1109/IIP57348.2022.00087","DOIUrl":null,"url":null,"abstract":"In order to control and prevent fires in advance and effectively reduce the adverse effects of fires, this paper proposes a smoke early warning method based on spark and an improved random forest model. On the basis of the existing Internet of Things acquisition equipment, the real-time reception of the collected data is realized through spark streaming, and the collected data is persisted, and the trained model is used to judge the smoke early warning. The model established by this method is an improved random forest implementation based on the dragonfly optimization algorithm based on the samples collected in various environments. In the data preprocessing, the problem of data imbalance was found in the data set, and the oversampling method was used to solve it. Then this paper analyzes the problems in cross validation after data oversampling and proposes KSMOTE algorithm to solve this problem, which effectively improves the classification ability of the model. The experimental results show that the system has good real-time performance and accuracy.","PeriodicalId":412907,"journal":{"name":"2022 4th International Conference on Intelligent Information Processing (IIP)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 4th International Conference on Intelligent Information Processing (IIP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IIP57348.2022.00087","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In order to control and prevent fires in advance and effectively reduce the adverse effects of fires, this paper proposes a smoke early warning method based on spark and an improved random forest model. On the basis of the existing Internet of Things acquisition equipment, the real-time reception of the collected data is realized through spark streaming, and the collected data is persisted, and the trained model is used to judge the smoke early warning. The model established by this method is an improved random forest implementation based on the dragonfly optimization algorithm based on the samples collected in various environments. In the data preprocessing, the problem of data imbalance was found in the data set, and the oversampling method was used to solve it. Then this paper analyzes the problems in cross validation after data oversampling and proposes KSMOTE algorithm to solve this problem, which effectively improves the classification ability of the model. The experimental results show that the system has good real-time performance and accuracy.