Dianne S. V. Medeiros, H. N. C. Neto, Martin Andreoni Lopez, Luiz Claudio S. Magalhães, N. Fernandes, A. Vieira, E. F. Silva, D. M. F. Mattos
{"title":"A survey on data analysis on large-Scale wireless networks: online stream processing, trends, and challenges","authors":"Dianne S. V. Medeiros, H. N. C. Neto, Martin Andreoni Lopez, Luiz Claudio S. Magalhães, N. Fernandes, A. Vieira, E. F. Silva, D. M. F. Mattos","doi":"10.21203/rs.3.rs-17789/v1","DOIUrl":null,"url":null,"abstract":"In this paper we focus on knowledge extraction from large-scale wireless networks through stream processing. We present the primary methods for sampling, data collection, and monitoring of wireless networks and we characterize knowledge extraction as a machine learning problem on big data stream processing. We show the main trends in big data stream processing frameworks. Additionally, we explore the data preprocessing, feature engineering, and the machine learning algorithms applied to the scenario of wireless network analytics. We address challenges and present research projects in wireless network monitoring and stream processing. Finally, future perspectives, such as deep learning and reinforcement learning in stream processing, are anticipated.","PeriodicalId":46467,"journal":{"name":"Journal of Internet Services and Applications","volume":"11 1","pages":"1-48"},"PeriodicalIF":2.4000,"publicationDate":"2020-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"22","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Internet Services and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21203/rs.3.rs-17789/v1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 22
Abstract
In this paper we focus on knowledge extraction from large-scale wireless networks through stream processing. We present the primary methods for sampling, data collection, and monitoring of wireless networks and we characterize knowledge extraction as a machine learning problem on big data stream processing. We show the main trends in big data stream processing frameworks. Additionally, we explore the data preprocessing, feature engineering, and the machine learning algorithms applied to the scenario of wireless network analytics. We address challenges and present research projects in wireless network monitoring and stream processing. Finally, future perspectives, such as deep learning and reinforcement learning in stream processing, are anticipated.