{"title":"基于探索性数据分析的UNSW-NB15数据集集成学习分类","authors":"N. Sharma, N. Yadav","doi":"10.1109/icrito51393.2021.9596213","DOIUrl":null,"url":null,"abstract":"Recent advancements in machine learning have made it a tool of choice for different classification and analytical problems. Over the last decade, data has increased exponentially in networking domains, so naturally, there is a need to understand this data to get useful insights. This paper deals with a critical field of computer networking: network security and the possibilities of machine learning automation in this field. We will be doing exploratory data analysis on the benchmark UNSW-NB15 dataset. This dataset is a modern substitute to the outdated KDD'99 dataset as it has greater uniformity of pattern distribution. We will also implement several ensemble algorithms like Random forest, Extra trees, AdaBoost and XGBoost to derive insights from the data and make useful predictions. We calculated all the standard evaluation parameters for a comparative analysis among all the classifiers used. This analysis gives knowledge, investigate difficulties, and future opportunities to propel machine learning in networking. Along these lines, it is a beneficial contribution to enhance the understanding of machine learning for networking, pushing the limits of automation using machine learning for better network management. This paper can give a basic understanding of the data analytics in terms of security using Machine Learning techniques.","PeriodicalId":259978,"journal":{"name":"2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)","volume":"100 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Ensemble Learning based Classification of UNSW-NB15 dataset using Exploratory Data Analysis\",\"authors\":\"N. Sharma, N. Yadav\",\"doi\":\"10.1109/icrito51393.2021.9596213\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent advancements in machine learning have made it a tool of choice for different classification and analytical problems. Over the last decade, data has increased exponentially in networking domains, so naturally, there is a need to understand this data to get useful insights. This paper deals with a critical field of computer networking: network security and the possibilities of machine learning automation in this field. We will be doing exploratory data analysis on the benchmark UNSW-NB15 dataset. This dataset is a modern substitute to the outdated KDD'99 dataset as it has greater uniformity of pattern distribution. We will also implement several ensemble algorithms like Random forest, Extra trees, AdaBoost and XGBoost to derive insights from the data and make useful predictions. We calculated all the standard evaluation parameters for a comparative analysis among all the classifiers used. This analysis gives knowledge, investigate difficulties, and future opportunities to propel machine learning in networking. Along these lines, it is a beneficial contribution to enhance the understanding of machine learning for networking, pushing the limits of automation using machine learning for better network management. This paper can give a basic understanding of the data analytics in terms of security using Machine Learning techniques.\",\"PeriodicalId\":259978,\"journal\":{\"name\":\"2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)\",\"volume\":\"100 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/icrito51393.2021.9596213\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 9th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icrito51393.2021.9596213","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
机器学习的最新进展使其成为解决不同分类和分析问题的首选工具。在过去十年中,网络领域的数据呈指数级增长,因此自然需要了解这些数据以获得有用的见解。本文讨论了计算机网络的一个关键领域:网络安全和机器学习自动化在该领域的可能性。我们将对基准UNSW-NB15数据集进行探索性数据分析。该数据集是过时的KDD'99数据集的现代替代品,因为它具有更大的模式分布均匀性。我们还将实现几个集成算法,如Random forest, Extra trees, AdaBoost和XGBoost,以从数据中获得见解并做出有用的预测。我们计算了所有标准评价参数,以便在所使用的所有分类器之间进行比较分析。这种分析为推动网络中的机器学习提供了知识,调查了困难,并提供了未来的机会。沿着这些思路,这是一个有益的贡献,以增强对网络机器学习的理解,推动自动化的极限,使用机器学习来更好地管理网络。本文可以对使用机器学习技术进行安全方面的数据分析有一个基本的了解。
Ensemble Learning based Classification of UNSW-NB15 dataset using Exploratory Data Analysis
Recent advancements in machine learning have made it a tool of choice for different classification and analytical problems. Over the last decade, data has increased exponentially in networking domains, so naturally, there is a need to understand this data to get useful insights. This paper deals with a critical field of computer networking: network security and the possibilities of machine learning automation in this field. We will be doing exploratory data analysis on the benchmark UNSW-NB15 dataset. This dataset is a modern substitute to the outdated KDD'99 dataset as it has greater uniformity of pattern distribution. We will also implement several ensemble algorithms like Random forest, Extra trees, AdaBoost and XGBoost to derive insights from the data and make useful predictions. We calculated all the standard evaluation parameters for a comparative analysis among all the classifiers used. This analysis gives knowledge, investigate difficulties, and future opportunities to propel machine learning in networking. Along these lines, it is a beneficial contribution to enhance the understanding of machine learning for networking, pushing the limits of automation using machine learning for better network management. This paper can give a basic understanding of the data analytics in terms of security using Machine Learning techniques.