A Survey on Machine Learning based Intrusion Detection Systems Using Apache Spark

Abstract

The emergence and wide application of the Internet have brought convenience to people's lives, but at the same time, it has also brought many security problems. How to protect network security and prevent intrusion detection is the focus of current research. This article adopts the method of review, first introduces the application examples of big data technology and machine learning technology in intrusion detection respectively, and then introduces intrusion detection system, machine learning algorithm and deep learning algorithm in detail. Finally, the model of spark applied to intrusion detection system is listed, and it is concluded that the combination of spark and machine learning technology for intrusion detection system can make it more efficient.