降低FPGA实现深度学习在线异常入侵检测算法的计算量

Khaled Alrawashdeh, C. Purdy
{"title":"降低FPGA实现深度学习在线异常入侵检测算法的计算量","authors":"Khaled Alrawashdeh, C. Purdy","doi":"10.1109/NAECON.2017.8268745","DOIUrl":null,"url":null,"abstract":"Deep learning algorithms produced impressive results in the image and voice recognition fields. Machine learning approach can be implemented to improve anomaly detection method to detect novel attacks. We use dynamic fixed-point arithmetic to reduce Deep Belief Network (DBN) calculations in an FPGA. We trained a three-layer DBN using contrastive divergence with pipeline structure, fine-tuning the network using a softmax function. Our work using dynamic fixed-point arithmetic and pipeline structure reduced the calculation requirement of the DBN more than 30% compare to the 16-bit implementation. We used the MNIST dataset for evaluation before testing online intrusion detection and achieved accuracy of 94.6% on the NSL-KDD dataset and 95.1% on the HTTP CSIC 2010 dataset. We produced efficient resource utilization and detection speed of .008ms. Our design can be further improved to decrease deep learning resources during training and testing for online intrusion detection in low powered devices.","PeriodicalId":306091,"journal":{"name":"2017 IEEE National Aerospace and Electronics Conference (NAECON)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2017-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"18","resultStr":"{\"title\":\"Reducing calculation requirements in FPGA implementation of deep learning algorithms for online anomaly intrusion detection\",\"authors\":\"Khaled Alrawashdeh, C. Purdy\",\"doi\":\"10.1109/NAECON.2017.8268745\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep learning algorithms produced impressive results in the image and voice recognition fields. Machine learning approach can be implemented to improve anomaly detection method to detect novel attacks. We use dynamic fixed-point arithmetic to reduce Deep Belief Network (DBN) calculations in an FPGA. We trained a three-layer DBN using contrastive divergence with pipeline structure, fine-tuning the network using a softmax function. Our work using dynamic fixed-point arithmetic and pipeline structure reduced the calculation requirement of the DBN more than 30% compare to the 16-bit implementation. We used the MNIST dataset for evaluation before testing online intrusion detection and achieved accuracy of 94.6% on the NSL-KDD dataset and 95.1% on the HTTP CSIC 2010 dataset. We produced efficient resource utilization and detection speed of .008ms. Our design can be further improved to decrease deep learning resources during training and testing for online intrusion detection in low powered devices.\",\"PeriodicalId\":306091,\"journal\":{\"name\":\"2017 IEEE National Aerospace and Electronics Conference (NAECON)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"18\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2017 IEEE National Aerospace and Electronics Conference (NAECON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NAECON.2017.8268745\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 IEEE National Aerospace and Electronics Conference (NAECON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NAECON.2017.8268745","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 18

摘要

深度学习算法在图像和语音识别领域取得了令人印象深刻的成果。利用机器学习方法改进异常检测方法,检测出新的攻击。在FPGA中采用动态不动点算法减少深度信念网络(DBN)的计算量。我们使用管道结构的对比发散训练了一个三层DBN,并使用softmax函数对网络进行了微调。我们的工作使用动态定点算法和管道结构,与16位实现相比,DBN的计算需求减少了30%以上。在测试在线入侵检测之前,我们使用MNIST数据集进行评估,在NSL-KDD数据集上实现了94.6%的准确率,在HTTP CSIC 2010数据集上实现了95.1%的准确率。我们产生了高效的资源利用率和0.008 ms的检测速度。我们的设计可以进一步改进,以减少低功耗设备在线入侵检测训练和测试期间的深度学习资源。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Reducing calculation requirements in FPGA implementation of deep learning algorithms for online anomaly intrusion detection
Deep learning algorithms produced impressive results in the image and voice recognition fields. Machine learning approach can be implemented to improve anomaly detection method to detect novel attacks. We use dynamic fixed-point arithmetic to reduce Deep Belief Network (DBN) calculations in an FPGA. We trained a three-layer DBN using contrastive divergence with pipeline structure, fine-tuning the network using a softmax function. Our work using dynamic fixed-point arithmetic and pipeline structure reduced the calculation requirement of the DBN more than 30% compare to the 16-bit implementation. We used the MNIST dataset for evaluation before testing online intrusion detection and achieved accuracy of 94.6% on the NSL-KDD dataset and 95.1% on the HTTP CSIC 2010 dataset. We produced efficient resource utilization and detection speed of .008ms. Our design can be further improved to decrease deep learning resources during training and testing for online intrusion detection in low powered devices.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信