Stefano Iannucci, Ovidiu Daniel Barba, V. Cardellini, I. Banicescu
{"title":"基于模型的入侵响应深度强化学习性能评价","authors":"Stefano Iannucci, Ovidiu Daniel Barba, V. Cardellini, I. Banicescu","doi":"10.1109/FAS-W.2019.00047","DOIUrl":null,"url":null,"abstract":"Given the always increasing size of computer systems, manually protecting them in case of attacks is infeasible and error-prone. For this reason, several Intrusion Response Systems (IRSs) have been proposed so far, with the purpose of limiting the amount of work of an administrator. However, since the most advanced IRSs adopt a stateful approach, they are subject to what Bellman defined as the curse of dimensionality. In this paper, we propose an approach based on deep reinforcement learning which, to the best of our knowledge, has never been used until now for intrusion response. Experimental results show that the proposed approach reduces the time needed for the computation of defense policies by orders of magnitude, while providing near-optimal rewards.","PeriodicalId":368308,"journal":{"name":"2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"14","resultStr":"{\"title\":\"A Performance Evaluation of Deep Reinforcement Learning for Model-Based Intrusion Response\",\"authors\":\"Stefano Iannucci, Ovidiu Daniel Barba, V. Cardellini, I. Banicescu\",\"doi\":\"10.1109/FAS-W.2019.00047\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Given the always increasing size of computer systems, manually protecting them in case of attacks is infeasible and error-prone. For this reason, several Intrusion Response Systems (IRSs) have been proposed so far, with the purpose of limiting the amount of work of an administrator. However, since the most advanced IRSs adopt a stateful approach, they are subject to what Bellman defined as the curse of dimensionality. In this paper, we propose an approach based on deep reinforcement learning which, to the best of our knowledge, has never been used until now for intrusion response. Experimental results show that the proposed approach reduces the time needed for the computation of defense policies by orders of magnitude, while providing near-optimal rewards.\",\"PeriodicalId\":368308,\"journal\":{\"name\":\"2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)\",\"volume\":\"20 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"14\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/FAS-W.2019.00047\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/FAS-W.2019.00047","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Performance Evaluation of Deep Reinforcement Learning for Model-Based Intrusion Response
Given the always increasing size of computer systems, manually protecting them in case of attacks is infeasible and error-prone. For this reason, several Intrusion Response Systems (IRSs) have been proposed so far, with the purpose of limiting the amount of work of an administrator. However, since the most advanced IRSs adopt a stateful approach, they are subject to what Bellman defined as the curse of dimensionality. In this paper, we propose an approach based on deep reinforcement learning which, to the best of our knowledge, has never been used until now for intrusion response. Experimental results show that the proposed approach reduces the time needed for the computation of defense policies by orders of magnitude, while providing near-optimal rewards.