Adaptive Flow Aggregation - A New Solution for Robust Flow Monitoring under Security Attacks

Yan Hu, D. Chiu, John C.S. Lui
{"title":"Adaptive Flow Aggregation - A New Solution for Robust Flow Monitoring under Security Attacks","authors":"Yan Hu, D. Chiu, John C.S. Lui","doi":"10.1109/NOMS.2006.1687572","DOIUrl":null,"url":null,"abstract":"Flow-level traffic measurement is required for a wide range of applications including accounting, network planning and security management. A key design challenge is how to gracefully deal with traffic surges that exhaust the resources (memory, export bandwidth or CPU) of the flow monitor. A standard solution is to do sampling (look at one out of every n packets). This is implemented in Cisco’s Netflow, a popular platform. Setting the sampling rate according to the normal traffic, however, cannot avoid overrunning available memory for flow records during abnormal situations, such as when there is a DoS attack or other security breaches. Currently available countermeasures have their own problems: (1) reject new flows when the cache is full - some legitimate new flows will not be counted; (2) export not-terminated flows to make room for new ones - this will exhaust the export bandwidth; (3) adapt the sampling rate to traffic rate - this will reduce the overall accuracy of accounting, including legitimate flows. In this paper, we propose a new counter-measure to deal with abnormal traffic conditions - adaptive flow aggregation. Often the reason for abnormal traffic conditions is due to security attacks. Fortunately, such attacks usually have some common patterns. For example, packets of DoS attacks have the same destination IP address, while traffic for worm spreading has the same source IP address. Our flow monitoring algorithm identifies these traffic clusters in real-time and aggregates these large amount of short flows into a few flows.","PeriodicalId":297324,"journal":{"name":"2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006","volume":"39 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2006-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"25","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NOMS.2006.1687572","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 25

Abstract

Flow-level traffic measurement is required for a wide range of applications including accounting, network planning and security management. A key design challenge is how to gracefully deal with traffic surges that exhaust the resources (memory, export bandwidth or CPU) of the flow monitor. A standard solution is to do sampling (look at one out of every n packets). This is implemented in Cisco’s Netflow, a popular platform. Setting the sampling rate according to the normal traffic, however, cannot avoid overrunning available memory for flow records during abnormal situations, such as when there is a DoS attack or other security breaches. Currently available countermeasures have their own problems: (1) reject new flows when the cache is full - some legitimate new flows will not be counted; (2) export not-terminated flows to make room for new ones - this will exhaust the export bandwidth; (3) adapt the sampling rate to traffic rate - this will reduce the overall accuracy of accounting, including legitimate flows. In this paper, we propose a new counter-measure to deal with abnormal traffic conditions - adaptive flow aggregation. Often the reason for abnormal traffic conditions is due to security attacks. Fortunately, such attacks usually have some common patterns. For example, packets of DoS attacks have the same destination IP address, while traffic for worm spreading has the same source IP address. Our flow monitoring algorithm identifies these traffic clusters in real-time and aggregates these large amount of short flows into a few flows.
自适应流量聚合——一种安全攻击下鲁棒流量监控的新方案
流量级流量测量在会计、网络规划和安全管理等广泛的应用中都是必需的。一个关键的设计挑战是如何优雅地处理耗尽流量监视器资源(内存、导出带宽或CPU)的流量激增。一个标准的解决方案是进行抽样(每n个数据包中查看一个)。这是在思科的Netflow中实现的,这是一个流行的平台。但是,按照正常流量设置采样率,不能避免在出现异常情况(如DoS攻击或其他安全漏洞)时,流量记录占用的可用内存过大。目前可用的对策有其自身的问题:(1)在缓存已满时拒绝新流——一些合法的新流将不被计算;(2)输出未终止的流量,为新的流量腾出空间——这将耗尽输出带宽;(3)使抽样率与流量率相适应——这将降低会计的整体准确性,包括合法流量。本文提出了一种新的应对异常交通状况的对策——自适应流聚合。流量异常的原因往往是由于安全攻击。幸运的是,这种攻击通常有一些共同的模式。例如,DoS攻击报文的目的IP地址相同,蠕虫传播流量的源IP地址相同。我们的流量监控算法实时识别这些流量集群,并将这些大量的短流聚合成几个流。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书