Accurate Classification for HPC Applications Concerning Traffic Matrix Visual Patterns

R. Castro, Celio Trois, L. C. E. Bona, M. Martinello
{"title":"Accurate Classification for HPC Applications Concerning Traffic Matrix Visual Patterns","authors":"R. Castro, Celio Trois, L. C. E. Bona, M. Martinello","doi":"10.1109/NoF50125.2020.9249204","DOIUrl":null,"url":null,"abstract":"The evolution of computing and networking allowed multiple computers to be interconnected, aggregating their processing powers to form High-Performance Computing (HPC) architectures. Applications running in these computational environments process and communicate huge amounts of information, taking several hours or even days to complete their executions so, understanding their computation and communication demands is essential for management purposes. Moreover, although most of HPC applications are implemented with well-known algorithms that tend to follow a given pattern in computation and communication, the classical methods of traffic analysis have not been accurate to classify them. In this sense, we argue that observing and understanding the visual patterns in these applications' traffic matrices (TMs) can provide an accurate classification method. In this paper, we propose TReco, a framework that maintains a database with visual features extracted from these TMs and applies machine learning techniques to classify the HPC applications that are consuming the network, regardless of the number of computational nodes executing it. In our experiments, we reached accuracy rate over 99.75%.","PeriodicalId":405626,"journal":{"name":"2020 11th International Conference on Network of the Future (NoF)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 11th International Conference on Network of the Future (NoF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NoF50125.2020.9249204","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The evolution of computing and networking allowed multiple computers to be interconnected, aggregating their processing powers to form High-Performance Computing (HPC) architectures. Applications running in these computational environments process and communicate huge amounts of information, taking several hours or even days to complete their executions so, understanding their computation and communication demands is essential for management purposes. Moreover, although most of HPC applications are implemented with well-known algorithms that tend to follow a given pattern in computation and communication, the classical methods of traffic analysis have not been accurate to classify them. In this sense, we argue that observing and understanding the visual patterns in these applications' traffic matrices (TMs) can provide an accurate classification method. In this paper, we propose TReco, a framework that maintains a database with visual features extracted from these TMs and applies machine learning techniques to classify the HPC applications that are consuming the network, regardless of the number of computational nodes executing it. In our experiments, we reached accuracy rate over 99.75%.
基于流量矩阵视觉模式的高性能计算应用的精确分类
计算和网络的发展允许多台计算机相互连接,聚合它们的处理能力以形成高性能计算(HPC)体系结构。在这些计算环境中运行的应用程序处理和通信大量的信息,需要几个小时甚至几天的时间来完成它们的执行,因此,了解它们的计算和通信需求对于管理目的至关重要。此外,尽管大多数HPC应用程序是用众所周知的算法实现的,这些算法倾向于遵循给定的计算和通信模式,但经典的流量分析方法并不能准确地对它们进行分类。从这个意义上说,我们认为观察和理解这些应用程序的流量矩阵(TMs)中的视觉模式可以提供一种准确的分类方法。在本文中,我们提出了TReco,这是一个框架,它维护一个数据库,其中包含从这些TMs中提取的视觉特征,并应用机器学习技术对消耗网络的HPC应用程序进行分类,而不管执行它的计算节点的数量。在我们的实验中,准确率达到了99.75%以上。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信