Rutger Beltman, Silke Knossen, Joseph Hill, P. Grosso
{"title":"使用P4和RDMA采集遥测数据","authors":"Rutger Beltman, Silke Knossen, Joseph Hill, P. Grosso","doi":"10.1109/INDIS51933.2020.00006","DOIUrl":null,"url":null,"abstract":"Telemetry data can be carried within network packets as they transit through the network. This in-band telemetry requires in turn to have efficient means for the collection and processing of these data. We show how the P4 language can be used to extract telemetry data from incoming packets, as it allows for efficient controlling of the data plane of network devices. Furthermore, we exploit remote direct memory access (RDMA) as this allows for direct placement of data into the memory of an external machine. We implemented the RDMA over Converged Ethernet (RoCE) protocol in a switch using a P4 program. The program keeps the state of the variables required to perform a write-only operation from the switch to a collector machine. The telemetry data is stored on persistent storage in the machine using memory mapping. Experiments with our implementation show that the telemetry data is saved to the designated addresses. We were able to achieve a rate of around 20 million packets per second without any packet loss.","PeriodicalId":394752,"journal":{"name":"2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"5","resultStr":"{\"title\":\"Using P4 and RDMA to collect telemetry data\",\"authors\":\"Rutger Beltman, Silke Knossen, Joseph Hill, P. Grosso\",\"doi\":\"10.1109/INDIS51933.2020.00006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Telemetry data can be carried within network packets as they transit through the network. This in-band telemetry requires in turn to have efficient means for the collection and processing of these data. We show how the P4 language can be used to extract telemetry data from incoming packets, as it allows for efficient controlling of the data plane of network devices. Furthermore, we exploit remote direct memory access (RDMA) as this allows for direct placement of data into the memory of an external machine. We implemented the RDMA over Converged Ethernet (RoCE) protocol in a switch using a P4 program. The program keeps the state of the variables required to perform a write-only operation from the switch to a collector machine. The telemetry data is stored on persistent storage in the machine using memory mapping. Experiments with our implementation show that the telemetry data is saved to the designated addresses. We were able to achieve a rate of around 20 million packets per second without any packet loss.\",\"PeriodicalId\":394752,\"journal\":{\"name\":\"2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)\",\"volume\":\"42 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"5\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/INDIS51933.2020.00006\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE/ACM Innovating the Network for Data-Intensive Science (INDIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/INDIS51933.2020.00006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 5
摘要
遥测数据可以在网络数据包中通过网络传输。这种带内遥测反过来要求有有效的手段来收集和处理这些数据。我们将展示如何使用P4语言从传入数据包中提取遥测数据,因为它允许对网络设备的数据平面进行有效控制。此外,我们利用远程直接内存访问(RDMA),因为它允许将数据直接放置到外部机器的内存中。我们使用P4程序在交换机中实现了RDMA over Converged Ethernet (RoCE)协议。该程序保存从交换机到收集器机器执行只写操作所需的变量的状态。遥测数据使用内存映射存储在机器的持久存储器上。实验结果表明,遥测数据被保存到指定的地址。我们能够达到每秒大约2000万个数据包的速率,没有任何数据包丢失。
Telemetry data can be carried within network packets as they transit through the network. This in-band telemetry requires in turn to have efficient means for the collection and processing of these data. We show how the P4 language can be used to extract telemetry data from incoming packets, as it allows for efficient controlling of the data plane of network devices. Furthermore, we exploit remote direct memory access (RDMA) as this allows for direct placement of data into the memory of an external machine. We implemented the RDMA over Converged Ethernet (RoCE) protocol in a switch using a P4 program. The program keeps the state of the variables required to perform a write-only operation from the switch to a collector machine. The telemetry data is stored on persistent storage in the machine using memory mapping. Experiments with our implementation show that the telemetry data is saved to the designated addresses. We were able to achieve a rate of around 20 million packets per second without any packet loss.