PCIe P2P Communication for the High Performance Heterogeneous Computing System

Abstract

PCIe’s point-to-point transmissions provides a low data latency in a computer host. To eliminate the TCP/IP stack bottleneck and improve the service performance in data center, a PCIe P2P transmission for the high-performance heterogeneous computing system is addressed. Based on basic elements including the specific PCIe adapter and PCIe switch, a PCIe P2P data transfers mechanism among the heterogeneous service nodes had been proposed. To implement the point-to-point data transfers mechanism, the related functions and interfaces in the portable software stack had been designed based on the fast-remote memory access network. It does not introduce extra processing overheads to the data transmission process among multiple service hosts, and simplifies the function calling of the related P2P data transfer mechanism. The performance analysis shows that the proposed data transfers mechanism is able to achieve a low latency, high-throughput distributed computing solutions, and can provide a kind of peer-to-peer transmission solution with low-latency and high-bandwidth to improve the processing for the computing cluster and high-performance data center.