An Advanced Cold Plate Liquid Cooling Rack Design for Hyperscale Data Center

Abstract

As the emerging business models and advanced customer experience is driving an explosion of data at the era of 5G, data center has been evolving with increasingly powerful AI (Artificial Intelligence) computing capability for enhancing CSP (Cloud Service Provider) cloud service by data analytics in data centric world. High-performance computing, storage and networking are essential to achieve this. Meanwhile, energy efficiency, which is measured by PUE, is the mandatory design target for modern data center. The cold plate liquid cooling solution is one of crucial technologies to continual address the demand of higher performance computing at lower PUE. This paper introduces an advanced cold plate liquid cooling rack architecture for JD.COM data center as well as the key learnings from JD.com engineering practice and validation data, including system level liquid cooling design related ingredients’ design and selection, such as CPU cold plates, memory cold plates, leakage detection, and quick disconnects, etc. Moreover, JD.COM’s novel methodology for optimized CPU cold plate design as well as the implementation of whole-loop leakage detection in a JD.COM datacenter are also introduced.