The Wormhole AI Training Processor

Abstract

Deep-Learning Artificial Intelligence is a hot and growing field, requiring a challenging mix of performance, power efficiency, programmability, scalability, and low price. Wormhole is an AI training processor directly targeted at this field, designed for high performance (TOPS and TFLOPS), software enablement, extreme scalability, and high performance-per-watt-per-dollar.