Network Compression via Cooperative Architecture Search and Distillation

Abstract

Neural Architecture Search (NAS) and its variants are competitive in many computer vision tasks lately. In this paper, we develop a Cooperative Architecture Search and Distillation (CASD) method for network compression. Compared with prior art, our method achieves better performance in ResNet164 pruning on CIFAR-10 and CIFAR-100 image classifications, promising to be extended to other tasks.