Online Knowledge Distillation for Efficient Action Recognition

Abstract

Existing skeleton-based action recognition methods require heavy computational resources for accurate predictions. One promising technique to obtain an accurate yet lightweight action recognition network is knowledge distillation (KD), which distills the knowledge from a powerful teacher model to a less-parameterized student model. However, existing distillation works in action recognition require a pre-trained teacher network and a two-stage learning procedure. In this work, we propose a novel Online Knowledge Distillation framework by distilling Action Recognition structure knowledge in a one-stage manner to improve the distillation efficiency, termed OKDAR. Specifically, OKDAR learns a single multi-branch network and acquires the predictions from each one, which is then assembled by a feature mix model as the implicit teacher network to teach each student in reverse. The effectiveness of our approach is demonstrated by extensive experiments on two common benchmarks, i.e., NTU-RGB+D 60 and NTU-RGB+D 120.