MITPose: Multi-Granularity Feature Interaction for Human Pose Estimation

Human pose estimation is broadly used in action recognition, Re-Identity, and multi-object tracking. Recently deep convolutional neural networks have demonstrated their great power in human pose estimation. However, CNN-based methods are limited by the constrained receptive field that has poor performance in modeling global relationships of different body parts. In this paper, we propose a novel multi-granularity feature interaction network for human pose estimation (MITPose), which exploits the multi-granularity feature interaction in global-local level features, multi-scale features, and locality features. Our MITPose can efficiently leverage the long-range representation ability of transformer net and inductive locality of convolution net to obtain the comprehensive information for key point localization and relationship modeling. Extensive experiments illustrate that our proposed MITPose achieves state-of-the-art performance on the public COCO dataset.