What are You Posing: A gesture description dataset based on coarse-grained semantics

At present, algorithms for human pose estimation and image caption are prosperous but have disadvantages. The current mainstream algorithms of pose estimation only present the information of key nodes as a scalar but lacks semantics, while in most of algorithms for human image captioning, more attention is paid to the relationship between human bodies and the background, without understanding the human body semantics, which can not meet the need of deep visual understanding.In this paper, to fill in imperfection in previous studies, we provide a novel data set of the caption of human pose estimation for the deep understanding of image semantics. Moreover, we use the pose estimation system to extract posture figures and then we utilize the encoder-decoder to generate the captions of human poses in single picture, to produce deeper understanding of the original image. Lastly, we use Bert to carry out the next step of reasoning and get a further understanding. Our data set is open source.