Modeling of Verb Representation for Visual Data Understanding

Abstract

This paper aims to propose a design and architecture of a lexicon of verbs that would help in parsing visual scenes into linguistically grounded representation as well as in generating the semantic representations. To this end, we look over verb representation in linguistics for a skeleton architecture of a model and observe visual data in order to extract detailed properties embedded in visual scenes. This paper mentions early results of modeling works so we need to explorer various factors and apply them in the modeling works continuously.