ViTBAT: Video tracking and behavior annotation tool

Abstract

Reliable and repeatable evaluation of low-level (tracking) and high-level (behavior analysis) vision tasks require annotation of ground-truth information in videos. Depending on the scenarios, ground-truth annotation may be required for individual targets and/or groups of targets. Unlike the existing tools that generally allow an explicit annotation for individual targets only, we propose a tool that enables an explicit annotation both for individual targets and groups of targets for the tracking and behavior recognition tasks together with effective visualization features. Whether for individuals or groups, the tool allows labeling of their states and behaviors manually or semi-automatically through a simple and friendly user interface in a time-efficient manner. Based on a subjective assessment, the proposed tool is found to be more effective than the well-known ViPER tool on a series of defined criteria. A dedicated website makes the tool publicly available for the community.