The Mecanex system for Multimedia Content Annotation

Abstract

A system for efficient multimedia content analysis and automatic annotation is presented in this paper. The system is able to identify objects in videos and annotate them with metadata. It includes three modules: the first provides detection and recognition of faces; the second provides generic object detection, based on a deep convolutional neural network; the third provides automated location estimation and landmark recognition based on the state-of-the-art technologies of Bag-of-Words and RANSAC. The system has been developed and successfully tested in the framework of the EC Horizon 2020 Mecanex project, targeting advertising and campaign production markets.