Intelligent Film Assistant for Personalized Video Creation on Mobile Devices

Abstract

We describe the development of an intelligent film assistant system that supports the creation of professional video content on mobile devices such as smart phones by amateur users. Cinematographic expert knowledge on scene composition and camera motion is provided to the user in the form of story boards that are tailored to specific use cases. We give an overview of the project concept and some selected components including algorithms that are required for video stabilization and shot classification. The goal is to translate the scene characteristics detected by the vision algorithms into real-time feedback to the user during video recording and to support post-production. A major focus of the project is the incorporation of human-centered design principles with usability studies and expert interviews into the whole research process.