How to integrate interactions into video editing software?

Abstract

This paper explores an idea to enrich existing mulsemedia editing software, getting inspiration from music scores, to have them integrate actions coming from the viewer while editing a mulsemedia. In this paper, we reflect on the possibility to do it with a unique timeline. Thus, we propose to completely change the point of view. Instead of trying to insert the interaction in the timeline, we propose to cut the media into several parts and insert them into the interaction.