NLP-Enriched Automatic Video Segmentation

Abstract

E-learning environments are heavily dependent on videos as the main media to deliver lectures to learners. Despite the merits of video-based lectures, new challenges can paralyze the learning process. Challenges that deal with video content accessibility, such as searching, retrieving, explaining, matching, organizing, and even summarizing these contents, significantly limit the potential of video-based learning. In this paper, we propose a novel approach to segment video lectures and integrate Natural Language Processing (NLP) tasks to extract key linguistic features exist within the video. We exploit the benefits of visual, audio, and textual features in order to create comprehensive temporal feature vectors for the enhanced segmented video. Afterwards, we apply an NLP cosine similarity to the cluster and identify the various topics presented in the video. The final product would be an indexed, vector-based searchable video segments of a specific topic/subtopic