Automatic Subtitle Generation for Videos

Abstract

Subtitles are content gotten from either a transcript or screenplay of the discourse or critique in movies, TV programs, computer games. In a lion's share of cases inside a video, the sound holds a critical spot. At present, to incorporate subtitles into the videos, we have to download them from a third-party source and manually add it to our media player of choice. This poses a few problems: The video content we are trying to transcribe may not always have subtitles readily available for it and an active internet connection would be required to even be able to search for such a resource before we can consume it. We aim to try to solve these problems by performing a comparative analysis of various speech recognition engines in a real-time use case, i.e. generating subtitles for a video being played on a media player in an offline environment. Among the speech recognition engines that were compared, DeepSpeech obtained the lower Word Error Rate (WER) of twenty-six percentage, but when we consider system resource usage as well, CMU Sphinx proves to be a better overall engine for the given use case.