A Video-Browsing-Enhanced Personal Video Recorder

Abstract

We present the world's first highlights-playback-capable hard disk drive (HDD)-enhanced DVD recorder (personal video recorder-PVR). It automatically detects highlights in sports video by detecting portions with a mixture of the commentator's excited speech and cheering, using Gaussian mixture models (GMM's) trained using the MDL criterion. Our computation is carried out directly on the MDCT coefficients from the AC-3 coefficients thus giving us a tremendous speed advantage. Our accuracy of detection of sports highlights is high across a variety of sports. Our user-study shows that viewers like the new functionality even if it makes mistakes. Finally, we propose genre-independent temporal segmentation of non-sports content using computationally inexpensive audio-visual features. Such segmentation enables "smart skipping, "from one semantic unit to another.