Topic Detection for Video Stream based on Geographical Relationships and its Interactive Viewing System

During the recent years of Internet TV spread, researches on recommending relevant information for TV programs have been actively conducted. The NHK’s Hybridcast provides a service that recommends relevant information on the same screen during the broadcast of a TV program. However, there is currently no service for recommending supplementary information based on the users’ viewing behavior. Based on this research background, we first extract geographic words (location names) and topics of each scene using closed captions of TV programs. Next, we analyze the user’s viewing behavior to extract the scenes selected by the user in the sequence. After that, we can detect the topics of the user’s selected scenes. Therefore, the supplementary information is recommended by generating queries based on geographical relationships using geographical words and topics. In this paper, we discuss our proposed system for supporting interactive viewing of TV programs, which is based on the viewing behavior of users and geographic relationships.