Emotional video scene retrieval system for lifelog videos based on facial expression intensity

Lifelog videos, which are the records of a person's daily life as video data, draw attention since various recording devices such as smartphone become widely used. Due to privacy reasons, lifelog videos are usually managed by the owners of the videos although the amount of video data is quite large. This makes it quite difficult to find interesting and impressive scenes from lifelog videos. In order to facilitate the retrieval of such scenes, we develop a video scene retrieval system for lifelog videos. We focus on emotional scenes as interesting scenes taking into consideration the strength of emotion derived from the intensity of facial expression. Our retrieval system thus displays emotional scenes of various intensity to users in a comprehensible way. We clarify the usability of the retrieval system through an evaluation experiment.