Affective retrieval: Multimedia data retrieval based on impression

Abstract

Summary form only given. Affective computing and affective engineering have attracted the interests of researchers in the field of information science. Feelings, sensitivity, impressions, and emotions are treated in affective engineering. Multimedia data including pictures, music pieces, and movies give us some impression. Impression should be considered in the multimedia data retrieval. This means that the similarity of multimedia data includes the factor of impression. In the affective retrieval, the similarity of data depends on the similarity of impression. Additionally, impressive words may be specified in retrieval conditions. For example, we may specify the word “fresh” in retrieving pictures and/or music pieces. In order to realize the affective retrieval, impression must be analyzed, and the degrees of impression must be derived or calculated, and be used. In this talk, the background and the end of affective retrieval are presented. Major approaches to affective retrieval are surveyed. A prototype system of affective retrieval is introduced with the demonstration. This system retrieves multimedia data based on the similarity of impression. Impressive words could be specified in the retrieval. It is also shown that affective retrieval easily enables cross-media retrieval.