A permeable expert search strategy approach to multimodal retrieval

Abstract

This paper presents an interactive multimodal retrieval system featuring multiple search strategies. In contrast to the system-centric perspective often found in multimedia retrieval, we follow a more user-centered approach considering the search as an interactive process. To assist in this process, the discussed system supports directed and exploratory search as well as faceted navigation and a transition between these information seeking strategies. In order to integrate these strategies, a consistent retrieval and interaction model based on the principle of polyrepresentation is developed. To complete the functionality, a preference-based mechanism for graded relevance feedback is presented that overcomes limitations of binary as well as total order-based approaches. To improve the learnability of the system and to give users back the feeling of control over the search process, various visualizations are offered that open paths of communication between the system and the user in order to bridge the gap between the system's notion of the information need and the one of the actual user.