Nonverbal query driven interactive search systems: a study on language agnostic information access technologies

Abstract

This work is concentrated on analyzing possibilities for retrieving and presenting the information available on the web, without the explicit need to formulate precise queries. The research question of our work can be formulated as: "Is it possible to retrieve information without clearly formulated verbal query?" For this consortium we present our prototype of interactive image search system called "Gaze Learning Access and Search Engine" (GLASE) version 0.1, which can perform relevance calculation based on gaze data and within-session learning. The search user interface (UI) uses an eye-tracker as an input device and employs a relevance re-ranking algorithm based on the gaze length. The preliminary experimental results showed that using our gaze-driven system reduced the task completion time an average of 13.7% in a search session.