Evaluating A Personal Information Assistant

Abstract

Personal Information Assistants that search on user's behalf aim to fetch relevant documents on a regular basis. We have developed such assistant system and evaluated it using a long-term, task-oriented approach involving real users. Current evaluation methodologies are inadequate and hence have resorted to a long-term real user study. This paper describes the design and development of our system and the results of the evaluation study.