Practical considerations when filtering documents

Abstract

Implementing, configuring, and running an information filtering system in a practical setting is a difficult and challenging problem. This is due to variety and configuration of available system components along with additional factors such as topic length, feedback, and system training. Moreover, the interplay between the different components and additional factors can lead to degraded system performance when adding or manipulating particular components. We explore the interactions and effects of different components and some of the factors with respect to performance. The main contribution of this paper is a better understanding of how to configure filtering systems along with the possible pitfalls of applying conflicting components which harm performance and result in a poor user experience.