The use of genetic programming to build queries for information retrieval

Abstract

Genetic programming is applied to an information retrieval system in order to improve Boolean query formulation via relevance feedback. This approach brings together the concepts of information retrieval and genetic programming. Documents are viewed as vectors in index term space. A Boolean query, viewed as a parse tree, is an organism in the genetic programming sense. Through the mechanisms of genetic programming, the query is modified in order to improve precision and recall. Relevance feedback is incorporated, in part, via user defined measures over a trial set of documents. The fitness of a candidate query can be expressed directly as a function of the relevance of the retrieved set. Preliminary results based on a testbed are given. The form of the fitness function has a significant effect upon performance and the proper fitness functions take into account relevance based on topicality (and perhaps other factors).<>