An evaluation scheme for hierarchical information browsing structures

Abstract

There is no widely accepted means of evaluating category systems for information search and browsing. This presentation outlines an evaluation scheme and an evaluation method that applies the scheme. The scheme delineates features broadly classified under comprehensiveness, coherence, and correctness. The method evaluates the category system through a survey distributed among subject domain experts. The method requires minimal resources, is easily conducted remotely, and is easily modified. The approach finds the over- and under-sensitivities of the method of generating the system. A case study has demonstrated the usefulness of the approach, and the inter-rater reliability found suggests that the evaluation scheme is meaningful.