Recognizer characterisation for combining handwriting recognition results at word level

Abstract

The paper concentrates on the combination of results of multiple recognizers at the word level. Two approaches are presented: word list merging and linear combination. Word list merging requires no knowledge about the individual recognizers. The linear combination is an attempt to exploit the information about characteristics of individual recognizers. This appears more complex than in the case of combination of results at the character level. Recognition of words is influenced by more factors, which can independently affect the recognition process. Characterisation of recognizers, used for word level combination, is more complex and requires more than a simple consideration of recognition success and failure. The concept of handwriting data characterisation is defined. A number of handwriting characteristics are extracted and used to guide the combination process. The choice of characteristics is made in the context of recognition methods used. No attempt at general characterisation of handwriting is made. The relationship between handwriting characteristics and recognition results is observed and used to obtain characteristics of individual recognizers. Results of the two combination methods are reported and compared with another frequently used method for results combination, the Borda count.