Evaluation of the new feature types for question classification with support vector machines

Abstract

Question classification is of crucial importance for question answering. In question classification, the accuracy of machine learning algorithms was found to significantly outperform other approaches. The two key issues in classification with a ML-based approach are classifier design and feature selection. Support vector machines is known to work well for sparse, high dimensional problems. However, the frequently used bag-of-words approach does not take full advantage of information contained in a question. To exploit this information we introduce three new feature types: subordinate word category, question focus and syntactic-semantic structure. As the results demonstrate, the inclusion of the new features provides higher accuracy of question classification compared to the standard bag-of-words approach and other ML based methods such as SVM with the tree kernel, SVM with error correcting codes and SNoW. A classification accuracy of 84.6% obtained using the three introduced feature types is as of yet the highest reported in the literature.