Theme-Based Multi-class Object Recognition and Segmentation

Abstract

In this paper, we propose a new theme-based CRF model and investigate its performance on class based pixel-wise segmentation of images. By including the theme of an image, we also propose a new texture-environment potential to represent texture environment of a pixel, which alone gives satisfactory recognition results. The pixel-wise segmentation accuracy is remarkably improved by introducing texture potential. We compare our results to recent published results on the MSRC 21-class database and show that our theme-based CRF model significantly outperforms the current state-of-the-art. Especially, by assigning a theme for each image, our model obtains greatly improved accuracy of structured classes with high visual variability and fewer training examples, the accuracy of which is very low in most related works.