Mixture of truncated exponentials in supervised classification: Case study for the naive bayes and averaged one-dependence estimators classifiers

Abstract

The Averaged One-Dependence Estimators (AODE) classifier is one of the most attractive semi-naive Bayesian classifiers and hence a good alternative to Naive Bayes (NB), as it obtains fairly low error rates maintaining under control the computational complexity. Unfortunately, as most of the methods designed within the framework of Bayesian networks, AODE is exclusively defined to deal with discrete variables. Several approaches to avoid the use of discretization pre-processing techniques have already been presented, all of them involving in lower or greater degree the assumption of (conditional) Gaussian distributions. In this paper, we propose the use of Mixture of Truncated Exponentials (MTEs), whose expressive power to accurately approximate the most commonly used distributions for hybrid networks has already been demonstrated. We perform experiments on the use of MTEs over a large group of datasets for the first time, and we analyze the importance of selecting a proper number of points when learning MTEs for NB and AODE, as we believe, it is decisive to provide accurate results.