Feature Selection for Fuzzy Neural Networks using Group Lasso Regularization

Abstract

In this paper, a Group Lasso penalty based em-bedded/integrated feature selection method for multiple-input and multiple-output (MIMO) Takagi-Sugeno (TS) fuzzy neural network (FNN) is proposed. Group Lasso regularization can produce sparsity on the widths of the modified Gaussian membership function and this can guide us to select the useful features. Compared with Lasso, Group Lasso formulation has a Group penalty to the set of widths (weights) connected to a particular feature. To address the non-differentiability of the Group Lasso term, a smoothing Group Lasso method is introduced. Finally, one benchmark classification problem and two regression problems are used to validate the effectiveness of the proposed method.