Uncertainty measures and feature selection based on composite entropy for generalized multigranulation fuzzy neighborhood rough set

Abstract

With the continuous advancement of information technology, the information and data covered by various information systems become increasingly complex and diverse, it is essential to perform knowledge mining from multiple perspectives to extract valuable insights. Fuzzy neighborhood multigranulation rough set, as an excellent feature selection model, is capable of handling heterogeneous datasets more effectively, significantly improving learning efficiency. In this study, we investigate a feature selection method based on a generalized multigranulation fuzzy rough set (GMFNRS) in fuzzy decision systems. First, the concepts of fuzzy neighborhood rough sets and generalized multigranulation rough sets are introduced. Subsequently, the GMFNRS model is established to enable data mining and rule extraction from various perspectives. Secondly, from an informational perspective, the study investigates uncertainty measurement methods through fuzzy neighborhood joint entropy. Furthermore, a novel fuzzy neighborhood generalized composite entropy is proposed by integrating the GMFNRS model with uncertainty measures. Finally, a forward greedy feature selection algorithm is considered to extract essential information from complex datasets. Experimental results on 15 public datasets demonstrate that the proposed model effectively selects important features in fuzzy systems and exhibits excellent classification performance.