Dynamic Individual Selection and Crossover Boosted Forensic-based Investigation Algorithm for Global Optimization and Feature Selection

Abstract

Abst

The advent of Big Data has rendered Machine Learning tasks more intricate as they frequently involve higher-dimensional data. Feature Selection (FS) methods can abate the complexity of the data and enhance the accuracy, generalizability, and interpretability of models. Meta-heuristic algorithms are often utilized for FS tasks due to their low requirements and efficient performance. This paper introduces an augmented Forensic-Based Investigation algorithm (DCFBI) that incorporates a Dynamic Individual Selection (DIS) and crisscross (CC) mechanism to improve the pursuit phase of the FBI. Moreover, a binary version of DCFBI (BDCFBI) is applied to FS. Experiments conducted on IEEE CEC 2017 with other metaheuristics demonstrate that DCFBI surpasses them in search capability. The influence of different mechanisms on the original FBI is analyzed on benchmark functions, while its scalability is verified by comparing it with the original FBI on benchmarks with varied dimensions. BDCFBI is then applied to 18 real datasets from the UCI machine learning database and the Wieslaw dataset to select near-optimal features, which are then compared with six renowned binary metaheuristics. The results show that BDCFBI can be more competitive than similar methods and acquire a subset of features with superior classification accuracy.